Aug 15 19:01:02 user nova-compute[73188]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 15 19:01:05 user nova-compute[73188]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73188) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73188) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73188) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 19:01:05 user nova-compute[73188]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:01:05 user nova-compute[73188]: INFO nova.virt.driver [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 15 19:01:05 user nova-compute[73188]: INFO nova.compute.provider_config [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] Acquiring lock "singleton_lock" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] Acquired lock "singleton_lock" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] Releasing lock "singleton_lock" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] Full set of CONF: {{(pid=73188) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ******************************************************************************** {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] Configuration options gathered from: {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ================================================================================ {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] allow_resize_to_same_host      = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] arq_binding_timeout            = 300 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] backdoor_port                  = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] backdoor_socket                = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] block_device_allocate_retries  = 300 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] block_device_allocate_retries_interval = 5 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cert                           = self.pem {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] compute_monitors               = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] config_dir                     = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] config_drive_format            = iso9660 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] config_source                  = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] console_host                   = user {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] control_exchange               = nova {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cpu_allocation_ratio           = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] daemon                         = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] debug                          = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] default_access_ip_network_name = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] default_availability_zone      = nova {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] default_ephemeral_format       = ext4 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] default_schedule_zone          = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] disk_allocation_ratio          = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] enable_new_services            = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] enabled_ssl_apis               = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] flat_injected                  = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] force_config_drive             = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] force_raw_images               = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] graceful_shutdown_timeout      = 5 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] heal_instance_info_cache_interval = 60 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] host                           = user {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] instance_build_timeout         = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] instance_delete_interval       = 300 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] instance_name_template         = instance-%08x {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] instance_usage_audit           = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] instance_usage_audit_period    = month {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] internal_service_availability_zone = internal {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] key                            = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] live_migration_retry_count     = 30 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] log_config_append              = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] log_dir                        = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] log_file                       = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] log_options                    = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] log_rotate_interval            = 1 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] log_rotate_interval_type       = days {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] log_rotation_type              = none {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] long_rpc_timeout               = 1800 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] max_concurrent_builds          = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] max_concurrent_live_migrations = 1 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] max_concurrent_snapshots       = 5 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] max_local_block_devices        = 3 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] max_logfile_count              = 30 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] max_logfile_size_mb            = 200 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] maximum_instance_delete_attempts = 5 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] metadata_listen                = 0.0.0.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] metadata_listen_port           = 8775 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] metadata_workers               = 3 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] migrate_max_retries            = -1 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] mkisofs_cmd                    = genisoimage {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] my_ip                          = 10.0.0.210 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] network_allocate_retries       = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] osapi_compute_listen_port      = 8774 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] osapi_compute_unique_server_name_scope =  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] osapi_compute_workers          = 3 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] password_length                = 12 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] periodic_enable                = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] periodic_fuzzy_delay           = 60 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] pointer_model                  = ps2mouse {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] preallocate_images             = none {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] publish_errors                 = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] pybasedir                      = /opt/stack/nova {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ram_allocation_ratio           = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] rate_limit_burst               = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] rate_limit_except_level        = CRITICAL {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] rate_limit_interval            = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] reboot_timeout                 = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] reclaim_instance_interval      = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] record                         = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] reimage_timeout_per_gb         = 60 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] report_interval                = 120 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] rescue_timeout                 = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] reserved_host_cpus             = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] reserved_host_disk_mb          = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] reserved_host_memory_mb        = 512 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] reserved_huge_pages            = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] resize_confirm_window          = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] resize_fs_using_block_device   = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] resume_guests_state_on_host_boot = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] rpc_response_timeout           = 60 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] run_external_periodic_tasks    = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] running_deleted_instance_action = reap {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] running_deleted_instance_timeout = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] scheduler_instance_sync_interval = 120 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] service_down_time              = 720 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] servicegroup_driver            = db {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] shelved_offload_time           = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] shelved_poll_interval          = 3600 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] shutdown_timeout               = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] source_is_ipv6                 = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ssl_only                       = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] state_path                     = /opt/stack/data/nova {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] sync_power_state_interval      = 600 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] sync_power_state_pool_size     = 1000 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] syslog_log_facility            = LOG_USER {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] tempdir                        = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] timeout_nbd                    = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] transport_url                  = **** {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] update_resources_interval      = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] use_cow_images                 = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] use_eventlog                   = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] use_journal                    = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] use_json                       = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] use_rootwrap_daemon            = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] use_stderr                     = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] use_syslog                     = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vcpu_pin_set                   = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vif_plugging_is_fatal          = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vif_plugging_timeout           = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] virt_mkfs                      = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] volume_usage_poll_interval     = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] watch_log_file                 = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] web                            = /usr/share/spice-html5 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_concurrency.disable_process_locking = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.auth_strategy              = keystone {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.compute_link_prefix        = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.dhcp_domain                = novalocal {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.enable_instance_password   = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.glance_link_prefix         = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.instance_list_per_project_cells = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.list_records_by_skipping_down_cells = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.local_metadata_per_cell    = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.max_limit                  = 1000 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.metadata_cache_expiration  = 15 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.neutron_default_tenant_id  = default {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.use_forwarded_for          = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.use_neutron_default_nets   = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.vendordata_dynamic_targets = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.vendordata_jsonfile_path   = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.backend_argument         = **** {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.config_prefix            = cache.oslo {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.dead_timeout             = 60.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.debug_cache_backend      = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.enable_retry_client      = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.enable_socket_keepalive  = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.enabled                  = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.expiration_time          = 600 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.hashclient_retry_attempts = 2 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.memcache_dead_retry      = 300 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.memcache_password        =  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.memcache_sasl_enabled    = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.memcache_username        =  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.proxies                  = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.retry_attempts           = 2 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.retry_delay              = 0.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.socket_keepalive_count   = 1 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.socket_keepalive_idle    = 1 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.socket_keepalive_interval = 1 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.tls_allowed_ciphers      = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.tls_cafile               = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.tls_certfile             = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.tls_enabled              = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cache.tls_keyfile              = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cinder.auth_section            = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cinder.auth_type               = password {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cinder.cafile                  = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cinder.certfile                = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cinder.collect_timing          = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cinder.cross_az_attach         = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cinder.debug                   = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cinder.endpoint_template       = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cinder.http_retries            = 3 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cinder.insecure                = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cinder.keyfile                 = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cinder.os_region_name          = RegionOne {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cinder.split_loggers           = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cinder.timeout                 = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] compute.cpu_dedicated_set      = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] compute.cpu_shared_set         = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] compute.image_type_exclude_list = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] compute.resource_provider_association_refresh = 300 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] compute.shutdown_retry_interval = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] conductor.workers              = 3 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] console.allowed_origins        = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] console.ssl_ciphers            = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] console.ssl_minimum_version    = default {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] consoleauth.token_ttl          = 600 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cyborg.cafile                  = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cyborg.certfile                = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cyborg.collect_timing          = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cyborg.connect_retries         = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cyborg.connect_retry_delay     = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cyborg.endpoint_override       = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cyborg.insecure                = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cyborg.keyfile                 = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cyborg.max_version             = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cyborg.min_version             = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cyborg.region_name             = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cyborg.service_name            = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cyborg.service_type            = accelerator {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cyborg.split_loggers           = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cyborg.status_code_retries     = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cyborg.status_code_retry_delay = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cyborg.timeout                 = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] cyborg.version                 = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] database.backend               = sqlalchemy {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] database.connection            = **** {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] database.connection_debug      = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] database.connection_parameters =  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] database.connection_recycle_time = 3600 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] database.connection_trace      = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] database.db_inc_retry_interval = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] database.db_max_retries        = 20 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] database.db_max_retry_interval = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] database.db_retry_interval     = 1 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] database.max_overflow          = 50 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] database.max_pool_size         = 5 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] database.max_retries           = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] database.mysql_enable_ndb      = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] database.mysql_wsrep_sync_wait = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] database.pool_timeout          = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] database.retry_interval        = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] database.slave_connection      = **** {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] database.sqlite_synchronous    = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api_database.backend           = sqlalchemy {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api_database.connection        = **** {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api_database.connection_debug  = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api_database.connection_parameters =  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api_database.connection_recycle_time = 3600 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api_database.connection_trace  = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api_database.db_inc_retry_interval = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api_database.db_max_retries    = 20 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api_database.db_max_retry_interval = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api_database.db_retry_interval = 1 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api_database.max_overflow      = 50 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api_database.max_pool_size     = 5 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api_database.max_retries       = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api_database.mysql_enable_ndb  = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api_database.pool_timeout      = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api_database.retry_interval    = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api_database.slave_connection  = **** {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] api_database.sqlite_synchronous = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] devices.enabled_mdev_types     = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ephemeral_storage_encryption.enabled = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.api_servers             = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.cafile                  = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.certfile                = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.collect_timing          = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.connect_retries         = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.connect_retry_delay     = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.debug                   = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.default_trusted_certificate_ids = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.enable_certificate_validation = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.enable_rbd_download     = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.endpoint_override       = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.insecure                = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.keyfile                 = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.max_version             = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.min_version             = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.num_retries             = 3 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.rbd_ceph_conf           =  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.rbd_connect_timeout     = 5 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.rbd_pool                =  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.rbd_user                =  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.region_name             = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.service_name            = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.service_type            = image {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.split_loggers           = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.status_code_retries     = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.status_code_retry_delay = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.timeout                 = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.verify_glance_signatures = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] glance.version                 = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] guestfs.debug                  = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] hyperv.config_drive_cdrom      = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] hyperv.config_drive_inject_password = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] hyperv.enable_remotefx         = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] hyperv.instances_path_share    =  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] hyperv.limit_cpu_features      = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] hyperv.use_multipath_io        = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] hyperv.vswitch_name            = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] mks.enabled                    = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] image_cache.manager_interval   = 2400 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] image_cache.precache_concurrency = 1 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] image_cache.remove_unused_base_images = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] image_cache.subdirectory_name  = _base {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.api_max_retries         = 60 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.api_retry_interval      = 2 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.auth_section            = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.auth_type               = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.cafile                  = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.certfile                = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.collect_timing          = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:05 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.connect_retries         = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.connect_retry_delay     = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.endpoint_override       = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.insecure                = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.keyfile                 = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.max_version             = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.min_version             = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.partition_key           = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.peer_list               = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.region_name             = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.serial_console_state_timeout = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.service_name            = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.service_type            = baremetal {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.split_loggers           = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.status_code_retries     = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.status_code_retry_delay = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.timeout                 = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ironic.version                 = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] key_manager.fixed_key          = **** {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican.barbican_api_version  = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican.barbican_endpoint     = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican.barbican_endpoint_type = public {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican.barbican_region_name  = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican.cafile                = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican.certfile              = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican.collect_timing        = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican.insecure              = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican.keyfile               = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican.number_of_retries     = 60 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican.retry_delay           = 1 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican.send_service_user_token = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican.split_loggers         = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican.timeout               = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican.verify_ssl            = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican.verify_ssl_path       = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican_service_user.auth_section = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican_service_user.auth_type = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican_service_user.cafile   = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican_service_user.certfile = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican_service_user.collect_timing = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican_service_user.insecure = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican_service_user.keyfile  = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican_service_user.split_loggers = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] barbican_service_user.timeout  = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vault.approle_role_id          = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vault.approle_secret_id        = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vault.cafile                   = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vault.certfile                 = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vault.collect_timing           = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vault.insecure                 = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vault.keyfile                  = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vault.kv_mountpoint            = secret {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vault.kv_version               = 2 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vault.namespace                = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vault.root_token_id            = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vault.split_loggers            = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vault.ssl_ca_crt_file          = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vault.timeout                  = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vault.use_ssl                  = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] keystone.cafile                = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] keystone.certfile              = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] keystone.collect_timing        = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] keystone.connect_retries       = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] keystone.connect_retry_delay   = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] keystone.endpoint_override     = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] keystone.insecure              = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] keystone.keyfile               = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] keystone.max_version           = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] keystone.min_version           = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] keystone.region_name           = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] keystone.service_name          = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] keystone.service_type          = identity {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] keystone.split_loggers         = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] keystone.status_code_retries   = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] keystone.status_code_retry_delay = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] keystone.timeout               = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] keystone.version               = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.connection_uri         =  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.cpu_mode               = custom {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: WARNING oslo_config.cfg [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.cpu_power_governor_high = performance {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.cpu_power_management   = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.device_detach_attempts = 8 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.device_detach_timeout  = 20 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.disk_cachemodes        = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.disk_prefix            = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.enabled_perf_events    = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.file_backed_memory     = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.gid_maps               = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.hw_disk_discard        = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.hw_machine_type        = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.images_rbd_pool        = rbd {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.images_type            = default {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.images_volume_group    = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.inject_key             = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.inject_partition       = -2 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.inject_password        = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.iscsi_iface            = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.iser_use_multipath     = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.live_migration_downtime = 500 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.live_migration_inbound_addr = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.live_migration_scheme  = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.live_migration_timeout_action = abort {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.live_migration_tunnelled = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: WARNING oslo_config.cfg [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 15 19:01:06 user nova-compute[73188]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 15 19:01:06 user nova-compute[73188]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 15 19:01:06 user nova-compute[73188]: and ``live_migration_inbound_addr`` respectively.
Aug 15 19:01:06 user nova-compute[73188]: ).  Its value may be silently ignored in the future.
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.live_migration_with_native_tls = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.max_queues             = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.nfs_mount_options      = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.num_pcie_ports         = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.pmem_namespaces        = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.quobyte_client_cfg     = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.rbd_secret_uuid        = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.rbd_user               = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.rescue_image_id        = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.rescue_kernel_id       = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.rx_queue_size          = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.smbfs_mount_options    =  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.snapshot_compression   = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.snapshot_image_format  = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.sparse_logical_volumes = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.swtpm_enabled          = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.swtpm_group            = tss {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.swtpm_user             = tss {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.sysinfo_serial         = unique {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.tb_cache_size          = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.tx_queue_size          = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.uid_maps               = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.use_virtio_for_bridges = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.virt_type              = kvm {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.volume_clear           = zero {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.volume_clear_size      = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.volume_use_multipath   = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.vzstorage_cache_path   = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.auth_section           = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.auth_type              = password {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.cafile                 = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.certfile               = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.collect_timing         = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.connect_retries        = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.connect_retry_delay    = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.default_floating_pool  = public {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.endpoint_override      = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.extension_sync_interval = 600 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.http_retries           = 3 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.insecure               = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.keyfile                = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.max_version            = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.min_version            = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.ovs_bridge             = br-int {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.physnets               = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.region_name            = RegionOne {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.service_metadata_proxy = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.service_name           = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.service_type           = network {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.split_loggers          = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.status_code_retries    = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.status_code_retry_delay = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.timeout                = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] neutron.version                = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] notifications.bdms_in_notifications = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] notifications.default_level    = INFO {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] notifications.notification_format = unversioned {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] notifications.notify_on_state_change = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] pci.alias                      = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] pci.device_spec                = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] pci.report_in_placement        = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.auth_section         = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.auth_type            = password {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.cafile               = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.certfile             = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.collect_timing       = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.connect_retries      = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.connect_retry_delay  = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.default_domain_id    = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.default_domain_name  = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.domain_id            = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.domain_name          = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.endpoint_override    = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.insecure             = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.keyfile              = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.max_version          = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.min_version          = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.password             = **** {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.project_domain_id    = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.project_domain_name  = Default {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.project_id           = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.project_name         = service {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.region_name          = RegionOne {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.service_name         = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.service_type         = placement {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.split_loggers        = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.status_code_retries  = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.status_code_retry_delay = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.system_scope         = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.timeout              = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.trust_id             = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.user_domain_id       = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.user_domain_name     = Default {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.user_id              = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.username             = placement {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] placement.version              = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] quota.cores                    = 20 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] quota.count_usage_from_placement = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] quota.injected_file_content_bytes = 10240 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] quota.injected_file_path_length = 255 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] quota.injected_files           = 5 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] quota.instances                = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] quota.key_pairs                = 100 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] quota.metadata_items           = 128 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] quota.ram                      = 51200 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] quota.recheck_quota            = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] quota.server_group_members     = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] quota.server_groups            = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] rdp.enabled                    = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] scheduler.image_metadata_prefilter = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] scheduler.max_attempts         = 3 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] scheduler.max_placement_results = 1000 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] scheduler.workers              = 3 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.host_subset_size = 1 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.isolated_hosts = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.isolated_images = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.pci_in_placement = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.track_instance_changes = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] metrics.required               = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] metrics.weight_multiplier      = 1.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] metrics.weight_setting         = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] serial_console.enabled         = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] serial_console.port_range      = 10000:20000 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] serial_console.serialproxy_port = 6083 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] service_user.auth_section      = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] service_user.auth_type         = password {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] service_user.cafile            = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] service_user.certfile          = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] service_user.collect_timing    = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] service_user.insecure          = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] service_user.keyfile           = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] service_user.send_service_user_token = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] service_user.split_loggers     = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] service_user.timeout           = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] spice.agent_enabled            = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] spice.enabled                  = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] spice.html5proxy_port          = 6082 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] spice.image_compression        = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] spice.jpeg_compression         = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] spice.playback_compression     = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] spice.server_listen            = 127.0.0.1 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] spice.streaming_mode           = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] spice.zlib_compression         = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] upgrade_levels.baseapi         = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] upgrade_levels.cert            = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] upgrade_levels.compute         = auto {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] upgrade_levels.conductor       = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] upgrade_levels.scheduler       = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vendordata_dynamic_auth.cafile = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vendordata_dynamic_auth.certfile = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vendordata_dynamic_auth.insecure = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vendordata_dynamic_auth.timeout = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.api_retry_count         = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.ca_file                 = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.cache_prefix            = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.cluster_name            = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.connection_pool_size    = 10 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.console_delay_seconds   = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.datastore_regex         = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.host_ip                 = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.host_password           = **** {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.host_port               = 443 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.host_username           = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.insecure                = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.integration_bridge      = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.maximum_objects         = 100 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.pbm_default_policy      = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.pbm_enabled             = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.pbm_wsdl_location       = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.serial_port_proxy_uri   = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.serial_port_service_uri = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.task_poll_interval      = 0.5 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.use_linked_clone        = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.vnc_keymap              = en-us {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.vnc_port                = 5900 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vmware.vnc_port_total          = 10000 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vnc.auth_schemes               = ['none'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vnc.enabled                    = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vnc.novncproxy_port            = 6080 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vnc.vencrypt_ca_certs          = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vnc.vencrypt_client_cert       = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vnc.vencrypt_client_key        = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] workarounds.disable_rootwrap   = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] workarounds.enable_numa_live_migration = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] workarounds.libvirt_disable_apic = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] wsgi.client_socket_timeout     = 900 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] wsgi.default_pool_size         = 1000 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] wsgi.keep_alive                = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] wsgi.max_header_line           = 16384 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] wsgi.ssl_ca_file               = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] wsgi.ssl_cert_file             = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] wsgi.ssl_key_file              = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] wsgi.tcp_keepidle              = 600 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] zvm.ca_file                    = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] zvm.cloud_connector_url        = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] zvm.reachable_timeout          = 300 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_policy.enforce_new_defaults = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_policy.enforce_scope      = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_policy.policy_default_rule = default {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] profiler.connection_string     = messaging:// {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] profiler.enabled               = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] profiler.es_doc_type           = notification {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] profiler.es_scroll_size        = 10000 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] profiler.es_scroll_time        = 2m {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] profiler.filter_error_trace    = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] profiler.hmac_keys             = **** {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] profiler.sentinel_service_name = mymaster {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] profiler.socket_timeout        = 0.1 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] profiler.trace_requests        = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] profiler.trace_sqlalchemy      = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] profiler_jaeger.process_tags   = {} {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] profiler_jaeger.service_name_prefix = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] profiler_otlp.service_name_prefix = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] remote_debug.host              = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] remote_debug.port              = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_notifications.retry = -1 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_limit.auth_section        = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_limit.auth_type           = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_limit.cafile              = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_limit.certfile            = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_limit.collect_timing      = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_limit.connect_retries     = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_limit.connect_retry_delay = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_limit.endpoint_id         = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_limit.endpoint_override   = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_limit.insecure            = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_limit.keyfile             = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_limit.max_version         = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_limit.min_version         = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_limit.region_name         = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_limit.service_name        = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_limit.service_type        = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_limit.split_loggers       = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_limit.status_code_retries = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_limit.status_code_retry_delay = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_limit.timeout             = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_limit.valid_interfaces    = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_limit.version             = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_reports.file_event_handler = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] oslo_reports.log_dir           = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vif_plug_ovs_privileged.group  = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] vif_plug_ovs_privileged.user   = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] os_vif_ovs.isolate_vif         = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] os_brick.lock_path             = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] privsep_osbrick.capabilities   = [21] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] privsep_osbrick.group          = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] privsep_osbrick.helper_command = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] privsep_osbrick.user           = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] nova_sys_admin.group           = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] nova_sys_admin.helper_command  = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] nova_sys_admin.user            = None {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG oslo_service.service [None req-f668bd5b-dc1f-4913-bbc1-c9992b93caf5 None None] ******************************************************************************** {{(pid=73188) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 15 19:01:06 user nova-compute[73188]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 15 19:01:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Starting native event thread {{(pid=73188) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Starting green dispatch thread {{(pid=73188) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Starting connection event dispatch thread {{(pid=73188) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Connecting to libvirt: qemu:///system {{(pid=73188) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f2811944d90> {{(pid=73188) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 15 19:01:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f2811944d90> {{(pid=73188) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 15 19:01:06 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Connection event '1' reason 'None'
Aug 15 19:01:06 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 15 19:01:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.mount [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Initialising _HostMountState generation 0 {{(pid=73188) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 15 19:01:13 user nova-compute[73188]: INFO nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Libvirt host capabilities <capabilities>
Aug 15 19:01:13 user nova-compute[73188]:   <host>
Aug 15 19:01:13 user nova-compute[73188]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 15 19:01:13 user nova-compute[73188]:     <cpu>
Aug 15 19:01:13 user nova-compute[73188]:       <arch>x86_64</arch>
Aug 15 19:01:13 user nova-compute[73188]:       <model>IvyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <vendor>Intel</vendor>
Aug 15 19:01:13 user nova-compute[73188]:       <microcode version='1070'/>
Aug 15 19:01:13 user nova-compute[73188]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 15 19:01:13 user nova-compute[73188]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature name='ss'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature name='vmx'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature name='pcid'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature name='osxsave'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature name='hypervisor'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature name='arat'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature name='tsc_adjust'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature name='md-clear'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature name='stibp'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature name='arch-capabilities'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature name='ssbd'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature name='invtsc'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature name='rsba'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature name='skip-l1dfl-vmentry'/>
Aug 15 19:01:13 user nova-compute[73188]:       <pages unit='KiB' size='4'/>
Aug 15 19:01:13 user nova-compute[73188]:       <pages unit='KiB' size='2048'/>
Aug 15 19:01:13 user nova-compute[73188]:     </cpu>
Aug 15 19:01:13 user nova-compute[73188]:     <power_management>
Aug 15 19:01:13 user nova-compute[73188]:       <suspend_mem/>
Aug 15 19:01:13 user nova-compute[73188]:       <suspend_disk/>
Aug 15 19:01:13 user nova-compute[73188]:       <suspend_hybrid/>
Aug 15 19:01:13 user nova-compute[73188]:     </power_management>
Aug 15 19:01:13 user nova-compute[73188]:     <iommu support='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     <migration_features>
Aug 15 19:01:13 user nova-compute[73188]:       <live/>
Aug 15 19:01:13 user nova-compute[73188]:       <uri_transports>
Aug 15 19:01:13 user nova-compute[73188]:         <uri_transport>tcp</uri_transport>
Aug 15 19:01:13 user nova-compute[73188]:         <uri_transport>rdma</uri_transport>
Aug 15 19:01:13 user nova-compute[73188]:       </uri_transports>
Aug 15 19:01:13 user nova-compute[73188]:     </migration_features>
Aug 15 19:01:13 user nova-compute[73188]:     <topology>
Aug 15 19:01:13 user nova-compute[73188]:       <cells num='2'>
Aug 15 19:01:13 user nova-compute[73188]:         <cell id='0'>
Aug 15 19:01:13 user nova-compute[73188]:           <memory unit='KiB'>8189224</memory>
Aug 15 19:01:13 user nova-compute[73188]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 15 19:01:13 user nova-compute[73188]:           <pages unit='KiB' size='2048'>0</pages>
Aug 15 19:01:13 user nova-compute[73188]:           <distances>
Aug 15 19:01:13 user nova-compute[73188]:             <sibling id='0' value='10'/>
Aug 15 19:01:13 user nova-compute[73188]:             <sibling id='1' value='20'/>
Aug 15 19:01:13 user nova-compute[73188]:           </distances>
Aug 15 19:01:13 user nova-compute[73188]:           <cpus num='6'>
Aug 15 19:01:13 user nova-compute[73188]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 15 19:01:13 user nova-compute[73188]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 15 19:01:13 user nova-compute[73188]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 15 19:01:13 user nova-compute[73188]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 15 19:01:13 user nova-compute[73188]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 15 19:01:13 user nova-compute[73188]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 15 19:01:13 user nova-compute[73188]:           </cpus>
Aug 15 19:01:13 user nova-compute[73188]:         </cell>
Aug 15 19:01:13 user nova-compute[73188]:         <cell id='1'>
Aug 15 19:01:13 user nova-compute[73188]:           <memory unit='KiB'>8206460</memory>
Aug 15 19:01:13 user nova-compute[73188]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 15 19:01:13 user nova-compute[73188]:           <pages unit='KiB' size='2048'>0</pages>
Aug 15 19:01:13 user nova-compute[73188]:           <distances>
Aug 15 19:01:13 user nova-compute[73188]:             <sibling id='0' value='20'/>
Aug 15 19:01:13 user nova-compute[73188]:             <sibling id='1' value='10'/>
Aug 15 19:01:13 user nova-compute[73188]:           </distances>
Aug 15 19:01:13 user nova-compute[73188]:           <cpus num='6'>
Aug 15 19:01:13 user nova-compute[73188]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 15 19:01:13 user nova-compute[73188]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 15 19:01:13 user nova-compute[73188]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 15 19:01:13 user nova-compute[73188]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 15 19:01:13 user nova-compute[73188]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 15 19:01:13 user nova-compute[73188]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 15 19:01:13 user nova-compute[73188]:           </cpus>
Aug 15 19:01:13 user nova-compute[73188]:         </cell>
Aug 15 19:01:13 user nova-compute[73188]:       </cells>
Aug 15 19:01:13 user nova-compute[73188]:     </topology>
Aug 15 19:01:13 user nova-compute[73188]:     <cache>
Aug 15 19:01:13 user nova-compute[73188]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 15 19:01:13 user nova-compute[73188]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 15 19:01:13 user nova-compute[73188]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 15 19:01:13 user nova-compute[73188]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 15 19:01:13 user nova-compute[73188]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 15 19:01:13 user nova-compute[73188]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 15 19:01:13 user nova-compute[73188]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 15 19:01:13 user nova-compute[73188]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 15 19:01:13 user nova-compute[73188]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 15 19:01:13 user nova-compute[73188]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 15 19:01:13 user nova-compute[73188]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 15 19:01:13 user nova-compute[73188]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 15 19:01:13 user nova-compute[73188]:     </cache>
Aug 15 19:01:13 user nova-compute[73188]:     <secmodel>
Aug 15 19:01:13 user nova-compute[73188]:       <model>apparmor</model>
Aug 15 19:01:13 user nova-compute[73188]:       <doi>0</doi>
Aug 15 19:01:13 user nova-compute[73188]:     </secmodel>
Aug 15 19:01:13 user nova-compute[73188]:     <secmodel>
Aug 15 19:01:13 user nova-compute[73188]:       <model>dac</model>
Aug 15 19:01:13 user nova-compute[73188]:       <doi>0</doi>
Aug 15 19:01:13 user nova-compute[73188]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 15 19:01:13 user nova-compute[73188]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 15 19:01:13 user nova-compute[73188]:     </secmodel>
Aug 15 19:01:13 user nova-compute[73188]:   </host>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='alpha'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>64</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>clipper</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='armv6l'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>32</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>spitz</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>nuri</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>kzm</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>sx1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>z2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>tosa</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>n810</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>n800</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>terrier</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>midway</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>microbit</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>verdex</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>highbank</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>akita</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>connex</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>collie</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='armv7l'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>32</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>spitz</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>nuri</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>kzm</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>sx1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>z2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>tosa</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>n810</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>n800</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>terrier</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>midway</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>microbit</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>verdex</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>highbank</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>akita</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>connex</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>collie</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='aarch64'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>64</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>spitz</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>nuri</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>kzm</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>sx1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>z2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>tosa</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>n810</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>n800</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>terrier</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>midway</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>microbit</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>verdex</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>raspi3b</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>highbank</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>akita</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>connex</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>collie</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <acpi default='on' toggle='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='cris'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>32</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='i686'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>32</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>x-remote</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>isapc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>microvm</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='kvm'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <pae/>
Aug 15 19:01:13 user nova-compute[73188]:       <nonpae/>
Aug 15 19:01:13 user nova-compute[73188]:       <acpi default='on' toggle='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:       <apic default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='m68k'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>32</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>an5206</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>q800</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>next-cube</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='microblaze'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>32</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='microblazeel'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>32</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='mips'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>32</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='16'>malta</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='mipsel'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>32</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='16'>malta</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='mips64'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>64</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='16'>malta</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>pica61</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>magnum</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='mips64el'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>64</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='16'>malta</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>pica61</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>magnum</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='16'>boston</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='ppc'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>32</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mac99</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>40p</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>taihu</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='ppc64'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>64</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2048'>powernv9</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>taihu</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2048'>powernv10</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>40p</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mac99</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2048'>powernv8</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='ppc64le'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>64</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2048'>powernv9</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>taihu</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2048'>powernv10</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>40p</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>mac99</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2048'>powernv8</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='riscv32'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>32</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='8'>spike</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>opentitan</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='5'>sifive_u</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>sifive_e</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='8'>virt</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='riscv64'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>64</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='8'>spike</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='5'>sifive_u</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>shakti_c</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>sifive_e</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='8'>virt</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='s390x'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>64</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='sh4'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>32</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>shix</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>r2d</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='sh4eb'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>64</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>shix</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>r2d</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='sparc'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>32</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>SS-5</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>SS-20</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>LX</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>SS-4</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>SS-10</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>Voyager</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='sparc64'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>64</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>sun4u</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>niagara</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>sun4v</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='x86_64'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>64</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>x-remote</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='1'>isapc</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>microvm</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='kvm'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <acpi default='on' toggle='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:       <apic default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='xtensa'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>32</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>sim</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='32'>kc705</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='32'>ml605</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='32'>virt</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='32'>lx200</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='32'>lx60</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]:   <guest>
Aug 15 19:01:13 user nova-compute[73188]:     <os_type>hvm</os_type>
Aug 15 19:01:13 user nova-compute[73188]:     <arch name='xtensaeb'>
Aug 15 19:01:13 user nova-compute[73188]:       <wordsize>32</wordsize>
Aug 15 19:01:13 user nova-compute[73188]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='4'>sim</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='32'>kc705</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='32'>ml605</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='32'>virt</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='32'>lx200</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='32'>lx60</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 15 19:01:13 user nova-compute[73188]:       <domain type='qemu'/>
Aug 15 19:01:13 user nova-compute[73188]:     </arch>
Aug 15 19:01:13 user nova-compute[73188]:     <features>
Aug 15 19:01:13 user nova-compute[73188]:       <cpuselection/>
Aug 15 19:01:13 user nova-compute[73188]:       <deviceboot/>
Aug 15 19:01:13 user nova-compute[73188]:       <disksnapshot default='on' toggle='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     </features>
Aug 15 19:01:13 user nova-compute[73188]:   </guest>
Aug 15 19:01:13 user nova-compute[73188]: </capabilities>
Aug 15 19:01:13 user nova-compute[73188]: 
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 15 19:01:13 user nova-compute[73188]: <domainCapabilities>
Aug 15 19:01:13 user nova-compute[73188]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 19:01:13 user nova-compute[73188]:   <domain>kvm</domain>
Aug 15 19:01:13 user nova-compute[73188]:   <machine>pc-q35-6.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:   <arch>i686</arch>
Aug 15 19:01:13 user nova-compute[73188]:   <vcpu max='288'/>
Aug 15 19:01:13 user nova-compute[73188]:   <iothreads supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:   <os supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:     <enum name='firmware'/>
Aug 15 19:01:13 user nova-compute[73188]:     <loader supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='type'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>rom</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>pflash</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='readonly'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>yes</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>no</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='secure'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>no</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </loader>
Aug 15 19:01:13 user nova-compute[73188]:   </os>
Aug 15 19:01:13 user nova-compute[73188]:   <cpu>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='host-passthrough' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='hostPassthroughMigratable'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>off</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='maximum' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='maximumMigratable'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>on</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>off</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='host-model' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <vendor>Intel</vendor>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ss'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='vmx'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='pcid'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='hypervisor'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='arat'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='umip'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='md-clear'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='stibp'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ssbd'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ibpb'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ibrs'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='amd-stibp'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='disable' name='erms'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='disable' name='lm'/>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='custom' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>qemu64</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>qemu32</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>phenom</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium3</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium2</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>n270</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>kvm64</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>kvm32</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>coreduo</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>core2duo</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>athlon</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Westmere</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Snowridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>SandyBridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Penryn</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G5</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G4</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G3</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G2</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G1</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Nehalem</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>IvyBridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Icelake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-Rome</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-Milan</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Dhyana</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cooperlake</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Conroe</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>486</model>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:   </cpu>
Aug 15 19:01:13 user nova-compute[73188]:   <memoryBacking supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:     <enum name='sourceType'>
Aug 15 19:01:13 user nova-compute[73188]:       <value>file</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>anonymous</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>memfd</value>
Aug 15 19:01:13 user nova-compute[73188]:     </enum>
Aug 15 19:01:13 user nova-compute[73188]:   </memoryBacking>
Aug 15 19:01:13 user nova-compute[73188]:   <devices>
Aug 15 19:01:13 user nova-compute[73188]:     <disk supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='diskDevice'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>disk</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>cdrom</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>floppy</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>lun</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='bus'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>fdc</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>scsi</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>usb</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>sata</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-non-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </disk>
Aug 15 19:01:13 user nova-compute[73188]:     <graphics supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='type'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>sdl</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vnc</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>spice</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>egl-headless</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </graphics>
Aug 15 19:01:13 user nova-compute[73188]:     <video supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='modelType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vga</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>cirrus</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vmvga</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>qxl</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>none</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>bochs</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>ramfb</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </video>
Aug 15 19:01:13 user nova-compute[73188]:     <hostdev supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='mode'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>subsystem</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='startupPolicy'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>default</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>mandatory</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>requisite</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>optional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='subsysType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>usb</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>pci</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>scsi</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='capsType'/>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='pciBackend'/>
Aug 15 19:01:13 user nova-compute[73188]:     </hostdev>
Aug 15 19:01:13 user nova-compute[73188]:     <rng supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-non-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='backendModel'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>random</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>egd</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>builtin</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </rng>
Aug 15 19:01:13 user nova-compute[73188]:     <filesystem supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='driverType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>path</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>handle</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtiofs</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </filesystem>
Aug 15 19:01:13 user nova-compute[73188]:     <tpm supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>tpm-tis</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>tpm-crb</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='backendModel'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>passthrough</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>emulator</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </tpm>
Aug 15 19:01:13 user nova-compute[73188]:   </devices>
Aug 15 19:01:13 user nova-compute[73188]:   <features>
Aug 15 19:01:13 user nova-compute[73188]:     <gic supported='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     <vmcoreinfo supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <genid supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <backingStoreInput supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <backup supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <sev supported='no'/>
Aug 15 19:01:13 user nova-compute[73188]:   </features>
Aug 15 19:01:13 user nova-compute[73188]: </domainCapabilities>
Aug 15 19:01:13 user nova-compute[73188]:  {{(pid=73188) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 15 19:01:13 user nova-compute[73188]: <domainCapabilities>
Aug 15 19:01:13 user nova-compute[73188]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 19:01:13 user nova-compute[73188]:   <domain>kvm</domain>
Aug 15 19:01:13 user nova-compute[73188]:   <machine>pc-i440fx-6.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:   <arch>i686</arch>
Aug 15 19:01:13 user nova-compute[73188]:   <vcpu max='255'/>
Aug 15 19:01:13 user nova-compute[73188]:   <iothreads supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:   <os supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:     <enum name='firmware'/>
Aug 15 19:01:13 user nova-compute[73188]:     <loader supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='type'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>rom</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>pflash</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='readonly'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>yes</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>no</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='secure'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>no</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </loader>
Aug 15 19:01:13 user nova-compute[73188]:   </os>
Aug 15 19:01:13 user nova-compute[73188]:   <cpu>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='host-passthrough' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='hostPassthroughMigratable'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>off</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='maximum' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='maximumMigratable'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>on</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>off</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='host-model' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <vendor>Intel</vendor>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ss'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='vmx'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='pcid'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='hypervisor'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='arat'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='umip'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='md-clear'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='stibp'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ssbd'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ibpb'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ibrs'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='amd-stibp'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='disable' name='erms'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='disable' name='lm'/>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='custom' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>qemu64</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>qemu32</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>phenom</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium3</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium2</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>n270</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>kvm64</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>kvm32</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>coreduo</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>core2duo</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>athlon</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Westmere</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Snowridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>SandyBridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Penryn</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G5</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G4</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G3</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G2</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G1</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Nehalem</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>IvyBridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Icelake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-Rome</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-Milan</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Dhyana</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cooperlake</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Conroe</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>486</model>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:   </cpu>
Aug 15 19:01:13 user nova-compute[73188]:   <memoryBacking supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:     <enum name='sourceType'>
Aug 15 19:01:13 user nova-compute[73188]:       <value>file</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>anonymous</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>memfd</value>
Aug 15 19:01:13 user nova-compute[73188]:     </enum>
Aug 15 19:01:13 user nova-compute[73188]:   </memoryBacking>
Aug 15 19:01:13 user nova-compute[73188]:   <devices>
Aug 15 19:01:13 user nova-compute[73188]:     <disk supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='diskDevice'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>disk</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>cdrom</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>floppy</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>lun</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='bus'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>ide</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>fdc</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>scsi</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>usb</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>sata</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-non-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </disk>
Aug 15 19:01:13 user nova-compute[73188]:     <graphics supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='type'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>sdl</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vnc</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>spice</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>egl-headless</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </graphics>
Aug 15 19:01:13 user nova-compute[73188]:     <video supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='modelType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vga</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>cirrus</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vmvga</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>qxl</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>none</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>bochs</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>ramfb</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </video>
Aug 15 19:01:13 user nova-compute[73188]:     <hostdev supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='mode'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>subsystem</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='startupPolicy'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>default</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>mandatory</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>requisite</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>optional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='subsysType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>usb</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>pci</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>scsi</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='capsType'/>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='pciBackend'/>
Aug 15 19:01:13 user nova-compute[73188]:     </hostdev>
Aug 15 19:01:13 user nova-compute[73188]:     <rng supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-non-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='backendModel'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>random</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>egd</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>builtin</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </rng>
Aug 15 19:01:13 user nova-compute[73188]:     <filesystem supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='driverType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>path</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>handle</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtiofs</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </filesystem>
Aug 15 19:01:13 user nova-compute[73188]:     <tpm supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>tpm-tis</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>tpm-crb</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='backendModel'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>passthrough</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>emulator</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </tpm>
Aug 15 19:01:13 user nova-compute[73188]:   </devices>
Aug 15 19:01:13 user nova-compute[73188]:   <features>
Aug 15 19:01:13 user nova-compute[73188]:     <gic supported='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     <vmcoreinfo supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <genid supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <backingStoreInput supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <backup supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <sev supported='no'/>
Aug 15 19:01:13 user nova-compute[73188]:   </features>
Aug 15 19:01:13 user nova-compute[73188]: </domainCapabilities>
Aug 15 19:01:13 user nova-compute[73188]:  {{(pid=73188) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 15 19:01:13 user nova-compute[73188]: <domainCapabilities>
Aug 15 19:01:13 user nova-compute[73188]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 19:01:13 user nova-compute[73188]:   <domain>kvm</domain>
Aug 15 19:01:13 user nova-compute[73188]:   <machine>pc-q35-jammy</machine>
Aug 15 19:01:13 user nova-compute[73188]:   <arch>i686</arch>
Aug 15 19:01:13 user nova-compute[73188]:   <vcpu max='288'/>
Aug 15 19:01:13 user nova-compute[73188]:   <iothreads supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:   <os supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:     <enum name='firmware'/>
Aug 15 19:01:13 user nova-compute[73188]:     <loader supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='type'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>rom</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>pflash</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='readonly'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>yes</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>no</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='secure'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>no</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </loader>
Aug 15 19:01:13 user nova-compute[73188]:   </os>
Aug 15 19:01:13 user nova-compute[73188]:   <cpu>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='host-passthrough' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='hostPassthroughMigratable'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>off</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='maximum' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='maximumMigratable'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>on</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>off</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='host-model' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <vendor>Intel</vendor>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ss'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='vmx'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='pcid'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='hypervisor'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='arat'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='umip'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='md-clear'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='stibp'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ssbd'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ibpb'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ibrs'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='amd-stibp'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='disable' name='erms'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='disable' name='lm'/>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='custom' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>qemu64</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>qemu32</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>phenom</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium3</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium2</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>n270</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>kvm64</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>kvm32</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>coreduo</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>core2duo</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>athlon</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Westmere</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Snowridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>SandyBridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Penryn</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G5</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G4</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G3</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G2</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G1</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Nehalem</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>IvyBridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Icelake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-Rome</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-Milan</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Dhyana</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cooperlake</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Conroe</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>486</model>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:   </cpu>
Aug 15 19:01:13 user nova-compute[73188]:   <memoryBacking supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:     <enum name='sourceType'>
Aug 15 19:01:13 user nova-compute[73188]:       <value>file</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>anonymous</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>memfd</value>
Aug 15 19:01:13 user nova-compute[73188]:     </enum>
Aug 15 19:01:13 user nova-compute[73188]:   </memoryBacking>
Aug 15 19:01:13 user nova-compute[73188]:   <devices>
Aug 15 19:01:13 user nova-compute[73188]:     <disk supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='diskDevice'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>disk</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>cdrom</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>floppy</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>lun</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='bus'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>fdc</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>scsi</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>usb</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>sata</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-non-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </disk>
Aug 15 19:01:13 user nova-compute[73188]:     <graphics supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='type'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>sdl</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vnc</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>spice</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>egl-headless</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </graphics>
Aug 15 19:01:13 user nova-compute[73188]:     <video supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='modelType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vga</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>cirrus</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vmvga</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>qxl</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>none</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>bochs</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>ramfb</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </video>
Aug 15 19:01:13 user nova-compute[73188]:     <hostdev supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='mode'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>subsystem</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='startupPolicy'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>default</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>mandatory</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>requisite</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>optional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='subsysType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>usb</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>pci</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>scsi</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='capsType'/>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='pciBackend'/>
Aug 15 19:01:13 user nova-compute[73188]:     </hostdev>
Aug 15 19:01:13 user nova-compute[73188]:     <rng supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-non-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='backendModel'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>random</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>egd</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>builtin</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </rng>
Aug 15 19:01:13 user nova-compute[73188]:     <filesystem supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='driverType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>path</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>handle</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtiofs</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </filesystem>
Aug 15 19:01:13 user nova-compute[73188]:     <tpm supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>tpm-tis</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>tpm-crb</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='backendModel'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>passthrough</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>emulator</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </tpm>
Aug 15 19:01:13 user nova-compute[73188]:   </devices>
Aug 15 19:01:13 user nova-compute[73188]:   <features>
Aug 15 19:01:13 user nova-compute[73188]:     <gic supported='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     <vmcoreinfo supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <genid supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <backingStoreInput supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <backup supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <sev supported='no'/>
Aug 15 19:01:13 user nova-compute[73188]:   </features>
Aug 15 19:01:13 user nova-compute[73188]: </domainCapabilities>
Aug 15 19:01:13 user nova-compute[73188]:  {{(pid=73188) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 15 19:01:13 user nova-compute[73188]: <domainCapabilities>
Aug 15 19:01:13 user nova-compute[73188]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 19:01:13 user nova-compute[73188]:   <domain>kvm</domain>
Aug 15 19:01:13 user nova-compute[73188]:   <machine>pc-i440fx-jammy</machine>
Aug 15 19:01:13 user nova-compute[73188]:   <arch>i686</arch>
Aug 15 19:01:13 user nova-compute[73188]:   <vcpu max='255'/>
Aug 15 19:01:13 user nova-compute[73188]:   <iothreads supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:   <os supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:     <enum name='firmware'/>
Aug 15 19:01:13 user nova-compute[73188]:     <loader supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='type'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>rom</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>pflash</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='readonly'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>yes</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>no</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='secure'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>no</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </loader>
Aug 15 19:01:13 user nova-compute[73188]:   </os>
Aug 15 19:01:13 user nova-compute[73188]:   <cpu>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='host-passthrough' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='hostPassthroughMigratable'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>off</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='maximum' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='maximumMigratable'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>on</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>off</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='host-model' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <vendor>Intel</vendor>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ss'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='vmx'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='pcid'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='hypervisor'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='arat'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='umip'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='md-clear'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='stibp'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ssbd'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ibpb'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ibrs'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='amd-stibp'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='disable' name='erms'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='disable' name='lm'/>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='custom' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>qemu64</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>qemu32</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>phenom</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium3</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium2</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>n270</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>kvm64</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>kvm32</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>coreduo</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>core2duo</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>athlon</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Westmere</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Snowridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>SandyBridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Penryn</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G5</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G4</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G3</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G2</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G1</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Nehalem</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>IvyBridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Icelake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-Rome</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-Milan</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Dhyana</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cooperlake</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Conroe</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>486</model>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:   </cpu>
Aug 15 19:01:13 user nova-compute[73188]:   <memoryBacking supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:     <enum name='sourceType'>
Aug 15 19:01:13 user nova-compute[73188]:       <value>file</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>anonymous</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>memfd</value>
Aug 15 19:01:13 user nova-compute[73188]:     </enum>
Aug 15 19:01:13 user nova-compute[73188]:   </memoryBacking>
Aug 15 19:01:13 user nova-compute[73188]:   <devices>
Aug 15 19:01:13 user nova-compute[73188]:     <disk supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='diskDevice'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>disk</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>cdrom</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>floppy</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>lun</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='bus'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>ide</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>fdc</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>scsi</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>usb</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>sata</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-non-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </disk>
Aug 15 19:01:13 user nova-compute[73188]:     <graphics supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='type'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>sdl</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vnc</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>spice</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>egl-headless</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </graphics>
Aug 15 19:01:13 user nova-compute[73188]:     <video supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='modelType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vga</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>cirrus</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vmvga</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>qxl</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>none</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>bochs</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>ramfb</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </video>
Aug 15 19:01:13 user nova-compute[73188]:     <hostdev supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='mode'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>subsystem</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='startupPolicy'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>default</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>mandatory</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>requisite</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>optional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='subsysType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>usb</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>pci</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>scsi</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='capsType'/>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='pciBackend'/>
Aug 15 19:01:13 user nova-compute[73188]:     </hostdev>
Aug 15 19:01:13 user nova-compute[73188]:     <rng supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-non-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='backendModel'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>random</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>egd</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>builtin</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </rng>
Aug 15 19:01:13 user nova-compute[73188]:     <filesystem supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='driverType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>path</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>handle</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtiofs</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </filesystem>
Aug 15 19:01:13 user nova-compute[73188]:     <tpm supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>tpm-tis</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>tpm-crb</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='backendModel'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>passthrough</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>emulator</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </tpm>
Aug 15 19:01:13 user nova-compute[73188]:   </devices>
Aug 15 19:01:13 user nova-compute[73188]:   <features>
Aug 15 19:01:13 user nova-compute[73188]:     <gic supported='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     <vmcoreinfo supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <genid supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <backingStoreInput supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <backup supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <sev supported='no'/>
Aug 15 19:01:13 user nova-compute[73188]:   </features>
Aug 15 19:01:13 user nova-compute[73188]: </domainCapabilities>
Aug 15 19:01:13 user nova-compute[73188]:  {{(pid=73188) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 15 19:01:13 user nova-compute[73188]: <domainCapabilities>
Aug 15 19:01:13 user nova-compute[73188]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 19:01:13 user nova-compute[73188]:   <domain>kvm</domain>
Aug 15 19:01:13 user nova-compute[73188]:   <machine>pc-q35-6.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:   <arch>x86_64</arch>
Aug 15 19:01:13 user nova-compute[73188]:   <vcpu max='288'/>
Aug 15 19:01:13 user nova-compute[73188]:   <iothreads supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:   <os supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:     <enum name='firmware'>
Aug 15 19:01:13 user nova-compute[73188]:       <value>efi</value>
Aug 15 19:01:13 user nova-compute[73188]:     </enum>
Aug 15 19:01:13 user nova-compute[73188]:     <loader supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='type'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>rom</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>pflash</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='readonly'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>yes</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>no</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='secure'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>yes</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>no</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </loader>
Aug 15 19:01:13 user nova-compute[73188]:   </os>
Aug 15 19:01:13 user nova-compute[73188]:   <cpu>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='host-passthrough' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='hostPassthroughMigratable'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>on</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>off</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='maximum' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='maximumMigratable'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>on</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>off</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='host-model' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <vendor>Intel</vendor>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ss'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='vmx'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='pcid'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='hypervisor'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='arat'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='umip'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='md-clear'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='stibp'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ssbd'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='invtsc'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ibpb'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ibrs'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='amd-stibp'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='rsba'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='disable' name='erms'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='custom' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>qemu64</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>qemu32</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>phenom</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium3</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium2</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>n270</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>kvm64</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>kvm32</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>coreduo</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>core2duo</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>athlon</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Westmere</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Snowridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>SandyBridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Penryn</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G5</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G4</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G3</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G2</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Opteron_G1</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Nehalem</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>IvyBridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Icelake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-Rome</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-Milan</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Dhyana</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cooperlake</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Conroe</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>486</model>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:   </cpu>
Aug 15 19:01:13 user nova-compute[73188]:   <memoryBacking supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:     <enum name='sourceType'>
Aug 15 19:01:13 user nova-compute[73188]:       <value>file</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>anonymous</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>memfd</value>
Aug 15 19:01:13 user nova-compute[73188]:     </enum>
Aug 15 19:01:13 user nova-compute[73188]:   </memoryBacking>
Aug 15 19:01:13 user nova-compute[73188]:   <devices>
Aug 15 19:01:13 user nova-compute[73188]:     <disk supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='diskDevice'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>disk</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>cdrom</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>floppy</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>lun</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='bus'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>fdc</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>scsi</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>usb</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>sata</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-non-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </disk>
Aug 15 19:01:13 user nova-compute[73188]:     <graphics supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='type'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>sdl</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vnc</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>spice</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>egl-headless</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </graphics>
Aug 15 19:01:13 user nova-compute[73188]:     <video supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='modelType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vga</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>cirrus</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vmvga</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>qxl</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>none</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>bochs</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>ramfb</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </video>
Aug 15 19:01:13 user nova-compute[73188]:     <hostdev supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='mode'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>subsystem</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='startupPolicy'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>default</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>mandatory</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>requisite</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>optional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='subsysType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>usb</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>pci</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>scsi</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='capsType'/>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='pciBackend'/>
Aug 15 19:01:13 user nova-compute[73188]:     </hostdev>
Aug 15 19:01:13 user nova-compute[73188]:     <rng supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-non-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='backendModel'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>random</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>egd</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>builtin</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </rng>
Aug 15 19:01:13 user nova-compute[73188]:     <filesystem supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='driverType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>path</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>handle</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtiofs</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </filesystem>
Aug 15 19:01:13 user nova-compute[73188]:     <tpm supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>tpm-tis</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>tpm-crb</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='backendModel'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>passthrough</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>emulator</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </tpm>
Aug 15 19:01:13 user nova-compute[73188]:   </devices>
Aug 15 19:01:13 user nova-compute[73188]:   <features>
Aug 15 19:01:13 user nova-compute[73188]:     <gic supported='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     <vmcoreinfo supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <genid supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <backingStoreInput supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <backup supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <sev supported='no'/>
Aug 15 19:01:13 user nova-compute[73188]:   </features>
Aug 15 19:01:13 user nova-compute[73188]: </domainCapabilities>
Aug 15 19:01:13 user nova-compute[73188]:  {{(pid=73188) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 15 19:01:13 user nova-compute[73188]: <domainCapabilities>
Aug 15 19:01:13 user nova-compute[73188]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 19:01:13 user nova-compute[73188]:   <domain>kvm</domain>
Aug 15 19:01:13 user nova-compute[73188]:   <machine>pc-i440fx-6.2</machine>
Aug 15 19:01:13 user nova-compute[73188]:   <arch>x86_64</arch>
Aug 15 19:01:13 user nova-compute[73188]:   <vcpu max='255'/>
Aug 15 19:01:13 user nova-compute[73188]:   <iothreads supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:   <os supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:     <enum name='firmware'>
Aug 15 19:01:13 user nova-compute[73188]:       <value>efi</value>
Aug 15 19:01:13 user nova-compute[73188]:     </enum>
Aug 15 19:01:13 user nova-compute[73188]:     <loader supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='type'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>rom</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>pflash</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='readonly'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>yes</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>no</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='secure'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>no</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </loader>
Aug 15 19:01:13 user nova-compute[73188]:   </os>
Aug 15 19:01:13 user nova-compute[73188]:   <cpu>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='host-passthrough' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='hostPassthroughMigratable'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>on</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>off</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='maximum' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='maximumMigratable'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>on</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>off</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='host-model' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <vendor>Intel</vendor>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ss'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='vmx'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='pcid'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='hypervisor'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='arat'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='umip'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='md-clear'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='stibp'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ssbd'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='invtsc'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ibpb'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ibrs'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='amd-stibp'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='rsba'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='disable' name='erms'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='custom' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>qemu64</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>qemu32</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>phenom</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium3</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium2</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>n270</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>kvm64</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>kvm32</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>coreduo</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>core2duo</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>athlon</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Westmere</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Snowridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>SandyBridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Penryn</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G5</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G4</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G3</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G2</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Opteron_G1</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Nehalem</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>IvyBridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Icelake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-Rome</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-Milan</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Dhyana</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cooperlake</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Conroe</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>486</model>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:   </cpu>
Aug 15 19:01:13 user nova-compute[73188]:   <memoryBacking supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:     <enum name='sourceType'>
Aug 15 19:01:13 user nova-compute[73188]:       <value>file</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>anonymous</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>memfd</value>
Aug 15 19:01:13 user nova-compute[73188]:     </enum>
Aug 15 19:01:13 user nova-compute[73188]:   </memoryBacking>
Aug 15 19:01:13 user nova-compute[73188]:   <devices>
Aug 15 19:01:13 user nova-compute[73188]:     <disk supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='diskDevice'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>disk</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>cdrom</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>floppy</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>lun</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='bus'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>ide</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>fdc</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>scsi</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>usb</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>sata</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-non-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </disk>
Aug 15 19:01:13 user nova-compute[73188]:     <graphics supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='type'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>sdl</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vnc</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>spice</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>egl-headless</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </graphics>
Aug 15 19:01:13 user nova-compute[73188]:     <video supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='modelType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vga</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>cirrus</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vmvga</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>qxl</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>none</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>bochs</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>ramfb</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </video>
Aug 15 19:01:13 user nova-compute[73188]:     <hostdev supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='mode'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>subsystem</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='startupPolicy'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>default</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>mandatory</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>requisite</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>optional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='subsysType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>usb</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>pci</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>scsi</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='capsType'/>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='pciBackend'/>
Aug 15 19:01:13 user nova-compute[73188]:     </hostdev>
Aug 15 19:01:13 user nova-compute[73188]:     <rng supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-non-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='backendModel'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>random</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>egd</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>builtin</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </rng>
Aug 15 19:01:13 user nova-compute[73188]:     <filesystem supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='driverType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>path</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>handle</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtiofs</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </filesystem>
Aug 15 19:01:13 user nova-compute[73188]:     <tpm supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>tpm-tis</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>tpm-crb</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='backendModel'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>passthrough</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>emulator</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </tpm>
Aug 15 19:01:13 user nova-compute[73188]:   </devices>
Aug 15 19:01:13 user nova-compute[73188]:   <features>
Aug 15 19:01:13 user nova-compute[73188]:     <gic supported='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     <vmcoreinfo supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <genid supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <backingStoreInput supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <backup supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <sev supported='no'/>
Aug 15 19:01:13 user nova-compute[73188]:   </features>
Aug 15 19:01:13 user nova-compute[73188]: </domainCapabilities>
Aug 15 19:01:13 user nova-compute[73188]:  {{(pid=73188) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 15 19:01:13 user nova-compute[73188]: <domainCapabilities>
Aug 15 19:01:13 user nova-compute[73188]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 19:01:13 user nova-compute[73188]:   <domain>kvm</domain>
Aug 15 19:01:13 user nova-compute[73188]:   <machine>pc-q35-jammy</machine>
Aug 15 19:01:13 user nova-compute[73188]:   <arch>x86_64</arch>
Aug 15 19:01:13 user nova-compute[73188]:   <vcpu max='288'/>
Aug 15 19:01:13 user nova-compute[73188]:   <iothreads supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:   <os supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:     <enum name='firmware'>
Aug 15 19:01:13 user nova-compute[73188]:       <value>efi</value>
Aug 15 19:01:13 user nova-compute[73188]:     </enum>
Aug 15 19:01:13 user nova-compute[73188]:     <loader supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='type'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>rom</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>pflash</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='readonly'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>yes</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>no</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='secure'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>yes</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>no</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </loader>
Aug 15 19:01:13 user nova-compute[73188]:   </os>
Aug 15 19:01:13 user nova-compute[73188]:   <cpu>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='host-passthrough' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='hostPassthroughMigratable'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>on</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>off</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='maximum' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='maximumMigratable'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>on</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>off</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='host-model' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <vendor>Intel</vendor>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ss'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='vmx'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='pcid'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='hypervisor'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='arat'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='umip'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='md-clear'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='stibp'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ssbd'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='invtsc'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ibpb'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ibrs'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='amd-stibp'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='rsba'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='disable' name='erms'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='custom' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>qemu64</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>qemu32</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>phenom</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium3</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium2</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>n270</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>kvm64</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>kvm32</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>coreduo</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>core2duo</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>athlon</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Westmere</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Snowridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>SandyBridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Penryn</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G5</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G4</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G3</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G2</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Opteron_G1</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Nehalem</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>IvyBridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Icelake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-Rome</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-Milan</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Dhyana</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cooperlake</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Conroe</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>486</model>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:   </cpu>
Aug 15 19:01:13 user nova-compute[73188]:   <memoryBacking supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:     <enum name='sourceType'>
Aug 15 19:01:13 user nova-compute[73188]:       <value>file</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>anonymous</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>memfd</value>
Aug 15 19:01:13 user nova-compute[73188]:     </enum>
Aug 15 19:01:13 user nova-compute[73188]:   </memoryBacking>
Aug 15 19:01:13 user nova-compute[73188]:   <devices>
Aug 15 19:01:13 user nova-compute[73188]:     <disk supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='diskDevice'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>disk</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>cdrom</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>floppy</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>lun</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='bus'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>fdc</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>scsi</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>usb</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>sata</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-non-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </disk>
Aug 15 19:01:13 user nova-compute[73188]:     <graphics supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='type'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>sdl</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vnc</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>spice</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>egl-headless</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </graphics>
Aug 15 19:01:13 user nova-compute[73188]:     <video supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='modelType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vga</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>cirrus</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vmvga</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>qxl</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>none</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>bochs</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>ramfb</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </video>
Aug 15 19:01:13 user nova-compute[73188]:     <hostdev supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='mode'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>subsystem</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='startupPolicy'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>default</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>mandatory</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>requisite</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>optional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='subsysType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>usb</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>pci</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>scsi</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='capsType'/>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='pciBackend'/>
Aug 15 19:01:13 user nova-compute[73188]:     </hostdev>
Aug 15 19:01:13 user nova-compute[73188]:     <rng supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-non-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='backendModel'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>random</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>egd</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>builtin</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </rng>
Aug 15 19:01:13 user nova-compute[73188]:     <filesystem supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='driverType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>path</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>handle</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtiofs</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </filesystem>
Aug 15 19:01:13 user nova-compute[73188]:     <tpm supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>tpm-tis</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>tpm-crb</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='backendModel'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>passthrough</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>emulator</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </tpm>
Aug 15 19:01:13 user nova-compute[73188]:   </devices>
Aug 15 19:01:13 user nova-compute[73188]:   <features>
Aug 15 19:01:13 user nova-compute[73188]:     <gic supported='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     <vmcoreinfo supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <genid supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <backingStoreInput supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <backup supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <sev supported='no'/>
Aug 15 19:01:13 user nova-compute[73188]:   </features>
Aug 15 19:01:13 user nova-compute[73188]: </domainCapabilities>
Aug 15 19:01:13 user nova-compute[73188]:  {{(pid=73188) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 15 19:01:13 user nova-compute[73188]: <domainCapabilities>
Aug 15 19:01:13 user nova-compute[73188]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 19:01:13 user nova-compute[73188]:   <domain>kvm</domain>
Aug 15 19:01:13 user nova-compute[73188]:   <machine>pc-i440fx-jammy</machine>
Aug 15 19:01:13 user nova-compute[73188]:   <arch>x86_64</arch>
Aug 15 19:01:13 user nova-compute[73188]:   <vcpu max='255'/>
Aug 15 19:01:13 user nova-compute[73188]:   <iothreads supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:   <os supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:     <enum name='firmware'>
Aug 15 19:01:13 user nova-compute[73188]:       <value>efi</value>
Aug 15 19:01:13 user nova-compute[73188]:     </enum>
Aug 15 19:01:13 user nova-compute[73188]:     <loader supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='type'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>rom</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>pflash</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='readonly'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>yes</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>no</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='secure'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>no</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </loader>
Aug 15 19:01:13 user nova-compute[73188]:   </os>
Aug 15 19:01:13 user nova-compute[73188]:   <cpu>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='host-passthrough' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='hostPassthroughMigratable'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>on</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>off</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='maximum' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='maximumMigratable'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>on</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>off</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='host-model' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <vendor>Intel</vendor>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ss'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='vmx'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='pcid'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='hypervisor'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='arat'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='umip'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='md-clear'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='stibp'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ssbd'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='invtsc'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ibpb'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='ibrs'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='amd-stibp'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='rsba'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='disable' name='erms'/>
Aug 15 19:01:13 user nova-compute[73188]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:     <mode name='custom' supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>qemu64</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>qemu32</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>phenom</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium3</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium2</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>pentium</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>n270</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>kvm64</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>kvm32</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>coreduo</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>core2duo</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>athlon</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Westmere</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Snowridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Skylake-Client</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>SandyBridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Penryn</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G5</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G4</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G3</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Opteron_G2</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Opteron_G1</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Nehalem</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>IvyBridge</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Icelake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Haswell</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-Rome</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-Milan</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>EPYC</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Dhyana</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cooperlake</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>Conroe</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='no'>Broadwell</model>
Aug 15 19:01:13 user nova-compute[73188]:       <model usable='yes'>486</model>
Aug 15 19:01:13 user nova-compute[73188]:     </mode>
Aug 15 19:01:13 user nova-compute[73188]:   </cpu>
Aug 15 19:01:13 user nova-compute[73188]:   <memoryBacking supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:     <enum name='sourceType'>
Aug 15 19:01:13 user nova-compute[73188]:       <value>file</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>anonymous</value>
Aug 15 19:01:13 user nova-compute[73188]:       <value>memfd</value>
Aug 15 19:01:13 user nova-compute[73188]:     </enum>
Aug 15 19:01:13 user nova-compute[73188]:   </memoryBacking>
Aug 15 19:01:13 user nova-compute[73188]:   <devices>
Aug 15 19:01:13 user nova-compute[73188]:     <disk supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='diskDevice'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>disk</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>cdrom</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>floppy</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>lun</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='bus'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>ide</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>fdc</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>scsi</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>usb</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>sata</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-non-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </disk>
Aug 15 19:01:13 user nova-compute[73188]:     <graphics supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='type'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>sdl</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vnc</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>spice</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>egl-headless</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </graphics>
Aug 15 19:01:13 user nova-compute[73188]:     <video supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='modelType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vga</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>cirrus</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>vmvga</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>qxl</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>none</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>bochs</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>ramfb</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </video>
Aug 15 19:01:13 user nova-compute[73188]:     <hostdev supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='mode'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>subsystem</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='startupPolicy'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>default</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>mandatory</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>requisite</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>optional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='subsysType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>usb</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>pci</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>scsi</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='capsType'/>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='pciBackend'/>
Aug 15 19:01:13 user nova-compute[73188]:     </hostdev>
Aug 15 19:01:13 user nova-compute[73188]:     <rng supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtio-non-transitional</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='backendModel'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>random</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>egd</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>builtin</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </rng>
Aug 15 19:01:13 user nova-compute[73188]:     <filesystem supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='driverType'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>path</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>handle</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>virtiofs</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </filesystem>
Aug 15 19:01:13 user nova-compute[73188]:     <tpm supported='yes'>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='model'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>tpm-tis</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>tpm-crb</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:       <enum name='backendModel'>
Aug 15 19:01:13 user nova-compute[73188]:         <value>passthrough</value>
Aug 15 19:01:13 user nova-compute[73188]:         <value>emulator</value>
Aug 15 19:01:13 user nova-compute[73188]:       </enum>
Aug 15 19:01:13 user nova-compute[73188]:     </tpm>
Aug 15 19:01:13 user nova-compute[73188]:   </devices>
Aug 15 19:01:13 user nova-compute[73188]:   <features>
Aug 15 19:01:13 user nova-compute[73188]:     <gic supported='no'/>
Aug 15 19:01:13 user nova-compute[73188]:     <vmcoreinfo supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <genid supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <backingStoreInput supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <backup supported='yes'/>
Aug 15 19:01:13 user nova-compute[73188]:     <sev supported='no'/>
Aug 15 19:01:13 user nova-compute[73188]:   </features>
Aug 15 19:01:13 user nova-compute[73188]: </domainCapabilities>
Aug 15 19:01:13 user nova-compute[73188]:  {{(pid=73188) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73188) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73188) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Checking secure boot support for host arch (x86_64) {{(pid=73188) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 19:01:13 user nova-compute[73188]: INFO nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Secure Boot support detected
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] cpu compare xml: <cpu match="exact">
Aug 15 19:01:13 user nova-compute[73188]:   <model>Nehalem</model>
Aug 15 19:01:13 user nova-compute[73188]: </cpu>
Aug 15 19:01:13 user nova-compute[73188]:  {{(pid=73188) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 15 19:01:13 user nova-compute[73188]: INFO nova.virt.node [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Generated node identity 63d71eac-d5e2-446b-a323-b32b3e9557e5
Aug 15 19:01:13 user nova-compute[73188]: INFO nova.virt.node [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Wrote node identity 63d71eac-d5e2-446b-a323-b32b3e9557e5 to /opt/stack/data/nova/compute_id
Aug 15 19:01:13 user nova-compute[73188]: WARNING nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Compute nodes ['63d71eac-d5e2-446b-a323-b32b3e9557e5'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 15 19:01:13 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 15 19:01:13 user nova-compute[73188]: WARNING nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 15 19:01:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:01:13 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:01:14 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:01:14 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:01:14 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Hypervisor/Node resource view: name=user free_ram=10843MB free_disk=26.266590118408203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:01:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:01:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:01:14 user nova-compute[73188]: WARNING nova.compute.resource_tracker [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] No compute node record for user:63d71eac-d5e2-446b-a323-b32b3e9557e5: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 63d71eac-d5e2-446b-a323-b32b3e9557e5 could not be found.
Aug 15 19:01:14 user nova-compute[73188]: INFO nova.compute.resource_tracker [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Compute node record created for user:user with uuid: 63d71eac-d5e2-446b-a323-b32b3e9557e5
Aug 15 19:01:14 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:01:14 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:01:14 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [req-6a22f16b-627a-4337-a28d-6eaedabba0f4] Created resource provider record via placement API for resource provider with UUID 63d71eac-d5e2-446b-a323-b32b3e9557e5 and name user.
Aug 15 19:01:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73188) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 15 19:01:14 user nova-compute[73188]: INFO nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] kernel doesn't support AMD SEV
Aug 15 19:01:14 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Updating inventory in ProviderTree for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 19:01:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:01:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Libvirt baseline CPU <cpu>
Aug 15 19:01:14 user nova-compute[73188]:   <arch>x86_64</arch>
Aug 15 19:01:14 user nova-compute[73188]:   <model>Nehalem</model>
Aug 15 19:01:14 user nova-compute[73188]:   <vendor>Intel</vendor>
Aug 15 19:01:14 user nova-compute[73188]:   <topology sockets="6" cores="1" threads="1"/>
Aug 15 19:01:14 user nova-compute[73188]: </cpu>
Aug 15 19:01:14 user nova-compute[73188]:  {{(pid=73188) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 15 19:01:14 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Updated inventory for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 15 19:01:14 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Updating resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 generation from 0 to 1 during operation: update_inventory {{(pid=73188) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 15 19:01:14 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Updating inventory in ProviderTree for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 19:01:14 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Updating resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 generation from 1 to 2 during operation: update_traits {{(pid=73188) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 15 19:01:14 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:01:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.603s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:01:14 user nova-compute[73188]: DEBUG nova.service [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Creating RPC server for service compute {{(pid=73188) start /opt/stack/nova/nova/service.py:182}}
Aug 15 19:01:14 user nova-compute[73188]: DEBUG nova.service [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Join ServiceGroup membership for this service compute {{(pid=73188) start /opt/stack/nova/nova/service.py:199}}
Aug 15 19:01:14 user nova-compute[73188]: DEBUG nova.servicegroup.drivers.db [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73188) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 15 19:01:26 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_power_states {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:01:26 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:02:05 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:02:05 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:02:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:02:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:02:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Didn't find any instances for network info cache update. {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 19:02:05 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:02:05 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:02:05 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:02:05 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:02:05 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:02:05 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:02:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:02:05 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:02:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:02:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:02:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:02:05 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:02:05 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:02:05 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:02:05 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=10264MB free_disk=26.170310974121094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:02:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:02:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:02:06 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:02:06 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:02:06 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:02:06 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:02:06 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:02:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:03:06 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:03:06 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:03:06 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:03:06 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:03:06 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:03:06 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:03:07 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:03:07 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:03:07 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:03:07 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:03:07 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Didn't find any instances for network info cache update. {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 19:03:07 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:03:07 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:03:07 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:03:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:03:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:03:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:03:07 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:03:07 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:03:07 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:03:07 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=10197MB free_disk=26.216773986816406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:03:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:03:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:03:07 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:03:07 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:03:08 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:03:08 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:03:08 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:03:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:04:06 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:04:06 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:04:06 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:04:07 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:04:07 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:04:07 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:04:07 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Didn't find any instances for network info cache update. {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 19:04:07 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:04:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:04:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:04:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:04:07 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:04:07 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:04:07 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:04:07 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=10201MB free_disk=26.000595092773438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:04:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:04:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:04:07 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:04:07 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:04:07 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:04:07 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:04:08 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:04:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:04:09 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:04:09 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:04:09 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:04:09 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:04:09 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:05:06 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:05:07 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:05:07 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:05:07 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:05:07 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Didn't find any instances for network info cache update. {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 19:05:07 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:05:08 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:05:08 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:05:08 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:05:08 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:05:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:08 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:05:08 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:05:08 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:05:08 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=9473MB free_disk=26.023685455322266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:05:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:09 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:05:09 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:05:09 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:05:09 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:05:09 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:05:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.557s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:10 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:05:10 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:05:10 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:05:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:05:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:05:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:05:14 user nova-compute[73188]: INFO nova.compute.claims [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Claim successful on node user
Aug 15 19:05:14 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:05:14 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:05:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.285s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:05:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:05:14 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:05:14 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:05:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:05:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:05:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:05:14 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Creating image(s)
Aug 15 19:05:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "/opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "/opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:15 user nova-compute[73188]: DEBUG nova.policy [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bad952eceaec400396fd0a28c438c761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab4e1cccd434f6c83f2f9e4687d274e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:05:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f.part --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f.part --force-share --output=json" returned: 0 in 0.204s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:16 user nova-compute[73188]: DEBUG nova.virt.images [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] f00e830a-b2ca-4a70-976f-0b43c7345f1b was qcow2, converting to raw {{(pid=73188) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 19:05:16 user nova-compute[73188]: DEBUG nova.privsep.utils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73188) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 19:05:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f.part /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f.converted {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f.part /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f.converted" returned: 0 in 0.165s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f.converted --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f.converted --force-share --output=json" returned: 0 in 0.224s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.755s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:16 user nova-compute[73188]: INFO oslo.privsep.daemon [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp7xni0vh1/privsep.sock']
Aug 15 19:05:16 user sudo[82400]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp7xni0vh1/privsep.sock
Aug 15 19:05:16 user sudo[82400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 19:05:18 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Successfully created port: 85966f51-bc7f-46ed-8065-ecec627cfeb7 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:05:18 user sudo[82400]: pam_unix(sudo:session): session closed for user root
Aug 15 19:05:18 user nova-compute[73188]: INFO oslo.privsep.daemon [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Spawned new privsep daemon via rootwrap
Aug 15 19:05:18 user nova-compute[73188]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 19:05:18 user nova-compute[73188]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 19:05:18 user nova-compute[73188]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 15 19:05:18 user nova-compute[73188]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82404
Aug 15 19:05:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.168s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk 1073741824" returned: 0 in 0.046s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.224s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Cannot resize image /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG nova.objects.instance [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'migration_context' on Instance uuid ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Ensure instance console log exists: /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG nova.compute.manager [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:05:19 user nova-compute[73188]: INFO nova.compute.claims [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Claim successful on node user
Aug 15 19:05:19 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:05:19 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:05:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:05:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:05:20 user nova-compute[73188]: DEBUG nova.network.neutron [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:05:20 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:05:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:05:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:05:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:05:20 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Creating image(s)
Aug 15 19:05:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "/opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "/opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.183s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:20 user nova-compute[73188]: DEBUG nova.policy [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60be9c6b4c1b4f4b9038a3a6af7c3648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418458ca9ca647788ef8dd45ced52707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:05:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.193s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk 1073741824" returned: 0 in 0.056s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.191s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:20 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:05:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:21 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Cannot resize image /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:05:21 user nova-compute[73188]: DEBUG nova.objects.instance [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lazy-loading 'migration_context' on Instance uuid d1b5f5bf-9672-40a8-83da-3a8f25007e91 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:05:21 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Successfully updated port: 85966f51-bc7f-46ed-8065-ecec627cfeb7 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:05:21 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:05:21 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Ensure instance console log exists: /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:05:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "refresh_cache-ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:05:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquired lock "refresh_cache-ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:05:21 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:05:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-0df3b883-7c70-4520-879f-9efb864cc042 req-4e086998-15d4-4f11-9419-0fa49a15b61c service nova] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Received event network-changed-85966f51-bc7f-46ed-8065-ecec627cfeb7 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:05:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-0df3b883-7c70-4520-879f-9efb864cc042 req-4e086998-15d4-4f11-9419-0fa49a15b61c service nova] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Refreshing instance network info cache due to event network-changed-85966f51-bc7f-46ed-8065-ecec627cfeb7. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:05:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0df3b883-7c70-4520-879f-9efb864cc042 req-4e086998-15d4-4f11-9419-0fa49a15b61c service nova] Acquiring lock "refresh_cache-ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:05:21 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:05:22 user nova-compute[73188]: DEBUG nova.network.neutron [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Successfully created port: d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Acquiring lock "7caf434b-1484-4832-afee-0e2454bb5089" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "7caf434b-1484-4832-afee-0e2454bb5089" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:05:23 user nova-compute[73188]: INFO nova.compute.claims [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Claim successful on node user
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Updating instance_info_cache with network_info: [{"id": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "address": "fa:16:3e:df:71:ad", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85966f51-bc", "ovs_interfaceid": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Releasing lock "refresh_cache-ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Instance network_info: |[{"id": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "address": "fa:16:3e:df:71:ad", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85966f51-bc", "ovs_interfaceid": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0df3b883-7c70-4520-879f-9efb864cc042 req-4e086998-15d4-4f11-9419-0fa49a15b61c service nova] Acquired lock "refresh_cache-ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.network.neutron [req-0df3b883-7c70-4520-879f-9efb864cc042 req-4e086998-15d4-4f11-9419-0fa49a15b61c service nova] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Refreshing network info cache for port 85966f51-bc7f-46ed-8065-ecec627cfeb7 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Start _get_guest_xml network_info=[{"id": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "address": "fa:16:3e:df:71:ad", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85966f51-bc", "ovs_interfaceid": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:05:23 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:05:23 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.privsep.utils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73188) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-978893005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-978893005',id=1,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ab4e1cccd434f6c83f2f9e4687d274e',ramdisk_id='',reservation_id='r-asjt4bjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:05:15Z,user_data=None,user_id='bad952eceaec400396fd0a28c438c761',uuid=ff4ca43e-3c17-458a-bd3e-4204a6d96fd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "address": "fa:16:3e:df:71:ad", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85966f51-bc", "ovs_interfaceid": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converting VIF {"id": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "address": "fa:16:3e:df:71:ad", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85966f51-bc", "ovs_interfaceid": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:71:ad,bridge_name='br-int',has_traffic_filtering=True,id=85966f51-bc7f-46ed-8065-ecec627cfeb7,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85966f51-bc') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.objects.instance [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'pci_devices' on Instance uuid ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:05:23 user nova-compute[73188]:   <uuid>ff4ca43e-3c17-458a-bd3e-4204a6d96fd6</uuid>
Aug 15 19:05:23 user nova-compute[73188]:   <name>instance-00000001</name>
Aug 15 19:05:23 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:05:23 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:05:23 user nova-compute[73188]:   <metadata>
Aug 15 19:05:23 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:05:23 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:05:23 user nova-compute[73188]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-978893005</nova:name>
Aug 15 19:05:23 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:05:23</nova:creationTime>
Aug 15 19:05:23 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:05:23 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:05:23 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:05:23 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:05:23 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:05:23 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:05:23 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:05:23 user nova-compute[73188]:       <nova:owner>
Aug 15 19:05:23 user nova-compute[73188]:         <nova:user uuid="bad952eceaec400396fd0a28c438c761">tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member</nova:user>
Aug 15 19:05:23 user nova-compute[73188]:         <nova:project uuid="0ab4e1cccd434f6c83f2f9e4687d274e">tempest-ServerBootFromVolumeStableRescueTest-1886926549</nova:project>
Aug 15 19:05:23 user nova-compute[73188]:       </nova:owner>
Aug 15 19:05:23 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:05:23 user nova-compute[73188]:       <nova:ports>
Aug 15 19:05:23 user nova-compute[73188]:         <nova:port uuid="85966f51-bc7f-46ed-8065-ecec627cfeb7">
Aug 15 19:05:23 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 19:05:23 user nova-compute[73188]:         </nova:port>
Aug 15 19:05:23 user nova-compute[73188]:       </nova:ports>
Aug 15 19:05:23 user nova-compute[73188]:     </nova:instance>
Aug 15 19:05:23 user nova-compute[73188]:   </metadata>
Aug 15 19:05:23 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:05:23 user nova-compute[73188]:     <system>
Aug 15 19:05:23 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:05:23 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:05:23 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:05:23 user nova-compute[73188]:       <entry name="serial">ff4ca43e-3c17-458a-bd3e-4204a6d96fd6</entry>
Aug 15 19:05:23 user nova-compute[73188]:       <entry name="uuid">ff4ca43e-3c17-458a-bd3e-4204a6d96fd6</entry>
Aug 15 19:05:23 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:05:23 user nova-compute[73188]:     </system>
Aug 15 19:05:23 user nova-compute[73188]:   </sysinfo>
Aug 15 19:05:23 user nova-compute[73188]:   <os>
Aug 15 19:05:23 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:05:23 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:05:23 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:05:23 user nova-compute[73188]:   </os>
Aug 15 19:05:23 user nova-compute[73188]:   <features>
Aug 15 19:05:23 user nova-compute[73188]:     <acpi/>
Aug 15 19:05:23 user nova-compute[73188]:     <apic/>
Aug 15 19:05:23 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:05:23 user nova-compute[73188]:   </features>
Aug 15 19:05:23 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:05:23 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:05:23 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:05:23 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:05:23 user nova-compute[73188]:   </clock>
Aug 15 19:05:23 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:05:23 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:05:23 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:05:23 user nova-compute[73188]:   </cpu>
Aug 15 19:05:23 user nova-compute[73188]:   <devices>
Aug 15 19:05:23 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:05:23 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:05:23 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk"/>
Aug 15 19:05:23 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:05:23 user nova-compute[73188]:     </disk>
Aug 15 19:05:23 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:05:23 user nova-compute[73188]:       <mac address="fa:16:3e:df:71:ad"/>
Aug 15 19:05:23 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:05:23 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:05:23 user nova-compute[73188]:       <target dev="tap85966f51-bc"/>
Aug 15 19:05:23 user nova-compute[73188]:     </interface>
Aug 15 19:05:23 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:05:23 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/console.log" append="off"/>
Aug 15 19:05:23 user nova-compute[73188]:     </serial>
Aug 15 19:05:23 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:05:23 user nova-compute[73188]:     <video>
Aug 15 19:05:23 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:05:23 user nova-compute[73188]:     </video>
Aug 15 19:05:23 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:05:23 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:05:23 user nova-compute[73188]:     </rng>
Aug 15 19:05:23 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:05:23 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:05:23 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:05:23 user nova-compute[73188]:     </memballoon>
Aug 15 19:05:23 user nova-compute[73188]:   </devices>
Aug 15 19:05:23 user nova-compute[73188]: </domain>
Aug 15 19:05:23 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-978893005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-978893005',id=1,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ab4e1cccd434f6c83f2f9e4687d274e',ramdisk_id='',reservation_id='r-asjt4bjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:05:15Z,user_data=None,user_id='bad952eceaec400396fd0a28c438c761',uuid=ff4ca43e-3c17-458a-bd3e-4204a6d96fd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "address": "fa:16:3e:df:71:ad", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85966f51-bc", "ovs_interfaceid": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converting VIF {"id": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "address": "fa:16:3e:df:71:ad", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85966f51-bc", "ovs_interfaceid": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:71:ad,bridge_name='br-int',has_traffic_filtering=True,id=85966f51-bc7f-46ed-8065-ecec627cfeb7,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85966f51-bc') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG os_vif [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:71:ad,bridge_name='br-int',has_traffic_filtering=True,id=85966f51-bc7f-46ed-8065-ecec627cfeb7,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85966f51-bc') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Created schema index Interface.name {{(pid=73188) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Created schema index Port.name {{(pid=73188) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Created schema index Bridge.name {{(pid=73188) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [POLLOUT] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:05:23 user nova-compute[73188]: INFO oslo.privsep.daemon [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp69z5f5i7/privsep.sock']
Aug 15 19:05:23 user sudo[82461]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp69z5f5i7/privsep.sock
Aug 15 19:05:23 user sudo[82461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.network.neutron [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:05:23 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:05:23 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Creating image(s)
Aug 15 19:05:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Acquiring lock "/opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "/opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "/opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.169s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:24 user nova-compute[73188]: DEBUG nova.policy [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86c870adbae94c43808f8418d9c8aebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f959aaaf0fe4406a723804e59eb47ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:05:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk 1073741824" returned: 0 in 0.040s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.177s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:24 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:05:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:24 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Cannot resize image /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:05:24 user nova-compute[73188]: DEBUG nova.objects.instance [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lazy-loading 'migration_context' on Instance uuid 7caf434b-1484-4832-afee-0e2454bb5089 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:05:24 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:05:24 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Ensure instance console log exists: /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:05:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:25 user nova-compute[73188]: DEBUG nova.network.neutron [req-0df3b883-7c70-4520-879f-9efb864cc042 req-4e086998-15d4-4f11-9419-0fa49a15b61c service nova] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Updated VIF entry in instance network info cache for port 85966f51-bc7f-46ed-8065-ecec627cfeb7. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:05:25 user nova-compute[73188]: DEBUG nova.network.neutron [req-0df3b883-7c70-4520-879f-9efb864cc042 req-4e086998-15d4-4f11-9419-0fa49a15b61c service nova] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Updating instance_info_cache with network_info: [{"id": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "address": "fa:16:3e:df:71:ad", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85966f51-bc", "ovs_interfaceid": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:05:25 user sudo[82461]: pam_unix(sudo:session): session closed for user root
Aug 15 19:05:25 user nova-compute[73188]: INFO oslo.privsep.daemon [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Spawned new privsep daemon via rootwrap
Aug 15 19:05:25 user nova-compute[73188]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 19:05:25 user nova-compute[73188]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 19:05:25 user nova-compute[73188]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 15 19:05:25 user nova-compute[73188]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82480
Aug 15 19:05:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0df3b883-7c70-4520-879f-9efb864cc042 req-4e086998-15d4-4f11-9419-0fa49a15b61c service nova] Releasing lock "refresh_cache-ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:05:25 user nova-compute[73188]: DEBUG nova.network.neutron [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Successfully updated port: d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:05:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:05:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquired lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:05:25 user nova-compute[73188]: DEBUG nova.network.neutron [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:05:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85966f51-bc, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:05:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85966f51-bc, col_values=(('external_ids', {'iface-id': '85966f51-bc7f-46ed-8065-ecec627cfeb7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:71:ad', 'vm-uuid': 'ff4ca43e-3c17-458a-bd3e-4204a6d96fd6'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:05:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:05:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:25 user nova-compute[73188]: INFO os_vif [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:71:ad,bridge_name='br-int',has_traffic_filtering=True,id=85966f51-bc7f-46ed-8065-ecec627cfeb7,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85966f51-bc')
Aug 15 19:05:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:05:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] No VIF found with MAC fa:16:3e:df:71:ad, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:05:26 user nova-compute[73188]: DEBUG nova.network.neutron [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:05:26 user nova-compute[73188]: DEBUG nova.compute.manager [req-382ae70e-59fc-4f41-8123-68c2a74d949b req-ef540c3e-e9f2-47d5-a65b-3e6ed2437973 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received event network-changed-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:05:26 user nova-compute[73188]: DEBUG nova.compute.manager [req-382ae70e-59fc-4f41-8123-68c2a74d949b req-ef540c3e-e9f2-47d5-a65b-3e6ed2437973 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Refreshing instance network info cache due to event network-changed-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:05:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-382ae70e-59fc-4f41-8123-68c2a74d949b req-ef540c3e-e9f2-47d5-a65b-3e6ed2437973 service nova] Acquiring lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:05:26 user nova-compute[73188]: DEBUG nova.network.neutron [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Successfully created port: 8b93115d-3416-4846-9c43-a36a66f99e41 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:05:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:26 user nova-compute[73188]: DEBUG nova.network.neutron [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Updating instance_info_cache with network_info: [{"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:05:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Releasing lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:05:26 user nova-compute[73188]: DEBUG nova.compute.manager [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Instance network_info: |[{"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:05:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-382ae70e-59fc-4f41-8123-68c2a74d949b req-ef540c3e-e9f2-47d5-a65b-3e6ed2437973 service nova] Acquired lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:05:26 user nova-compute[73188]: DEBUG nova.network.neutron [req-382ae70e-59fc-4f41-8123-68c2a74d949b req-ef540c3e-e9f2-47d5-a65b-3e6ed2437973 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Refreshing network info cache for port d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:05:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Start _get_guest_xml network_info=[{"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:05:26 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:05:26 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:05:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:05:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:05:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:05:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2075783787',display_name='tempest-ServerActionsTestOtherB-server-2075783787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2075783787',id=2,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGAn2WMlt73NTUykPIA6PkYCDLbBTR2Yho5Rj2kET8coL/tBEtc4GHmcnA5ijjJ1l2hsUy4+ooa5E/SUoQZ5kfWNtXI5i4fVvpa+4mLZw6dteSEtg5YyfVDHt6PHs7vAQ==',key_name='tempest-keypair-93276017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='418458ca9ca647788ef8dd45ced52707',ramdisk_id='',reservation_id='r-36kpwfhi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1641219687',owner_user_name='tempest-ServerActionsTestOtherB-1641219687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:05:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60be9c6b4c1b4f4b9038a3a6af7c3648',uuid=d1b5f5bf-9672-40a8-83da-3a8f25007e91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Converting VIF {"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:5e:42,bridge_name='br-int',has_traffic_filtering=True,id=d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a,network=Network(10d6e7cc-813b-43e5-850a-cbdd4bd41525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5133aa6-a8') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG nova.objects.instance [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lazy-loading 'pci_devices' on Instance uuid d1b5f5bf-9672-40a8-83da-3a8f25007e91 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:05:27 user nova-compute[73188]:   <uuid>d1b5f5bf-9672-40a8-83da-3a8f25007e91</uuid>
Aug 15 19:05:27 user nova-compute[73188]:   <name>instance-00000002</name>
Aug 15 19:05:27 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:05:27 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:05:27 user nova-compute[73188]:   <metadata>
Aug 15 19:05:27 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:05:27 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:05:27 user nova-compute[73188]:       <nova:name>tempest-ServerActionsTestOtherB-server-2075783787</nova:name>
Aug 15 19:05:27 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:05:26</nova:creationTime>
Aug 15 19:05:27 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:05:27 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:05:27 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:05:27 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:05:27 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:05:27 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:05:27 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:05:27 user nova-compute[73188]:       <nova:owner>
Aug 15 19:05:27 user nova-compute[73188]:         <nova:user uuid="60be9c6b4c1b4f4b9038a3a6af7c3648">tempest-ServerActionsTestOtherB-1641219687-project-member</nova:user>
Aug 15 19:05:27 user nova-compute[73188]:         <nova:project uuid="418458ca9ca647788ef8dd45ced52707">tempest-ServerActionsTestOtherB-1641219687</nova:project>
Aug 15 19:05:27 user nova-compute[73188]:       </nova:owner>
Aug 15 19:05:27 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:05:27 user nova-compute[73188]:       <nova:ports>
Aug 15 19:05:27 user nova-compute[73188]:         <nova:port uuid="d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a">
Aug 15 19:05:27 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 19:05:27 user nova-compute[73188]:         </nova:port>
Aug 15 19:05:27 user nova-compute[73188]:       </nova:ports>
Aug 15 19:05:27 user nova-compute[73188]:     </nova:instance>
Aug 15 19:05:27 user nova-compute[73188]:   </metadata>
Aug 15 19:05:27 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:05:27 user nova-compute[73188]:     <system>
Aug 15 19:05:27 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:05:27 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:05:27 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:05:27 user nova-compute[73188]:       <entry name="serial">d1b5f5bf-9672-40a8-83da-3a8f25007e91</entry>
Aug 15 19:05:27 user nova-compute[73188]:       <entry name="uuid">d1b5f5bf-9672-40a8-83da-3a8f25007e91</entry>
Aug 15 19:05:27 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:05:27 user nova-compute[73188]:     </system>
Aug 15 19:05:27 user nova-compute[73188]:   </sysinfo>
Aug 15 19:05:27 user nova-compute[73188]:   <os>
Aug 15 19:05:27 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:05:27 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:05:27 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:05:27 user nova-compute[73188]:   </os>
Aug 15 19:05:27 user nova-compute[73188]:   <features>
Aug 15 19:05:27 user nova-compute[73188]:     <acpi/>
Aug 15 19:05:27 user nova-compute[73188]:     <apic/>
Aug 15 19:05:27 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:05:27 user nova-compute[73188]:   </features>
Aug 15 19:05:27 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:05:27 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:05:27 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:05:27 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:05:27 user nova-compute[73188]:   </clock>
Aug 15 19:05:27 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:05:27 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:05:27 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:05:27 user nova-compute[73188]:   </cpu>
Aug 15 19:05:27 user nova-compute[73188]:   <devices>
Aug 15 19:05:27 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:05:27 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:05:27 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk"/>
Aug 15 19:05:27 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:05:27 user nova-compute[73188]:     </disk>
Aug 15 19:05:27 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:05:27 user nova-compute[73188]:       <mac address="fa:16:3e:10:5e:42"/>
Aug 15 19:05:27 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:05:27 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:05:27 user nova-compute[73188]:       <target dev="tapd5133aa6-a8"/>
Aug 15 19:05:27 user nova-compute[73188]:     </interface>
Aug 15 19:05:27 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:05:27 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/console.log" append="off"/>
Aug 15 19:05:27 user nova-compute[73188]:     </serial>
Aug 15 19:05:27 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:05:27 user nova-compute[73188]:     <video>
Aug 15 19:05:27 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:05:27 user nova-compute[73188]:     </video>
Aug 15 19:05:27 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:05:27 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:05:27 user nova-compute[73188]:     </rng>
Aug 15 19:05:27 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:05:27 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:05:27 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:05:27 user nova-compute[73188]:     </memballoon>
Aug 15 19:05:27 user nova-compute[73188]:   </devices>
Aug 15 19:05:27 user nova-compute[73188]: </domain>
Aug 15 19:05:27 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2075783787',display_name='tempest-ServerActionsTestOtherB-server-2075783787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2075783787',id=2,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGAn2WMlt73NTUykPIA6PkYCDLbBTR2Yho5Rj2kET8coL/tBEtc4GHmcnA5ijjJ1l2hsUy4+ooa5E/SUoQZ5kfWNtXI5i4fVvpa+4mLZw6dteSEtg5YyfVDHt6PHs7vAQ==',key_name='tempest-keypair-93276017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='418458ca9ca647788ef8dd45ced52707',ramdisk_id='',reservation_id='r-36kpwfhi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1641219687',owner_user_name='tempest-ServerActionsTestOtherB-1641219687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:05:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60be9c6b4c1b4f4b9038a3a6af7c3648',uuid=d1b5f5bf-9672-40a8-83da-3a8f25007e91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Converting VIF {"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:5e:42,bridge_name='br-int',has_traffic_filtering=True,id=d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a,network=Network(10d6e7cc-813b-43e5-850a-cbdd4bd41525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5133aa6-a8') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG os_vif [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:5e:42,bridge_name='br-int',has_traffic_filtering=True,id=d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a,network=Network(10d6e7cc-813b-43e5-850a-cbdd4bd41525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5133aa6-a8') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5133aa6-a8, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5133aa6-a8, col_values=(('external_ids', {'iface-id': 'd5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:5e:42', 'vm-uuid': 'd1b5f5bf-9672-40a8-83da-3a8f25007e91'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:27 user nova-compute[73188]: INFO os_vif [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:5e:42,bridge_name='br-int',has_traffic_filtering=True,id=d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a,network=Network(10d6e7cc-813b-43e5-850a-cbdd4bd41525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5133aa6-a8')
Aug 15 19:05:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] No VIF found with MAC fa:16:3e:10:5e:42, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:05:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:28 user nova-compute[73188]: DEBUG nova.network.neutron [req-382ae70e-59fc-4f41-8123-68c2a74d949b req-ef540c3e-e9f2-47d5-a65b-3e6ed2437973 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Updated VIF entry in instance network info cache for port d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:05:28 user nova-compute[73188]: DEBUG nova.network.neutron [req-382ae70e-59fc-4f41-8123-68c2a74d949b req-ef540c3e-e9f2-47d5-a65b-3e6ed2437973 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Updating instance_info_cache with network_info: [{"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:05:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-382ae70e-59fc-4f41-8123-68c2a74d949b req-ef540c3e-e9f2-47d5-a65b-3e6ed2437973 service nova] Releasing lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:05:28 user nova-compute[73188]: DEBUG nova.network.neutron [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Successfully updated port: 8b93115d-3416-4846-9c43-a36a66f99e41 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:05:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Acquiring lock "refresh_cache-7caf434b-1484-4832-afee-0e2454bb5089" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:05:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Acquired lock "refresh_cache-7caf434b-1484-4832-afee-0e2454bb5089" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:05:28 user nova-compute[73188]: DEBUG nova.network.neutron [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:05:28 user nova-compute[73188]: DEBUG nova.compute.manager [req-01b8625d-64e7-4ae8-9e13-e77b910d1b60 req-50f089bb-4cb6-4382-830e-cf894a8dd6fc service nova] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Received event network-changed-8b93115d-3416-4846-9c43-a36a66f99e41 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:05:28 user nova-compute[73188]: DEBUG nova.compute.manager [req-01b8625d-64e7-4ae8-9e13-e77b910d1b60 req-50f089bb-4cb6-4382-830e-cf894a8dd6fc service nova] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Refreshing instance network info cache due to event network-changed-8b93115d-3416-4846-9c43-a36a66f99e41. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:05:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-01b8625d-64e7-4ae8-9e13-e77b910d1b60 req-50f089bb-4cb6-4382-830e-cf894a8dd6fc service nova] Acquiring lock "refresh_cache-7caf434b-1484-4832-afee-0e2454bb5089" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:05:28 user nova-compute[73188]: DEBUG nova.network.neutron [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:05:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.network.neutron [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Updating instance_info_cache with network_info: [{"id": "8b93115d-3416-4846-9c43-a36a66f99e41", "address": "fa:16:3e:da:94:b4", "network": {"id": "8c59b78f-940b-409a-a485-2ee269ef8a5f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2048234860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f959aaaf0fe4406a723804e59eb47ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b93115d-34", "ovs_interfaceid": "8b93115d-3416-4846-9c43-a36a66f99e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Releasing lock "refresh_cache-7caf434b-1484-4832-afee-0e2454bb5089" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Instance network_info: |[{"id": "8b93115d-3416-4846-9c43-a36a66f99e41", "address": "fa:16:3e:da:94:b4", "network": {"id": "8c59b78f-940b-409a-a485-2ee269ef8a5f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2048234860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f959aaaf0fe4406a723804e59eb47ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b93115d-34", "ovs_interfaceid": "8b93115d-3416-4846-9c43-a36a66f99e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-01b8625d-64e7-4ae8-9e13-e77b910d1b60 req-50f089bb-4cb6-4382-830e-cf894a8dd6fc service nova] Acquired lock "refresh_cache-7caf434b-1484-4832-afee-0e2454bb5089" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.network.neutron [req-01b8625d-64e7-4ae8-9e13-e77b910d1b60 req-50f089bb-4cb6-4382-830e-cf894a8dd6fc service nova] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Refreshing network info cache for port 8b93115d-3416-4846-9c43-a36a66f99e41 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Start _get_guest_xml network_info=[{"id": "8b93115d-3416-4846-9c43-a36a66f99e41", "address": "fa:16:3e:da:94:b4", "network": {"id": "8c59b78f-940b-409a-a485-2ee269ef8a5f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2048234860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f959aaaf0fe4406a723804e59eb47ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b93115d-34", "ovs_interfaceid": "8b93115d-3416-4846-9c43-a36a66f99e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:05:29 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:05:29 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2019357191',display_name='tempest-ServersNegativeTestJSON-server-2019357191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2019357191',id=3,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f959aaaf0fe4406a723804e59eb47ae',ramdisk_id='',reservation_id='r-p7joaxs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1086586370',owner_user_name='tempest-ServersNegativeTestJSON-1086586370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:05:24Z,user_data=None,user_id='86c870adbae94c43808f8418d9c8aebd',uuid=7caf434b-1484-4832-afee-0e2454bb5089,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b93115d-3416-4846-9c43-a36a66f99e41", "address": "fa:16:3e:da:94:b4", "network": {"id": "8c59b78f-940b-409a-a485-2ee269ef8a5f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2048234860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f959aaaf0fe4406a723804e59eb47ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b93115d-34", "ovs_interfaceid": "8b93115d-3416-4846-9c43-a36a66f99e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Converting VIF {"id": "8b93115d-3416-4846-9c43-a36a66f99e41", "address": "fa:16:3e:da:94:b4", "network": {"id": "8c59b78f-940b-409a-a485-2ee269ef8a5f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2048234860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f959aaaf0fe4406a723804e59eb47ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b93115d-34", "ovs_interfaceid": "8b93115d-3416-4846-9c43-a36a66f99e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:94:b4,bridge_name='br-int',has_traffic_filtering=True,id=8b93115d-3416-4846-9c43-a36a66f99e41,network=Network(8c59b78f-940b-409a-a485-2ee269ef8a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b93115d-34') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.objects.instance [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lazy-loading 'pci_devices' on Instance uuid 7caf434b-1484-4832-afee-0e2454bb5089 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:05:29 user nova-compute[73188]:   <uuid>7caf434b-1484-4832-afee-0e2454bb5089</uuid>
Aug 15 19:05:29 user nova-compute[73188]:   <name>instance-00000003</name>
Aug 15 19:05:29 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:05:29 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:05:29 user nova-compute[73188]:   <metadata>
Aug 15 19:05:29 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:05:29 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:05:29 user nova-compute[73188]:       <nova:name>tempest-ServersNegativeTestJSON-server-2019357191</nova:name>
Aug 15 19:05:29 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:05:29</nova:creationTime>
Aug 15 19:05:29 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:05:29 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:05:29 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:05:29 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:05:29 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:05:29 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:05:29 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:05:29 user nova-compute[73188]:       <nova:owner>
Aug 15 19:05:29 user nova-compute[73188]:         <nova:user uuid="86c870adbae94c43808f8418d9c8aebd">tempest-ServersNegativeTestJSON-1086586370-project-member</nova:user>
Aug 15 19:05:29 user nova-compute[73188]:         <nova:project uuid="2f959aaaf0fe4406a723804e59eb47ae">tempest-ServersNegativeTestJSON-1086586370</nova:project>
Aug 15 19:05:29 user nova-compute[73188]:       </nova:owner>
Aug 15 19:05:29 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:05:29 user nova-compute[73188]:       <nova:ports>
Aug 15 19:05:29 user nova-compute[73188]:         <nova:port uuid="8b93115d-3416-4846-9c43-a36a66f99e41">
Aug 15 19:05:29 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 19:05:29 user nova-compute[73188]:         </nova:port>
Aug 15 19:05:29 user nova-compute[73188]:       </nova:ports>
Aug 15 19:05:29 user nova-compute[73188]:     </nova:instance>
Aug 15 19:05:29 user nova-compute[73188]:   </metadata>
Aug 15 19:05:29 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:05:29 user nova-compute[73188]:     <system>
Aug 15 19:05:29 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:05:29 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:05:29 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:05:29 user nova-compute[73188]:       <entry name="serial">7caf434b-1484-4832-afee-0e2454bb5089</entry>
Aug 15 19:05:29 user nova-compute[73188]:       <entry name="uuid">7caf434b-1484-4832-afee-0e2454bb5089</entry>
Aug 15 19:05:29 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:05:29 user nova-compute[73188]:     </system>
Aug 15 19:05:29 user nova-compute[73188]:   </sysinfo>
Aug 15 19:05:29 user nova-compute[73188]:   <os>
Aug 15 19:05:29 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:05:29 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:05:29 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:05:29 user nova-compute[73188]:   </os>
Aug 15 19:05:29 user nova-compute[73188]:   <features>
Aug 15 19:05:29 user nova-compute[73188]:     <acpi/>
Aug 15 19:05:29 user nova-compute[73188]:     <apic/>
Aug 15 19:05:29 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:05:29 user nova-compute[73188]:   </features>
Aug 15 19:05:29 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:05:29 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:05:29 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:05:29 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:05:29 user nova-compute[73188]:   </clock>
Aug 15 19:05:29 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:05:29 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:05:29 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:05:29 user nova-compute[73188]:   </cpu>
Aug 15 19:05:29 user nova-compute[73188]:   <devices>
Aug 15 19:05:29 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:05:29 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:05:29 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk"/>
Aug 15 19:05:29 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:05:29 user nova-compute[73188]:     </disk>
Aug 15 19:05:29 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:05:29 user nova-compute[73188]:       <mac address="fa:16:3e:da:94:b4"/>
Aug 15 19:05:29 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:05:29 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:05:29 user nova-compute[73188]:       <target dev="tap8b93115d-34"/>
Aug 15 19:05:29 user nova-compute[73188]:     </interface>
Aug 15 19:05:29 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:05:29 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/console.log" append="off"/>
Aug 15 19:05:29 user nova-compute[73188]:     </serial>
Aug 15 19:05:29 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:05:29 user nova-compute[73188]:     <video>
Aug 15 19:05:29 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:05:29 user nova-compute[73188]:     </video>
Aug 15 19:05:29 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:05:29 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:05:29 user nova-compute[73188]:     </rng>
Aug 15 19:05:29 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:05:29 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:05:29 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:05:29 user nova-compute[73188]:     </memballoon>
Aug 15 19:05:29 user nova-compute[73188]:   </devices>
Aug 15 19:05:29 user nova-compute[73188]: </domain>
Aug 15 19:05:29 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2019357191',display_name='tempest-ServersNegativeTestJSON-server-2019357191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2019357191',id=3,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f959aaaf0fe4406a723804e59eb47ae',ramdisk_id='',reservation_id='r-p7joaxs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1086586370',owner_user_name='tempest-ServersNegativeTestJSON-1086586370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:05:24Z,user_data=None,user_id='86c870adbae94c43808f8418d9c8aebd',uuid=7caf434b-1484-4832-afee-0e2454bb5089,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b93115d-3416-4846-9c43-a36a66f99e41", "address": "fa:16:3e:da:94:b4", "network": {"id": "8c59b78f-940b-409a-a485-2ee269ef8a5f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2048234860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f959aaaf0fe4406a723804e59eb47ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b93115d-34", "ovs_interfaceid": "8b93115d-3416-4846-9c43-a36a66f99e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Converting VIF {"id": "8b93115d-3416-4846-9c43-a36a66f99e41", "address": "fa:16:3e:da:94:b4", "network": {"id": "8c59b78f-940b-409a-a485-2ee269ef8a5f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2048234860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f959aaaf0fe4406a723804e59eb47ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b93115d-34", "ovs_interfaceid": "8b93115d-3416-4846-9c43-a36a66f99e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:94:b4,bridge_name='br-int',has_traffic_filtering=True,id=8b93115d-3416-4846-9c43-a36a66f99e41,network=Network(8c59b78f-940b-409a-a485-2ee269ef8a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b93115d-34') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG os_vif [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:94:b4,bridge_name='br-int',has_traffic_filtering=True,id=8b93115d-3416-4846-9c43-a36a66f99e41,network=Network(8c59b78f-940b-409a-a485-2ee269ef8a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b93115d-34') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b93115d-34, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b93115d-34, col_values=(('external_ids', {'iface-id': '8b93115d-3416-4846-9c43-a36a66f99e41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:94:b4', 'vm-uuid': '7caf434b-1484-4832-afee-0e2454bb5089'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:05:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:30 user nova-compute[73188]: INFO os_vif [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:94:b4,bridge_name='br-int',has_traffic_filtering=True,id=8b93115d-3416-4846-9c43-a36a66f99e41,network=Network(8c59b78f-940b-409a-a485-2ee269ef8a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b93115d-34')
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] No VIF found with MAC fa:16:3e:da:94:b4, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126330.5073316, ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:05:30 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] VM Resumed (Lifecycle Event)
Aug 15 19:05:30 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Instance spawned successfully.
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:05:30 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126330.507623, ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:05:30 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] VM Started (Lifecycle Event)
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.compute.manager [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:05:30 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Instance spawned successfully.
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:05:30 user nova-compute[73188]: INFO nova.compute.manager [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Took 15.78 seconds to spawn the instance on the hypervisor.
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:05:30 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126330.7027051, d1b5f5bf-9672-40a8-83da-3a8f25007e91 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:05:30 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] VM Resumed (Lifecycle Event)
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:05:30 user nova-compute[73188]: INFO nova.compute.manager [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Took 16.70 seconds to build instance.
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:05:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8c804d19-bfe5-4949-97e1-b3e918a8b971 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.897s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:30 user nova-compute[73188]: INFO nova.compute.manager [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Took 10.61 seconds to spawn the instance on the hypervisor.
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.compute.manager [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:05:30 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126330.7028654, d1b5f5bf-9672-40a8-83da-3a8f25007e91 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:05:30 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] VM Started (Lifecycle Event)
Aug 15 19:05:30 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:05:31 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:05:31 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:05:31 user nova-compute[73188]: INFO nova.compute.manager [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Took 11.48 seconds to build instance.
Aug 15 19:05:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-819d12ef-2c37-4503-a0bd-a499e4e75491 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.650s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:31 user nova-compute[73188]: DEBUG nova.network.neutron [req-01b8625d-64e7-4ae8-9e13-e77b910d1b60 req-50f089bb-4cb6-4382-830e-cf894a8dd6fc service nova] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Updated VIF entry in instance network info cache for port 8b93115d-3416-4846-9c43-a36a66f99e41. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:05:31 user nova-compute[73188]: DEBUG nova.network.neutron [req-01b8625d-64e7-4ae8-9e13-e77b910d1b60 req-50f089bb-4cb6-4382-830e-cf894a8dd6fc service nova] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Updating instance_info_cache with network_info: [{"id": "8b93115d-3416-4846-9c43-a36a66f99e41", "address": "fa:16:3e:da:94:b4", "network": {"id": "8c59b78f-940b-409a-a485-2ee269ef8a5f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2048234860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f959aaaf0fe4406a723804e59eb47ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b93115d-34", "ovs_interfaceid": "8b93115d-3416-4846-9c43-a36a66f99e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:05:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-01b8625d-64e7-4ae8-9e13-e77b910d1b60 req-50f089bb-4cb6-4382-830e-cf894a8dd6fc service nova] Releasing lock "refresh_cache-7caf434b-1484-4832-afee-0e2454bb5089" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:05:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:05:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:05:34 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126334.2201798, 7caf434b-1484-4832-afee-0e2454bb5089 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:05:34 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] VM Resumed (Lifecycle Event)
Aug 15 19:05:34 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Instance spawned successfully.
Aug 15 19:05:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:05:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:05:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:05:34 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:05:34 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126334.2215343, 7caf434b-1484-4832-afee-0e2454bb5089 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:05:34 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] VM Started (Lifecycle Event)
Aug 15 19:05:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:05:34 user nova-compute[73188]: INFO nova.compute.manager [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Took 10.44 seconds to spawn the instance on the hypervisor.
Aug 15 19:05:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:05:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:05:34 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:05:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:34 user nova-compute[73188]: INFO nova.compute.manager [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Took 11.52 seconds to build instance.
Aug 15 19:05:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3278991d-1bcc-4fb5-8765-b1915c82bad2 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "7caf434b-1484-4832-afee-0e2454bb5089" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.647s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "c3ca002b-c535-4b87-8d39-861ce6847f12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "c3ca002b-c535-4b87-8d39-861ce6847f12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:43 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:05:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:44 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:05:44 user nova-compute[73188]: INFO nova.compute.claims [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Claim successful on node user
Aug 15 19:05:44 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:05:44 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:05:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:44 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:05:44 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:05:44 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:05:44 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:05:44 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:05:44 user nova-compute[73188]: DEBUG nova.policy [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a55d8274ea6d4970921dcbc36d8a00b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4761b15a8dae4f7cab8c13ace5b42ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:05:44 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:05:44 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:05:44 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Creating image(s)
Aug 15 19:05:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "/opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "/opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.283s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.008s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.257s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk 1073741824" returned: 0 in 0.062s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.200s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:45 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:05:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:46 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Cannot resize image /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:05:46 user nova-compute[73188]: DEBUG nova.objects.instance [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lazy-loading 'migration_context' on Instance uuid c3ca002b-c535-4b87-8d39-861ce6847f12 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:05:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:05:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Ensure instance console log exists: /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:05:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.007s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:46 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Successfully created port: 933ca0dd-f8d4-4a81-86e9-83a706d12d82 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:05:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Acquiring lock "dad06110-8c8a-432a-91d5-8d1b840b26ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "dad06110-8c8a-432a-91d5-8d1b840b26ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:47 user nova-compute[73188]: DEBUG nova.compute.manager [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:05:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:47 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:05:47 user nova-compute[73188]: INFO nova.compute.claims [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Claim successful on node user
Aug 15 19:05:47 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Successfully updated port: 933ca0dd-f8d4-4a81-86e9-83a706d12d82 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:05:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "refresh_cache-c3ca002b-c535-4b87-8d39-861ce6847f12" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:05:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquired lock "refresh_cache-c3ca002b-c535-4b87-8d39-861ce6847f12" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:05:47 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:05:47 user nova-compute[73188]: DEBUG nova.compute.manager [req-a0dd9f21-21ca-4249-b215-2cb8b632952f req-ea9f25a0-3a06-45a2-b97a-1bc977f4a27a service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Received event network-changed-933ca0dd-f8d4-4a81-86e9-83a706d12d82 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:05:47 user nova-compute[73188]: DEBUG nova.compute.manager [req-a0dd9f21-21ca-4249-b215-2cb8b632952f req-ea9f25a0-3a06-45a2-b97a-1bc977f4a27a service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Refreshing instance network info cache due to event network-changed-933ca0dd-f8d4-4a81-86e9-83a706d12d82. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:05:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a0dd9f21-21ca-4249-b215-2cb8b632952f req-ea9f25a0-3a06-45a2-b97a-1bc977f4a27a service nova] Acquiring lock "refresh_cache-c3ca002b-c535-4b87-8d39-861ce6847f12" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:05:47 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.compute.manager [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.compute.manager [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.network.neutron [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:05:48 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.compute.manager [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Updating instance_info_cache with network_info: [{"id": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "address": "fa:16:3e:ce:f4:29", "network": {"id": "574343fe-52ff-4be4-9622-e61a33db8396", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-946260414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4761b15a8dae4f7cab8c13ace5b42ddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933ca0dd-f8", "ovs_interfaceid": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.compute.manager [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:05:48 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Creating image(s)
Aug 15 19:05:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Acquiring lock "/opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "/opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "/opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Acquiring lock "eb94ba01989f4cf27d87de7eb460222cff939dad" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "eb94ba01989f4cf27d87de7eb460222cff939dad" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Releasing lock "refresh_cache-c3ca002b-c535-4b87-8d39-861ce6847f12" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Instance network_info: |[{"id": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "address": "fa:16:3e:ce:f4:29", "network": {"id": "574343fe-52ff-4be4-9622-e61a33db8396", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-946260414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4761b15a8dae4f7cab8c13ace5b42ddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933ca0dd-f8", "ovs_interfaceid": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a0dd9f21-21ca-4249-b215-2cb8b632952f req-ea9f25a0-3a06-45a2-b97a-1bc977f4a27a service nova] Acquired lock "refresh_cache-c3ca002b-c535-4b87-8d39-861ce6847f12" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.network.neutron [req-a0dd9f21-21ca-4249-b215-2cb8b632952f req-ea9f25a0-3a06-45a2-b97a-1bc977f4a27a service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Refreshing network info cache for port 933ca0dd-f8d4-4a81-86e9-83a706d12d82 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Start _get_guest_xml network_info=[{"id": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "address": "fa:16:3e:ce:f4:29", "network": {"id": "574343fe-52ff-4be4-9622-e61a33db8396", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-946260414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4761b15a8dae4f7cab8c13ace5b42ddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933ca0dd-f8", "ovs_interfaceid": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:05:48 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:05:48 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2111588244',display_name='tempest-VolumesAdminNegativeTest-server-2111588244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2111588244',id=4,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhzEVgAZIyoFgQVeNPqSye3z6nlv/4/Stz29Mf3stl/ITeA48p+P9NnJNjCNBtWEqboNXma6QWyzwPbEWe3Cw9UBu7Pdv3uSvBIpGVrOwhcjYg0TsqlRs1Ya8hdoqwTsg==',key_name='tempest-keypair-766805598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4761b15a8dae4f7cab8c13ace5b42ddd',ramdisk_id='',reservation_id='r-i1qctxbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1347354909',owner_user_name='tempest-VolumesAdminNegativeTest-1347354909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:05:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a55d8274ea6d4970921dcbc36d8a00b3',uuid=c3ca002b-c535-4b87-8d39-861ce6847f12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "address": "fa:16:3e:ce:f4:29", "network": {"id": "574343fe-52ff-4be4-9622-e61a33db8396", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-946260414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4761b15a8dae4f7cab8c13ace5b42ddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933ca0dd-f8", "ovs_interfaceid": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Converting VIF {"id": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "address": "fa:16:3e:ce:f4:29", "network": {"id": "574343fe-52ff-4be4-9622-e61a33db8396", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-946260414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4761b15a8dae4f7cab8c13ace5b42ddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933ca0dd-f8", "ovs_interfaceid": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f4:29,bridge_name='br-int',has_traffic_filtering=True,id=933ca0dd-f8d4-4a81-86e9-83a706d12d82,network=Network(574343fe-52ff-4be4-9622-e61a33db8396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap933ca0dd-f8') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:05:48 user nova-compute[73188]: DEBUG nova.objects.instance [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lazy-loading 'pci_devices' on Instance uuid c3ca002b-c535-4b87-8d39-861ce6847f12 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb94ba01989f4cf27d87de7eb460222cff939dad.part --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG nova.policy [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4362375f83984fd3a4c7ae8cc9838e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d2d81cf9f0431a9f929d80feee45ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:05:49 user nova-compute[73188]:   <uuid>c3ca002b-c535-4b87-8d39-861ce6847f12</uuid>
Aug 15 19:05:49 user nova-compute[73188]:   <name>instance-00000004</name>
Aug 15 19:05:49 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:05:49 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:05:49 user nova-compute[73188]:   <metadata>
Aug 15 19:05:49 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:05:49 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:05:49 user nova-compute[73188]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2111588244</nova:name>
Aug 15 19:05:49 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:05:48</nova:creationTime>
Aug 15 19:05:49 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:05:49 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:05:49 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:05:49 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:05:49 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:05:49 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:05:49 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:05:49 user nova-compute[73188]:       <nova:owner>
Aug 15 19:05:49 user nova-compute[73188]:         <nova:user uuid="a55d8274ea6d4970921dcbc36d8a00b3">tempest-VolumesAdminNegativeTest-1347354909-project-member</nova:user>
Aug 15 19:05:49 user nova-compute[73188]:         <nova:project uuid="4761b15a8dae4f7cab8c13ace5b42ddd">tempest-VolumesAdminNegativeTest-1347354909</nova:project>
Aug 15 19:05:49 user nova-compute[73188]:       </nova:owner>
Aug 15 19:05:49 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:05:49 user nova-compute[73188]:       <nova:ports>
Aug 15 19:05:49 user nova-compute[73188]:         <nova:port uuid="933ca0dd-f8d4-4a81-86e9-83a706d12d82">
Aug 15 19:05:49 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 19:05:49 user nova-compute[73188]:         </nova:port>
Aug 15 19:05:49 user nova-compute[73188]:       </nova:ports>
Aug 15 19:05:49 user nova-compute[73188]:     </nova:instance>
Aug 15 19:05:49 user nova-compute[73188]:   </metadata>
Aug 15 19:05:49 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:05:49 user nova-compute[73188]:     <system>
Aug 15 19:05:49 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:05:49 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:05:49 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:05:49 user nova-compute[73188]:       <entry name="serial">c3ca002b-c535-4b87-8d39-861ce6847f12</entry>
Aug 15 19:05:49 user nova-compute[73188]:       <entry name="uuid">c3ca002b-c535-4b87-8d39-861ce6847f12</entry>
Aug 15 19:05:49 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:05:49 user nova-compute[73188]:     </system>
Aug 15 19:05:49 user nova-compute[73188]:   </sysinfo>
Aug 15 19:05:49 user nova-compute[73188]:   <os>
Aug 15 19:05:49 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:05:49 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:05:49 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:05:49 user nova-compute[73188]:   </os>
Aug 15 19:05:49 user nova-compute[73188]:   <features>
Aug 15 19:05:49 user nova-compute[73188]:     <acpi/>
Aug 15 19:05:49 user nova-compute[73188]:     <apic/>
Aug 15 19:05:49 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:05:49 user nova-compute[73188]:   </features>
Aug 15 19:05:49 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:05:49 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:05:49 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:05:49 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:05:49 user nova-compute[73188]:   </clock>
Aug 15 19:05:49 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:05:49 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:05:49 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:05:49 user nova-compute[73188]:   </cpu>
Aug 15 19:05:49 user nova-compute[73188]:   <devices>
Aug 15 19:05:49 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:05:49 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:05:49 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk"/>
Aug 15 19:05:49 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:05:49 user nova-compute[73188]:     </disk>
Aug 15 19:05:49 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:05:49 user nova-compute[73188]:       <mac address="fa:16:3e:ce:f4:29"/>
Aug 15 19:05:49 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:05:49 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:05:49 user nova-compute[73188]:       <target dev="tap933ca0dd-f8"/>
Aug 15 19:05:49 user nova-compute[73188]:     </interface>
Aug 15 19:05:49 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:05:49 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/console.log" append="off"/>
Aug 15 19:05:49 user nova-compute[73188]:     </serial>
Aug 15 19:05:49 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:05:49 user nova-compute[73188]:     <video>
Aug 15 19:05:49 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:05:49 user nova-compute[73188]:     </video>
Aug 15 19:05:49 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:05:49 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:05:49 user nova-compute[73188]:     </rng>
Aug 15 19:05:49 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:05:49 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:05:49 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:05:49 user nova-compute[73188]:     </memballoon>
Aug 15 19:05:49 user nova-compute[73188]:   </devices>
Aug 15 19:05:49 user nova-compute[73188]: </domain>
Aug 15 19:05:49 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2111588244',display_name='tempest-VolumesAdminNegativeTest-server-2111588244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2111588244',id=4,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhzEVgAZIyoFgQVeNPqSye3z6nlv/4/Stz29Mf3stl/ITeA48p+P9NnJNjCNBtWEqboNXma6QWyzwPbEWe3Cw9UBu7Pdv3uSvBIpGVrOwhcjYg0TsqlRs1Ya8hdoqwTsg==',key_name='tempest-keypair-766805598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4761b15a8dae4f7cab8c13ace5b42ddd',ramdisk_id='',reservation_id='r-i1qctxbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1347354909',owner_user_name='tempest-VolumesAdminNegativeTest-1347354909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:05:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a55d8274ea6d4970921dcbc36d8a00b3',uuid=c3ca002b-c535-4b87-8d39-861ce6847f12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "address": "fa:16:3e:ce:f4:29", "network": {"id": "574343fe-52ff-4be4-9622-e61a33db8396", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-946260414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4761b15a8dae4f7cab8c13ace5b42ddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933ca0dd-f8", "ovs_interfaceid": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Converting VIF {"id": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "address": "fa:16:3e:ce:f4:29", "network": {"id": "574343fe-52ff-4be4-9622-e61a33db8396", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-946260414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4761b15a8dae4f7cab8c13ace5b42ddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933ca0dd-f8", "ovs_interfaceid": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f4:29,bridge_name='br-int',has_traffic_filtering=True,id=933ca0dd-f8d4-4a81-86e9-83a706d12d82,network=Network(574343fe-52ff-4be4-9622-e61a33db8396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap933ca0dd-f8') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG os_vif [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f4:29,bridge_name='br-int',has_traffic_filtering=True,id=933ca0dd-f8d4-4a81-86e9-83a706d12d82,network=Network(574343fe-52ff-4be4-9622-e61a33db8396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap933ca0dd-f8') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap933ca0dd-f8, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap933ca0dd-f8, col_values=(('external_ids', {'iface-id': '933ca0dd-f8d4-4a81-86e9-83a706d12d82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:f4:29', 'vm-uuid': 'c3ca002b-c535-4b87-8d39-861ce6847f12'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:49 user nova-compute[73188]: INFO os_vif [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f4:29,bridge_name='br-int',has_traffic_filtering=True,id=933ca0dd-f8d4-4a81-86e9-83a706d12d82,network=Network(574343fe-52ff-4be4-9622-e61a33db8396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap933ca0dd-f8')
Aug 15 19:05:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] No VIF found with MAC fa:16:3e:ce:f4:29, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb94ba01989f4cf27d87de7eb460222cff939dad.part --force-share --output=json" returned: 0 in 0.212s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG nova.virt.images [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] ddb81697-ef4c-4757-b9f2-8c7a21ff9064 was qcow2, converting to raw {{(pid=73188) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG nova.privsep.utils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73188) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eb94ba01989f4cf27d87de7eb460222cff939dad.part /opt/stack/data/nova/instances/_base/eb94ba01989f4cf27d87de7eb460222cff939dad.converted {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eb94ba01989f4cf27d87de7eb460222cff939dad.part /opt/stack/data/nova/instances/_base/eb94ba01989f4cf27d87de7eb460222cff939dad.converted" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb94ba01989f4cf27d87de7eb460222cff939dad.converted --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb94ba01989f4cf27d87de7eb460222cff939dad.converted --force-share --output=json" returned: 0 in 0.286s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "eb94ba01989f4cf27d87de7eb460222cff939dad" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.437s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:49 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb94ba01989f4cf27d87de7eb460222cff939dad --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb94ba01989f4cf27d87de7eb460222cff939dad --force-share --output=json" returned: 0 in 0.196s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Acquiring lock "eb94ba01989f4cf27d87de7eb460222cff939dad" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "eb94ba01989f4cf27d87de7eb460222cff939dad" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb94ba01989f4cf27d87de7eb460222cff939dad --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb94ba01989f4cf27d87de7eb460222cff939dad --force-share --output=json" returned: 0 in 0.213s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb94ba01989f4cf27d87de7eb460222cff939dad,backing_fmt=raw /opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb94ba01989f4cf27d87de7eb460222cff939dad,backing_fmt=raw /opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/disk 1073741824" returned: 0 in 0.050s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "eb94ba01989f4cf27d87de7eb460222cff939dad" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb94ba01989f4cf27d87de7eb460222cff939dad --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Acquiring lock "e8b88f49-7f48-4170-af8a-aa1de706f218" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Lock "e8b88f49-7f48-4170-af8a-aa1de706f218" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG nova.network.neutron [req-a0dd9f21-21ca-4249-b215-2cb8b632952f req-ea9f25a0-3a06-45a2-b97a-1bc977f4a27a service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Updated VIF entry in instance network info cache for port 933ca0dd-f8d4-4a81-86e9-83a706d12d82. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG nova.network.neutron [req-a0dd9f21-21ca-4249-b215-2cb8b632952f req-ea9f25a0-3a06-45a2-b97a-1bc977f4a27a service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Updating instance_info_cache with network_info: [{"id": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "address": "fa:16:3e:ce:f4:29", "network": {"id": "574343fe-52ff-4be4-9622-e61a33db8396", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-946260414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4761b15a8dae4f7cab8c13ace5b42ddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933ca0dd-f8", "ovs_interfaceid": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb94ba01989f4cf27d87de7eb460222cff939dad --force-share --output=json" returned: 0 in 0.174s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a0dd9f21-21ca-4249-b215-2cb8b632952f req-ea9f25a0-3a06-45a2-b97a-1bc977f4a27a service nova] Releasing lock "refresh_cache-c3ca002b-c535-4b87-8d39-861ce6847f12" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:05:50 user nova-compute[73188]: INFO nova.compute.claims [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Claim successful on node user
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Cannot resize image /opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG nova.objects.instance [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lazy-loading 'migration_context' on Instance uuid dad06110-8c8a-432a-91d5-8d1b840b26ca {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Ensure instance console log exists: /opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG nova.network.neutron [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Successfully created port: 5d901c10-1493-4a6b-b706-cc3979a6b29e {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-8bc9a33e-b992-455e-9c99-76d710cf0e42 req-9b79d107-7007-4016-a2c1-34d1bb058ad5 service nova] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Received event network-vif-plugged-85966f51-bc7f-46ed-8065-ecec627cfeb7 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8bc9a33e-b992-455e-9c99-76d710cf0e42 req-9b79d107-7007-4016-a2c1-34d1bb058ad5 service nova] Acquiring lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8bc9a33e-b992-455e-9c99-76d710cf0e42 req-9b79d107-7007-4016-a2c1-34d1bb058ad5 service nova] Lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8bc9a33e-b992-455e-9c99-76d710cf0e42 req-9b79d107-7007-4016-a2c1-34d1bb058ad5 service nova] Lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-8bc9a33e-b992-455e-9c99-76d710cf0e42 req-9b79d107-7007-4016-a2c1-34d1bb058ad5 service nova] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] No waiting events found dispatching network-vif-plugged-85966f51-bc7f-46ed-8065-ecec627cfeb7 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:05:50 user nova-compute[73188]: WARNING nova.compute.manager [req-8bc9a33e-b992-455e-9c99-76d710cf0e42 req-9b79d107-7007-4016-a2c1-34d1bb058ad5 service nova] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Received unexpected event network-vif-plugged-85966f51-bc7f-46ed-8065-ecec627cfeb7 for instance with vm_state active and task_state None.
Aug 15 19:05:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:51 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:05:51 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:05:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:05:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:05:51 user nova-compute[73188]: DEBUG nova.network.neutron [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:05:51 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:05:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:05:51 user nova-compute[73188]: DEBUG nova.policy [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19800e8916e542239bf9b015d2df8de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b49dcc697ced4397bc0760dc41be30cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:05:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:05:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:05:51 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Creating image(s)
Aug 15 19:05:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Acquiring lock "/opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Lock "/opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Lock "/opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.205s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.177s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/disk 1073741824" returned: 0 in 0.049s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.network.neutron [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Successfully updated port: 5d901c10-1493-4a6b-b706-cc3979a6b29e {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Acquiring lock "refresh_cache-dad06110-8c8a-432a-91d5-8d1b840b26ca" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Acquired lock "refresh_cache-dad06110-8c8a-432a-91d5-8d1b840b26ca" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.network.neutron [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-17fa386b-0316-48f4-86ad-c0522b4e490a req-b905d0ed-0093-4e24-8342-701ee2bffd63 service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Received event network-changed-5d901c10-1493-4a6b-b706-cc3979a6b29e {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-17fa386b-0316-48f4-86ad-c0522b4e490a req-b905d0ed-0093-4e24-8342-701ee2bffd63 service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Refreshing instance network info cache due to event network-changed-5d901c10-1493-4a6b-b706-cc3979a6b29e. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-17fa386b-0316-48f4-86ad-c0522b4e490a req-b905d0ed-0093-4e24-8342-701ee2bffd63 service nova] Acquiring lock "refresh_cache-dad06110-8c8a-432a-91d5-8d1b840b26ca" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.network.neutron [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.185s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Cannot resize image /opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.objects.instance [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Lazy-loading 'migration_context' on Instance uuid e8b88f49-7f48-4170-af8a-aa1de706f218 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Ensure instance console log exists: /opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.network.neutron [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Successfully created port: a9ef2f68-c2c1-464b-8942-572fe28ceba3 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.network.neutron [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Updating instance_info_cache with network_info: [{"id": "5d901c10-1493-4a6b-b706-cc3979a6b29e", "address": "fa:16:3e:7d:af:10", "network": {"id": "a465fffd-f8da-440a-8bdc-3c1da367bbc6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-832639605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31d2d81cf9f0431a9f929d80feee45ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d901c10-14", "ovs_interfaceid": "5d901c10-1493-4a6b-b706-cc3979a6b29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Releasing lock "refresh_cache-dad06110-8c8a-432a-91d5-8d1b840b26ca" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.compute.manager [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Instance network_info: |[{"id": "5d901c10-1493-4a6b-b706-cc3979a6b29e", "address": "fa:16:3e:7d:af:10", "network": {"id": "a465fffd-f8da-440a-8bdc-3c1da367bbc6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-832639605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31d2d81cf9f0431a9f929d80feee45ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d901c10-14", "ovs_interfaceid": "5d901c10-1493-4a6b-b706-cc3979a6b29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-17fa386b-0316-48f4-86ad-c0522b4e490a req-b905d0ed-0093-4e24-8342-701ee2bffd63 service nova] Acquired lock "refresh_cache-dad06110-8c8a-432a-91d5-8d1b840b26ca" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.network.neutron [req-17fa386b-0316-48f4-86ad-c0522b4e490a req-b905d0ed-0093-4e24-8342-701ee2bffd63 service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Refreshing network info cache for port 5d901c10-1493-4a6b-b706-cc3979a6b29e {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Start _get_guest_xml network_info=[{"id": "5d901c10-1493-4a6b-b706-cc3979a6b29e", "address": "fa:16:3e:7d:af:10", "network": {"id": "a465fffd-f8da-440a-8bdc-3c1da367bbc6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-832639605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31d2d81cf9f0431a9f929d80feee45ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d901c10-14", "ovs_interfaceid": "5d901c10-1493-4a6b-b706-cc3979a6b29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:05:37Z,direct_url=<?>,disk_format='qcow2',id=ddb81697-ef4c-4757-b9f2-8c7a21ff9064,min_disk=0,min_ram=0,name='',owner='78e87c7f6866431db9d458ca3540bacf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:05:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'ddb81697-ef4c-4757-b9f2-8c7a21ff9064'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:05:52 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:05:52 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:05:37Z,direct_url=<?>,disk_format='qcow2',id=ddb81697-ef4c-4757-b9f2-8c7a21ff9064,min_disk=0,min_ram=0,name='',owner='78e87c7f6866431db9d458ca3540bacf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:05:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:05:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-978768863',display_name='tempest-AttachSCSIVolumeTestJSON-server-978768863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-978768863',id=5,image_ref='ddb81697-ef4c-4757-b9f2-8c7a21ff9064',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMY95N3HgkKsO4svG6TxJbMXhyqp0JG8gXxU1cP0SD4yRgf7XjInyOsB+orVzpaJKTZruwrWLk6FiWYq91pqrG6tArKVYnhxVXEwYPkS4xZzercIKvZFexjeiMv2n82vQ==',key_name='tempest-keypair-830489440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31d2d81cf9f0431a9f929d80feee45ec',ramdisk_id='',reservation_id='r-oomwxo41',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb81697-ef4c-4757-b9f2-8c7a21ff9064',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1469956616',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1469956616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:05:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4362375f83984fd3a4c7ae8cc9838e59',uuid=dad06110-8c8a-432a-91d5-8d1b840b26ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d901c10-1493-4a6b-b706-cc3979a6b29e", "address": "fa:16:3e:7d:af:10", "network": {"id": "a465fffd-f8da-440a-8bdc-3c1da367bbc6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-832639605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31d2d81cf9f0431a9f929d80feee45ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d901c10-14", "ovs_interfaceid": "5d901c10-1493-4a6b-b706-cc3979a6b29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Converting VIF {"id": "5d901c10-1493-4a6b-b706-cc3979a6b29e", "address": "fa:16:3e:7d:af:10", "network": {"id": "a465fffd-f8da-440a-8bdc-3c1da367bbc6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-832639605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31d2d81cf9f0431a9f929d80feee45ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d901c10-14", "ovs_interfaceid": "5d901c10-1493-4a6b-b706-cc3979a6b29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:af:10,bridge_name='br-int',has_traffic_filtering=True,id=5d901c10-1493-4a6b-b706-cc3979a6b29e,network=Network(a465fffd-f8da-440a-8bdc-3c1da367bbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d901c10-14') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.objects.instance [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lazy-loading 'pci_devices' on Instance uuid dad06110-8c8a-432a-91d5-8d1b840b26ca {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:05:52 user nova-compute[73188]:   <uuid>dad06110-8c8a-432a-91d5-8d1b840b26ca</uuid>
Aug 15 19:05:52 user nova-compute[73188]:   <name>instance-00000005</name>
Aug 15 19:05:52 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:05:52 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:05:52 user nova-compute[73188]:   <metadata>
Aug 15 19:05:52 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:05:52 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:05:52 user nova-compute[73188]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-978768863</nova:name>
Aug 15 19:05:52 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:05:52</nova:creationTime>
Aug 15 19:05:52 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:05:52 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:05:52 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:05:52 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:05:52 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:05:52 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:05:52 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:05:52 user nova-compute[73188]:       <nova:owner>
Aug 15 19:05:52 user nova-compute[73188]:         <nova:user uuid="4362375f83984fd3a4c7ae8cc9838e59">tempest-AttachSCSIVolumeTestJSON-1469956616-project-member</nova:user>
Aug 15 19:05:52 user nova-compute[73188]:         <nova:project uuid="31d2d81cf9f0431a9f929d80feee45ec">tempest-AttachSCSIVolumeTestJSON-1469956616</nova:project>
Aug 15 19:05:52 user nova-compute[73188]:       </nova:owner>
Aug 15 19:05:52 user nova-compute[73188]:       <nova:root type="image" uuid="ddb81697-ef4c-4757-b9f2-8c7a21ff9064"/>
Aug 15 19:05:52 user nova-compute[73188]:       <nova:ports>
Aug 15 19:05:52 user nova-compute[73188]:         <nova:port uuid="5d901c10-1493-4a6b-b706-cc3979a6b29e">
Aug 15 19:05:52 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 19:05:52 user nova-compute[73188]:         </nova:port>
Aug 15 19:05:52 user nova-compute[73188]:       </nova:ports>
Aug 15 19:05:52 user nova-compute[73188]:     </nova:instance>
Aug 15 19:05:52 user nova-compute[73188]:   </metadata>
Aug 15 19:05:52 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:05:52 user nova-compute[73188]:     <system>
Aug 15 19:05:52 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:05:52 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:05:52 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:05:52 user nova-compute[73188]:       <entry name="serial">dad06110-8c8a-432a-91d5-8d1b840b26ca</entry>
Aug 15 19:05:52 user nova-compute[73188]:       <entry name="uuid">dad06110-8c8a-432a-91d5-8d1b840b26ca</entry>
Aug 15 19:05:52 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:05:52 user nova-compute[73188]:     </system>
Aug 15 19:05:52 user nova-compute[73188]:   </sysinfo>
Aug 15 19:05:52 user nova-compute[73188]:   <os>
Aug 15 19:05:52 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:05:52 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:05:52 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:05:52 user nova-compute[73188]:   </os>
Aug 15 19:05:52 user nova-compute[73188]:   <features>
Aug 15 19:05:52 user nova-compute[73188]:     <acpi/>
Aug 15 19:05:52 user nova-compute[73188]:     <apic/>
Aug 15 19:05:52 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:05:52 user nova-compute[73188]:   </features>
Aug 15 19:05:52 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:05:52 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:05:52 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:05:52 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:05:52 user nova-compute[73188]:   </clock>
Aug 15 19:05:52 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:05:52 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:05:52 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:05:52 user nova-compute[73188]:   </cpu>
Aug 15 19:05:52 user nova-compute[73188]:   <devices>
Aug 15 19:05:52 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:05:52 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:05:52 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/disk"/>
Aug 15 19:05:52 user nova-compute[73188]:       <target dev="sda" bus="scsi"/>
Aug 15 19:05:52 user nova-compute[73188]:       <address type="drive" controller="0" unit="0"/>
Aug 15 19:05:52 user nova-compute[73188]:     </disk>
Aug 15 19:05:52 user nova-compute[73188]:     <disk type="file" device="cdrom">
Aug 15 19:05:52 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 19:05:52 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/disk.config"/>
Aug 15 19:05:52 user nova-compute[73188]:       <target dev="sdb" bus="scsi"/>
Aug 15 19:05:52 user nova-compute[73188]:       <address type="drive" controller="0" unit="1"/>
Aug 15 19:05:52 user nova-compute[73188]:     </disk>
Aug 15 19:05:52 user nova-compute[73188]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 15 19:05:52 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:05:52 user nova-compute[73188]:       <mac address="fa:16:3e:7d:af:10"/>
Aug 15 19:05:52 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:05:52 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:05:52 user nova-compute[73188]:       <target dev="tap5d901c10-14"/>
Aug 15 19:05:52 user nova-compute[73188]:     </interface>
Aug 15 19:05:52 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:05:52 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/console.log" append="off"/>
Aug 15 19:05:52 user nova-compute[73188]:     </serial>
Aug 15 19:05:52 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:05:52 user nova-compute[73188]:     <video>
Aug 15 19:05:52 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:05:52 user nova-compute[73188]:     </video>
Aug 15 19:05:52 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:05:52 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:05:52 user nova-compute[73188]:     </rng>
Aug 15 19:05:52 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:05:52 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:05:52 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:05:52 user nova-compute[73188]:     </memballoon>
Aug 15 19:05:52 user nova-compute[73188]:   </devices>
Aug 15 19:05:52 user nova-compute[73188]: </domain>
Aug 15 19:05:52 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:05:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-978768863',display_name='tempest-AttachSCSIVolumeTestJSON-server-978768863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-978768863',id=5,image_ref='ddb81697-ef4c-4757-b9f2-8c7a21ff9064',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMY95N3HgkKsO4svG6TxJbMXhyqp0JG8gXxU1cP0SD4yRgf7XjInyOsB+orVzpaJKTZruwrWLk6FiWYq91pqrG6tArKVYnhxVXEwYPkS4xZzercIKvZFexjeiMv2n82vQ==',key_name='tempest-keypair-830489440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31d2d81cf9f0431a9f929d80feee45ec',ramdisk_id='',reservation_id='r-oomwxo41',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb81697-ef4c-4757-b9f2-8c7a21ff9064',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1469956616',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1469956616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:05:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4362375f83984fd3a4c7ae8cc9838e59',uuid=dad06110-8c8a-432a-91d5-8d1b840b26ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d901c10-1493-4a6b-b706-cc3979a6b29e", "address": "fa:16:3e:7d:af:10", "network": {"id": "a465fffd-f8da-440a-8bdc-3c1da367bbc6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-832639605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31d2d81cf9f0431a9f929d80feee45ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d901c10-14", "ovs_interfaceid": "5d901c10-1493-4a6b-b706-cc3979a6b29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Converting VIF {"id": "5d901c10-1493-4a6b-b706-cc3979a6b29e", "address": "fa:16:3e:7d:af:10", "network": {"id": "a465fffd-f8da-440a-8bdc-3c1da367bbc6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-832639605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31d2d81cf9f0431a9f929d80feee45ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d901c10-14", "ovs_interfaceid": "5d901c10-1493-4a6b-b706-cc3979a6b29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:af:10,bridge_name='br-int',has_traffic_filtering=True,id=5d901c10-1493-4a6b-b706-cc3979a6b29e,network=Network(a465fffd-f8da-440a-8bdc-3c1da367bbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d901c10-14') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG os_vif [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:af:10,bridge_name='br-int',has_traffic_filtering=True,id=5d901c10-1493-4a6b-b706-cc3979a6b29e,network=Network(a465fffd-f8da-440a-8bdc-3c1da367bbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d901c10-14') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d901c10-14, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5d901c10-14, col_values=(('external_ids', {'iface-id': '5d901c10-1493-4a6b-b706-cc3979a6b29e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:af:10', 'vm-uuid': 'dad06110-8c8a-432a-91d5-8d1b840b26ca'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:52 user nova-compute[73188]: INFO os_vif [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:af:10,bridge_name='br-int',has_traffic_filtering=True,id=5d901c10-1493-4a6b-b706-cc3979a6b29e,network=Network(a465fffd-f8da-440a-8bdc-3c1da367bbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d901c10-14')
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] No BDM found with device name sda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] No VIF found with MAC fa:16:3e:7d:af:10, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:05:52 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Using config drive
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-b1c1f063-3251-4b38-9308-e178667ef0de req-06513340-2ed0-40d0-992e-a3d153b4afd2 service nova] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Received event network-vif-plugged-85966f51-bc7f-46ed-8065-ecec627cfeb7 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b1c1f063-3251-4b38-9308-e178667ef0de req-06513340-2ed0-40d0-992e-a3d153b4afd2 service nova] Acquiring lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b1c1f063-3251-4b38-9308-e178667ef0de req-06513340-2ed0-40d0-992e-a3d153b4afd2 service nova] Lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b1c1f063-3251-4b38-9308-e178667ef0de req-06513340-2ed0-40d0-992e-a3d153b4afd2 service nova] Lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-b1c1f063-3251-4b38-9308-e178667ef0de req-06513340-2ed0-40d0-992e-a3d153b4afd2 service nova] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] No waiting events found dispatching network-vif-plugged-85966f51-bc7f-46ed-8065-ecec627cfeb7 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:05:52 user nova-compute[73188]: WARNING nova.compute.manager [req-b1c1f063-3251-4b38-9308-e178667ef0de req-06513340-2ed0-40d0-992e-a3d153b4afd2 service nova] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Received unexpected event network-vif-plugged-85966f51-bc7f-46ed-8065-ecec627cfeb7 for instance with vm_state active and task_state None.
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-b1c1f063-3251-4b38-9308-e178667ef0de req-06513340-2ed0-40d0-992e-a3d153b4afd2 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received event network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b1c1f063-3251-4b38-9308-e178667ef0de req-06513340-2ed0-40d0-992e-a3d153b4afd2 service nova] Acquiring lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b1c1f063-3251-4b38-9308-e178667ef0de req-06513340-2ed0-40d0-992e-a3d153b4afd2 service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b1c1f063-3251-4b38-9308-e178667ef0de req-06513340-2ed0-40d0-992e-a3d153b4afd2 service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-b1c1f063-3251-4b38-9308-e178667ef0de req-06513340-2ed0-40d0-992e-a3d153b4afd2 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] No waiting events found dispatching network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:05:52 user nova-compute[73188]: WARNING nova.compute.manager [req-b1c1f063-3251-4b38-9308-e178667ef0de req-06513340-2ed0-40d0-992e-a3d153b4afd2 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received unexpected event network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a for instance with vm_state active and task_state None.
Aug 15 19:05:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-b1c1f063-3251-4b38-9308-e178667ef0de req-06513340-2ed0-40d0-992e-a3d153b4afd2 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received event network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b1c1f063-3251-4b38-9308-e178667ef0de req-06513340-2ed0-40d0-992e-a3d153b4afd2 service nova] Acquiring lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b1c1f063-3251-4b38-9308-e178667ef0de req-06513340-2ed0-40d0-992e-a3d153b4afd2 service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b1c1f063-3251-4b38-9308-e178667ef0de req-06513340-2ed0-40d0-992e-a3d153b4afd2 service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.compute.manager [req-b1c1f063-3251-4b38-9308-e178667ef0de req-06513340-2ed0-40d0-992e-a3d153b4afd2 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] No waiting events found dispatching network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:05:53 user nova-compute[73188]: WARNING nova.compute.manager [req-b1c1f063-3251-4b38-9308-e178667ef0de req-06513340-2ed0-40d0-992e-a3d153b4afd2 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received unexpected event network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a for instance with vm_state active and task_state None.
Aug 15 19:05:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Acquiring lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.compute.manager [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:05:53 user nova-compute[73188]: INFO nova.compute.claims [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Claim successful on node user
Aug 15 19:05:53 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Creating config drive at /opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/disk.config
Aug 15 19:05:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe6t4vq22 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe6t4vq22" returned: 0 in 0.075s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126353.404717, c3ca002b-c535-4b87-8d39-861ce6847f12 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:05:53 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] VM Resumed (Lifecycle Event)
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:05:53 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Instance spawned successfully.
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:53 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126353.4050298, c3ca002b-c535-4b87-8d39-861ce6847f12 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:05:53 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] VM Started (Lifecycle Event)
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.network.neutron [req-17fa386b-0316-48f4-86ad-c0522b4e490a req-b905d0ed-0093-4e24-8342-701ee2bffd63 service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Updated VIF entry in instance network info cache for port 5d901c10-1493-4a6b-b706-cc3979a6b29e. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.network.neutron [req-17fa386b-0316-48f4-86ad-c0522b4e490a req-b905d0ed-0093-4e24-8342-701ee2bffd63 service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Updating instance_info_cache with network_info: [{"id": "5d901c10-1493-4a6b-b706-cc3979a6b29e", "address": "fa:16:3e:7d:af:10", "network": {"id": "a465fffd-f8da-440a-8bdc-3c1da367bbc6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-832639605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31d2d81cf9f0431a9f929d80feee45ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d901c10-14", "ovs_interfaceid": "5d901c10-1493-4a6b-b706-cc3979a6b29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:05:53 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:05:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-17fa386b-0316-48f4-86ad-c0522b4e490a req-b905d0ed-0093-4e24-8342-701ee2bffd63 service nova] Releasing lock "refresh_cache-dad06110-8c8a-432a-91d5-8d1b840b26ca" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:05:53 user nova-compute[73188]: INFO nova.compute.manager [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Took 8.73 seconds to spawn the instance on the hypervisor.
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.network.neutron [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Successfully updated port: a9ef2f68-c2c1-464b-8942-572fe28ceba3 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.742s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.compute.manager [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Acquiring lock "refresh_cache-e8b88f49-7f48-4170-af8a-aa1de706f218" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Acquired lock "refresh_cache-e8b88f49-7f48-4170-af8a-aa1de706f218" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:05:53 user nova-compute[73188]: DEBUG nova.network.neutron [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:05:54 user nova-compute[73188]: INFO nova.compute.manager [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Took 10.03 seconds to build instance.
Aug 15 19:05:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8423a2c7-5b44-47d1-a3d0-78746f822c97 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "c3ca002b-c535-4b87-8d39-861ce6847f12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.158s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG nova.network.neutron [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG nova.compute.manager [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG nova.network.neutron [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:05:54 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:05:54 user nova-compute[73188]: DEBUG nova.compute.manager [req-ab31e545-d628-4ce3-b3f1-c06d619d8faf req-b4671501-5202-4697-9170-c2a8a80c622b service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Received event network-changed-a9ef2f68-c2c1-464b-8942-572fe28ceba3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG nova.compute.manager [req-ab31e545-d628-4ce3-b3f1-c06d619d8faf req-b4671501-5202-4697-9170-c2a8a80c622b service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Refreshing instance network info cache due to event network-changed-a9ef2f68-c2c1-464b-8942-572fe28ceba3. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ab31e545-d628-4ce3-b3f1-c06d619d8faf req-b4671501-5202-4697-9170-c2a8a80c622b service nova] Acquiring lock "refresh_cache-e8b88f49-7f48-4170-af8a-aa1de706f218" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG nova.compute.manager [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG nova.policy [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '42c99d8a73ce4d2c9a6c98ebcec844bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6846c6807243379e6b5de3868c2fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG nova.compute.manager [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:05:54 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Creating image(s)
Aug 15 19:05:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Acquiring lock "/opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "/opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "/opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.244s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG nova.network.neutron [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Updating instance_info_cache with network_info: [{"id": "a9ef2f68-c2c1-464b-8942-572fe28ceba3", "address": "fa:16:3e:10:15:fd", "network": {"id": "e6808e77-8eb3-4298-a05b-dd25f9f39bb0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-711659466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b49dcc697ced4397bc0760dc41be30cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ef2f68-c2", "ovs_interfaceid": "a9ef2f68-c2c1-464b-8942-572fe28ceba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.260s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Releasing lock "refresh_cache-e8b88f49-7f48-4170-af8a-aa1de706f218" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Instance network_info: |[{"id": "a9ef2f68-c2c1-464b-8942-572fe28ceba3", "address": "fa:16:3e:10:15:fd", "network": {"id": "e6808e77-8eb3-4298-a05b-dd25f9f39bb0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-711659466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b49dcc697ced4397bc0760dc41be30cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ef2f68-c2", "ovs_interfaceid": "a9ef2f68-c2c1-464b-8942-572fe28ceba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ab31e545-d628-4ce3-b3f1-c06d619d8faf req-b4671501-5202-4697-9170-c2a8a80c622b service nova] Acquired lock "refresh_cache-e8b88f49-7f48-4170-af8a-aa1de706f218" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG nova.network.neutron [req-ab31e545-d628-4ce3-b3f1-c06d619d8faf req-b4671501-5202-4697-9170-c2a8a80c622b service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Refreshing network info cache for port a9ef2f68-c2c1-464b-8942-572fe28ceba3 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Start _get_guest_xml network_info=[{"id": "a9ef2f68-c2c1-464b-8942-572fe28ceba3", "address": "fa:16:3e:10:15:fd", "network": {"id": "e6808e77-8eb3-4298-a05b-dd25f9f39bb0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-711659466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b49dcc697ced4397bc0760dc41be30cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ef2f68-c2", "ovs_interfaceid": "a9ef2f68-c2c1-464b-8942-572fe28ceba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk 1073741824" returned: 0 in 0.068s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.334s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:54 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:05:54 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1165510733',display_name='tempest-VolumesAssistedSnapshotsTest-server-1165510733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1165510733',id=6,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTFy9hzXGJ0F/fF1bPYanwZleH9Y5TlMUVhGGxlMrePHT8c2PLIQuYokiozB/EVRizZyLqDxCxNdJ+/FHR8OW4Afe4cNVLh3xCdGZIfyo7DRP+p3rm1ghCaiiiira6Agg==',key_name='tempest-keypair-1933432392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b49dcc697ced4397bc0760dc41be30cc',ramdisk_id='',reservation_id='r-ahht7937',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-814188799',owner_user_name='tempest-VolumesAssistedSnapshotsTest-814188799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:05:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19800e8916e542239bf9b015d2df8de2',uuid=e8b88f49-7f48-4170-af8a-aa1de706f218,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9ef2f68-c2c1-464b-8942-572fe28ceba3", "address": "fa:16:3e:10:15:fd", "network": {"id": "e6808e77-8eb3-4298-a05b-dd25f9f39bb0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-711659466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b49dcc697ced4397bc0760dc41be30cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ef2f68-c2", "ovs_interfaceid": "a9ef2f68-c2c1-464b-8942-572fe28ceba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Converting VIF {"id": "a9ef2f68-c2c1-464b-8942-572fe28ceba3", "address": "fa:16:3e:10:15:fd", "network": {"id": "e6808e77-8eb3-4298-a05b-dd25f9f39bb0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-711659466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b49dcc697ced4397bc0760dc41be30cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ef2f68-c2", "ovs_interfaceid": "a9ef2f68-c2c1-464b-8942-572fe28ceba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:15:fd,bridge_name='br-int',has_traffic_filtering=True,id=a9ef2f68-c2c1-464b-8942-572fe28ceba3,network=Network(e6808e77-8eb3-4298-a05b-dd25f9f39bb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9ef2f68-c2') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.objects.instance [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Lazy-loading 'pci_devices' on Instance uuid e8b88f49-7f48-4170-af8a-aa1de706f218 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:05:55 user nova-compute[73188]:   <uuid>e8b88f49-7f48-4170-af8a-aa1de706f218</uuid>
Aug 15 19:05:55 user nova-compute[73188]:   <name>instance-00000006</name>
Aug 15 19:05:55 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:05:55 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:05:55 user nova-compute[73188]:   <metadata>
Aug 15 19:05:55 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:05:55 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:05:55 user nova-compute[73188]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1165510733</nova:name>
Aug 15 19:05:55 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:05:55</nova:creationTime>
Aug 15 19:05:55 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:05:55 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:05:55 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:05:55 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:05:55 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:05:55 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:05:55 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:05:55 user nova-compute[73188]:       <nova:owner>
Aug 15 19:05:55 user nova-compute[73188]:         <nova:user uuid="19800e8916e542239bf9b015d2df8de2">tempest-VolumesAssistedSnapshotsTest-814188799-project-member</nova:user>
Aug 15 19:05:55 user nova-compute[73188]:         <nova:project uuid="b49dcc697ced4397bc0760dc41be30cc">tempest-VolumesAssistedSnapshotsTest-814188799</nova:project>
Aug 15 19:05:55 user nova-compute[73188]:       </nova:owner>
Aug 15 19:05:55 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:05:55 user nova-compute[73188]:       <nova:ports>
Aug 15 19:05:55 user nova-compute[73188]:         <nova:port uuid="a9ef2f68-c2c1-464b-8942-572fe28ceba3">
Aug 15 19:05:55 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 19:05:55 user nova-compute[73188]:         </nova:port>
Aug 15 19:05:55 user nova-compute[73188]:       </nova:ports>
Aug 15 19:05:55 user nova-compute[73188]:     </nova:instance>
Aug 15 19:05:55 user nova-compute[73188]:   </metadata>
Aug 15 19:05:55 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:05:55 user nova-compute[73188]:     <system>
Aug 15 19:05:55 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:05:55 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:05:55 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:05:55 user nova-compute[73188]:       <entry name="serial">e8b88f49-7f48-4170-af8a-aa1de706f218</entry>
Aug 15 19:05:55 user nova-compute[73188]:       <entry name="uuid">e8b88f49-7f48-4170-af8a-aa1de706f218</entry>
Aug 15 19:05:55 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:05:55 user nova-compute[73188]:     </system>
Aug 15 19:05:55 user nova-compute[73188]:   </sysinfo>
Aug 15 19:05:55 user nova-compute[73188]:   <os>
Aug 15 19:05:55 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:05:55 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:05:55 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:05:55 user nova-compute[73188]:   </os>
Aug 15 19:05:55 user nova-compute[73188]:   <features>
Aug 15 19:05:55 user nova-compute[73188]:     <acpi/>
Aug 15 19:05:55 user nova-compute[73188]:     <apic/>
Aug 15 19:05:55 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:05:55 user nova-compute[73188]:   </features>
Aug 15 19:05:55 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:05:55 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:05:55 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:05:55 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:05:55 user nova-compute[73188]:   </clock>
Aug 15 19:05:55 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:05:55 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:05:55 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:05:55 user nova-compute[73188]:   </cpu>
Aug 15 19:05:55 user nova-compute[73188]:   <devices>
Aug 15 19:05:55 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:05:55 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:05:55 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/disk"/>
Aug 15 19:05:55 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:05:55 user nova-compute[73188]:     </disk>
Aug 15 19:05:55 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:05:55 user nova-compute[73188]:       <mac address="fa:16:3e:10:15:fd"/>
Aug 15 19:05:55 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:05:55 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:05:55 user nova-compute[73188]:       <target dev="tapa9ef2f68-c2"/>
Aug 15 19:05:55 user nova-compute[73188]:     </interface>
Aug 15 19:05:55 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:05:55 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/console.log" append="off"/>
Aug 15 19:05:55 user nova-compute[73188]:     </serial>
Aug 15 19:05:55 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:05:55 user nova-compute[73188]:     <video>
Aug 15 19:05:55 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:05:55 user nova-compute[73188]:     </video>
Aug 15 19:05:55 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:05:55 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:05:55 user nova-compute[73188]:     </rng>
Aug 15 19:05:55 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:05:55 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:05:55 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:05:55 user nova-compute[73188]:     </memballoon>
Aug 15 19:05:55 user nova-compute[73188]:   </devices>
Aug 15 19:05:55 user nova-compute[73188]: </domain>
Aug 15 19:05:55 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1165510733',display_name='tempest-VolumesAssistedSnapshotsTest-server-1165510733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1165510733',id=6,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTFy9hzXGJ0F/fF1bPYanwZleH9Y5TlMUVhGGxlMrePHT8c2PLIQuYokiozB/EVRizZyLqDxCxNdJ+/FHR8OW4Afe4cNVLh3xCdGZIfyo7DRP+p3rm1ghCaiiiira6Agg==',key_name='tempest-keypair-1933432392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b49dcc697ced4397bc0760dc41be30cc',ramdisk_id='',reservation_id='r-ahht7937',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-814188799',owner_user_name='tempest-VolumesAssistedSnapshotsTest-814188799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:05:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19800e8916e542239bf9b015d2df8de2',uuid=e8b88f49-7f48-4170-af8a-aa1de706f218,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9ef2f68-c2c1-464b-8942-572fe28ceba3", "address": "fa:16:3e:10:15:fd", "network": {"id": "e6808e77-8eb3-4298-a05b-dd25f9f39bb0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-711659466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b49dcc697ced4397bc0760dc41be30cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ef2f68-c2", "ovs_interfaceid": "a9ef2f68-c2c1-464b-8942-572fe28ceba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Converting VIF {"id": "a9ef2f68-c2c1-464b-8942-572fe28ceba3", "address": "fa:16:3e:10:15:fd", "network": {"id": "e6808e77-8eb3-4298-a05b-dd25f9f39bb0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-711659466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b49dcc697ced4397bc0760dc41be30cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ef2f68-c2", "ovs_interfaceid": "a9ef2f68-c2c1-464b-8942-572fe28ceba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:15:fd,bridge_name='br-int',has_traffic_filtering=True,id=a9ef2f68-c2c1-464b-8942-572fe28ceba3,network=Network(e6808e77-8eb3-4298-a05b-dd25f9f39bb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9ef2f68-c2') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG os_vif [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:15:fd,bridge_name='br-int',has_traffic_filtering=True,id=a9ef2f68-c2c1-464b-8942-572fe28ceba3,network=Network(e6808e77-8eb3-4298-a05b-dd25f9f39bb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9ef2f68-c2') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.224s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Checking if we can resize image /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9ef2f68-c2, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9ef2f68-c2, col_values=(('external_ids', {'iface-id': 'a9ef2f68-c2c1-464b-8942-572fe28ceba3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:15:fd', 'vm-uuid': 'e8b88f49-7f48-4170-af8a-aa1de706f218'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:55 user nova-compute[73188]: INFO os_vif [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:15:fd,bridge_name='br-int',has_traffic_filtering=True,id=a9ef2f68-c2c1-464b-8942-572fe28ceba3,network=Network(e6808e77-8eb3-4298-a05b-dd25f9f39bb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9ef2f68-c2')
Aug 15 19:05:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] No VIF found with MAC fa:16:3e:10:15:fd, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Cannot resize image /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.objects.instance [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lazy-loading 'migration_context' on Instance uuid 069eb3a9-59dc-45aa-a664-712ebbbad7e7 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Ensure instance console log exists: /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:56 user nova-compute[73188]: DEBUG nova.network.neutron [req-ab31e545-d628-4ce3-b3f1-c06d619d8faf req-b4671501-5202-4697-9170-c2a8a80c622b service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Updated VIF entry in instance network info cache for port a9ef2f68-c2c1-464b-8942-572fe28ceba3. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:05:56 user nova-compute[73188]: DEBUG nova.network.neutron [req-ab31e545-d628-4ce3-b3f1-c06d619d8faf req-b4671501-5202-4697-9170-c2a8a80c622b service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Updating instance_info_cache with network_info: [{"id": "a9ef2f68-c2c1-464b-8942-572fe28ceba3", "address": "fa:16:3e:10:15:fd", "network": {"id": "e6808e77-8eb3-4298-a05b-dd25f9f39bb0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-711659466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b49dcc697ced4397bc0760dc41be30cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ef2f68-c2", "ovs_interfaceid": "a9ef2f68-c2c1-464b-8942-572fe28ceba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:05:56 user nova-compute[73188]: DEBUG nova.network.neutron [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Successfully created port: d54026b3-10a6-44bb-9cc1-cb52b47fbfe2 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:05:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ab31e545-d628-4ce3-b3f1-c06d619d8faf req-b4671501-5202-4697-9170-c2a8a80c622b service nova] Releasing lock "refresh_cache-e8b88f49-7f48-4170-af8a-aa1de706f218" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:05:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Acquiring lock "0d5df01f-2a14-423a-9872-69132a3874ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "0d5df01f-2a14-423a-9872-69132a3874ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:56 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:05:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:56 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:05:56 user nova-compute[73188]: INFO nova.compute.claims [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Claim successful on node user
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.network.neutron [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Successfully updated port: d54026b3-10a6-44bb-9cc1-cb52b47fbfe2 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Acquiring lock "refresh_cache-069eb3a9-59dc-45aa-a664-712ebbbad7e7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Acquired lock "refresh_cache-069eb3a9-59dc-45aa-a664-712ebbbad7e7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.network.neutron [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.compute.manager [req-f2002ffe-379b-4cc5-8e78-bd2db71089fe req-e085e8c9-1698-443d-b008-6a9d1fe775c9 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Received event network-changed-d54026b3-10a6-44bb-9cc1-cb52b47fbfe2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.compute.manager [req-f2002ffe-379b-4cc5-8e78-bd2db71089fe req-e085e8c9-1698-443d-b008-6a9d1fe775c9 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Refreshing instance network info cache due to event network-changed-d54026b3-10a6-44bb-9cc1-cb52b47fbfe2. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f2002ffe-379b-4cc5-8e78-bd2db71089fe req-e085e8c9-1698-443d-b008-6a9d1fe775c9 service nova] Acquiring lock "refresh_cache-069eb3a9-59dc-45aa-a664-712ebbbad7e7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.network.neutron [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:05:57 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.policy [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48475ca817954e9fafd6801aff768985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ad86ad70c74685904ae5ef488e84f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:05:57 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Creating image(s)
Aug 15 19:05:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "/opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "/opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.network.neutron [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Updating instance_info_cache with network_info: [{"id": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "address": "fa:16:3e:99:31:c4", "network": {"id": "b0e519b5-4707-426d-b7c1-d5fc433bfbaa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2015894405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54026b3-10", "ovs_interfaceid": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Releasing lock "refresh_cache-069eb3a9-59dc-45aa-a664-712ebbbad7e7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.compute.manager [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Instance network_info: |[{"id": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "address": "fa:16:3e:99:31:c4", "network": {"id": "b0e519b5-4707-426d-b7c1-d5fc433bfbaa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2015894405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54026b3-10", "ovs_interfaceid": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f2002ffe-379b-4cc5-8e78-bd2db71089fe req-e085e8c9-1698-443d-b008-6a9d1fe775c9 service nova] Acquired lock "refresh_cache-069eb3a9-59dc-45aa-a664-712ebbbad7e7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.network.neutron [req-f2002ffe-379b-4cc5-8e78-bd2db71089fe req-e085e8c9-1698-443d-b008-6a9d1fe775c9 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Refreshing network info cache for port d54026b3-10a6-44bb-9cc1-cb52b47fbfe2 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Start _get_guest_xml network_info=[{"id": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "address": "fa:16:3e:99:31:c4", "network": {"id": "b0e519b5-4707-426d-b7c1-d5fc433bfbaa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2015894405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54026b3-10", "ovs_interfaceid": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:05:57 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:05:57 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:05:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-346712273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-346712273',id=7,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI7jXbeKw9zkf9/iIPvh7NB96wHBiVSd3tkGEgzRo7xcm/prE4XrAY5tS3bsMANa/m2oKIroukS/BgU5oVeuE62dlrCZmBmzDdHgRhV9W1LqC6AQ0bblC4H1qHiGzHZfg==',key_name='tempest-keypair-223053783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb6846c6807243379e6b5de3868c2fb2',ramdisk_id='',reservation_id='r-krs477l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-241567705',owner_user_name='tempest-TaggedAttachmentsTest-241567705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:05:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42c99d8a73ce4d2c9a6c98ebcec844bf',uuid=069eb3a9-59dc-45aa-a664-712ebbbad7e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "address": "fa:16:3e:99:31:c4", "network": {"id": "b0e519b5-4707-426d-b7c1-d5fc433bfbaa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2015894405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54026b3-10", "ovs_interfaceid": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Converting VIF {"id": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "address": "fa:16:3e:99:31:c4", "network": {"id": "b0e519b5-4707-426d-b7c1-d5fc433bfbaa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2015894405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54026b3-10", "ovs_interfaceid": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:31:c4,bridge_name='br-int',has_traffic_filtering=True,id=d54026b3-10a6-44bb-9cc1-cb52b47fbfe2,network=Network(b0e519b5-4707-426d-b7c1-d5fc433bfbaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd54026b3-10') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.objects.instance [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lazy-loading 'pci_devices' on Instance uuid 069eb3a9-59dc-45aa-a664-712ebbbad7e7 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:05:57 user nova-compute[73188]:   <uuid>069eb3a9-59dc-45aa-a664-712ebbbad7e7</uuid>
Aug 15 19:05:57 user nova-compute[73188]:   <name>instance-00000007</name>
Aug 15 19:05:57 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:05:57 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:05:57 user nova-compute[73188]:   <metadata>
Aug 15 19:05:57 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:05:57 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:05:57 user nova-compute[73188]:       <nova:name>tempest-device-tagging-server-346712273</nova:name>
Aug 15 19:05:57 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:05:57</nova:creationTime>
Aug 15 19:05:57 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:05:57 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:05:57 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:05:57 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:05:57 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:05:57 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:05:57 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:05:57 user nova-compute[73188]:       <nova:owner>
Aug 15 19:05:57 user nova-compute[73188]:         <nova:user uuid="42c99d8a73ce4d2c9a6c98ebcec844bf">tempest-TaggedAttachmentsTest-241567705-project-member</nova:user>
Aug 15 19:05:57 user nova-compute[73188]:         <nova:project uuid="eb6846c6807243379e6b5de3868c2fb2">tempest-TaggedAttachmentsTest-241567705</nova:project>
Aug 15 19:05:57 user nova-compute[73188]:       </nova:owner>
Aug 15 19:05:57 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:05:57 user nova-compute[73188]:       <nova:ports>
Aug 15 19:05:57 user nova-compute[73188]:         <nova:port uuid="d54026b3-10a6-44bb-9cc1-cb52b47fbfe2">
Aug 15 19:05:57 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 19:05:57 user nova-compute[73188]:         </nova:port>
Aug 15 19:05:57 user nova-compute[73188]:       </nova:ports>
Aug 15 19:05:57 user nova-compute[73188]:     </nova:instance>
Aug 15 19:05:57 user nova-compute[73188]:   </metadata>
Aug 15 19:05:57 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:05:57 user nova-compute[73188]:     <system>
Aug 15 19:05:57 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:05:57 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:05:57 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:05:57 user nova-compute[73188]:       <entry name="serial">069eb3a9-59dc-45aa-a664-712ebbbad7e7</entry>
Aug 15 19:05:57 user nova-compute[73188]:       <entry name="uuid">069eb3a9-59dc-45aa-a664-712ebbbad7e7</entry>
Aug 15 19:05:57 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:05:57 user nova-compute[73188]:     </system>
Aug 15 19:05:57 user nova-compute[73188]:   </sysinfo>
Aug 15 19:05:57 user nova-compute[73188]:   <os>
Aug 15 19:05:57 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:05:57 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:05:57 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:05:57 user nova-compute[73188]:   </os>
Aug 15 19:05:57 user nova-compute[73188]:   <features>
Aug 15 19:05:57 user nova-compute[73188]:     <acpi/>
Aug 15 19:05:57 user nova-compute[73188]:     <apic/>
Aug 15 19:05:57 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:05:57 user nova-compute[73188]:   </features>
Aug 15 19:05:57 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:05:57 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:05:57 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:05:57 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:05:57 user nova-compute[73188]:   </clock>
Aug 15 19:05:57 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:05:57 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:05:57 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:05:57 user nova-compute[73188]:   </cpu>
Aug 15 19:05:57 user nova-compute[73188]:   <devices>
Aug 15 19:05:57 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:05:57 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:05:57 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk"/>
Aug 15 19:05:57 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:05:57 user nova-compute[73188]:     </disk>
Aug 15 19:05:57 user nova-compute[73188]:     <disk type="file" device="cdrom">
Aug 15 19:05:57 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 19:05:57 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk.config"/>
Aug 15 19:05:57 user nova-compute[73188]:       <target dev="hda" bus="ide"/>
Aug 15 19:05:57 user nova-compute[73188]:     </disk>
Aug 15 19:05:57 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:05:57 user nova-compute[73188]:       <mac address="fa:16:3e:99:31:c4"/>
Aug 15 19:05:57 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:05:57 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:05:57 user nova-compute[73188]:       <target dev="tapd54026b3-10"/>
Aug 15 19:05:57 user nova-compute[73188]:     </interface>
Aug 15 19:05:57 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:05:57 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/console.log" append="off"/>
Aug 15 19:05:57 user nova-compute[73188]:     </serial>
Aug 15 19:05:57 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:05:57 user nova-compute[73188]:     <video>
Aug 15 19:05:57 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:05:57 user nova-compute[73188]:     </video>
Aug 15 19:05:57 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:05:57 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:05:57 user nova-compute[73188]:     </rng>
Aug 15 19:05:57 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:05:57 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:05:57 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:05:57 user nova-compute[73188]:     </memballoon>
Aug 15 19:05:57 user nova-compute[73188]:   </devices>
Aug 15 19:05:57 user nova-compute[73188]: </domain>
Aug 15 19:05:57 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:05:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-346712273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-346712273',id=7,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI7jXbeKw9zkf9/iIPvh7NB96wHBiVSd3tkGEgzRo7xcm/prE4XrAY5tS3bsMANa/m2oKIroukS/BgU5oVeuE62dlrCZmBmzDdHgRhV9W1LqC6AQ0bblC4H1qHiGzHZfg==',key_name='tempest-keypair-223053783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb6846c6807243379e6b5de3868c2fb2',ramdisk_id='',reservation_id='r-krs477l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-241567705',owner_user_name='tempest-TaggedAttachmentsTest-241567705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:05:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42c99d8a73ce4d2c9a6c98ebcec844bf',uuid=069eb3a9-59dc-45aa-a664-712ebbbad7e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "address": "fa:16:3e:99:31:c4", "network": {"id": "b0e519b5-4707-426d-b7c1-d5fc433bfbaa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2015894405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54026b3-10", "ovs_interfaceid": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Converting VIF {"id": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "address": "fa:16:3e:99:31:c4", "network": {"id": "b0e519b5-4707-426d-b7c1-d5fc433bfbaa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2015894405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54026b3-10", "ovs_interfaceid": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:31:c4,bridge_name='br-int',has_traffic_filtering=True,id=d54026b3-10a6-44bb-9cc1-cb52b47fbfe2,network=Network(b0e519b5-4707-426d-b7c1-d5fc433bfbaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd54026b3-10') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG os_vif [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:31:c4,bridge_name='br-int',has_traffic_filtering=True,id=d54026b3-10a6-44bb-9cc1-cb52b47fbfe2,network=Network(b0e519b5-4707-426d-b7c1-d5fc433bfbaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd54026b3-10') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd54026b3-10, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd54026b3-10, col_values=(('external_ids', {'iface-id': 'd54026b3-10a6-44bb-9cc1-cb52b47fbfe2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:31:c4', 'vm-uuid': '069eb3a9-59dc-45aa-a664-712ebbbad7e7'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:57 user nova-compute[73188]: INFO os_vif [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:31:c4,bridge_name='br-int',has_traffic_filtering=True,id=d54026b3-10a6-44bb-9cc1-cb52b47fbfe2,network=Network(b0e519b5-4707-426d-b7c1-d5fc433bfbaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd54026b3-10')
Aug 15 19:05:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.253s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] No BDM found with device name hda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:05:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] No VIF found with MAC fa:16:3e:99:31:c4, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:05:57 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Using config drive
Aug 15 19:05:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.241s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-2e8bafa2-9129-4f8e-a9c5-286a5f12ed5a req-0d4ec3c8-e3df-4ed2-b9fc-e1e7e2918e8b service nova] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Received event network-vif-plugged-8b93115d-3416-4846-9c43-a36a66f99e41 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2e8bafa2-9129-4f8e-a9c5-286a5f12ed5a req-0d4ec3c8-e3df-4ed2-b9fc-e1e7e2918e8b service nova] Acquiring lock "7caf434b-1484-4832-afee-0e2454bb5089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2e8bafa2-9129-4f8e-a9c5-286a5f12ed5a req-0d4ec3c8-e3df-4ed2-b9fc-e1e7e2918e8b service nova] Lock "7caf434b-1484-4832-afee-0e2454bb5089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2e8bafa2-9129-4f8e-a9c5-286a5f12ed5a req-0d4ec3c8-e3df-4ed2-b9fc-e1e7e2918e8b service nova] Lock "7caf434b-1484-4832-afee-0e2454bb5089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-2e8bafa2-9129-4f8e-a9c5-286a5f12ed5a req-0d4ec3c8-e3df-4ed2-b9fc-e1e7e2918e8b service nova] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] No waiting events found dispatching network-vif-plugged-8b93115d-3416-4846-9c43-a36a66f99e41 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:05:58 user nova-compute[73188]: WARNING nova.compute.manager [req-2e8bafa2-9129-4f8e-a9c5-286a5f12ed5a req-0d4ec3c8-e3df-4ed2-b9fc-e1e7e2918e8b service nova] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Received unexpected event network-vif-plugged-8b93115d-3416-4846-9c43-a36a66f99e41 for instance with vm_state active and task_state None.
Aug 15 19:05:58 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Creating config drive at /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk.config
Aug 15 19:05:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgypb0elr {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk 1073741824" returned: 0 in 0.139s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.385s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgypb0elr" returned: 0 in 0.104s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Successfully created port: 21d69054-1e25-44d3-bd72-c036ff3f1498 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.239s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126358.5235586, dad06110-8c8a-432a-91d5-8d1b840b26ca => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:05:58 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] VM Resumed (Lifecycle Event)
Aug 15 19:05:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:05:58 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Instance spawned successfully.
Aug 15 19:05:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:05:58 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:05:58 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126358.5239441, dad06110-8c8a-432a-91d5-8d1b840b26ca => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:05:58 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] VM Started (Lifecycle Event)
Aug 15 19:05:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Cannot resize image /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG nova.objects.instance [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lazy-loading 'migration_context' on Instance uuid 0d5df01f-2a14-423a-9872-69132a3874ce {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:05:58 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:05:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Ensure instance console log exists: /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:05:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:58 user nova-compute[73188]: INFO nova.compute.manager [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Took 10.33 seconds to spawn the instance on the hypervisor.
Aug 15 19:05:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:05:58 user nova-compute[73188]: INFO nova.compute.manager [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Took 11.28 seconds to build instance.
Aug 15 19:05:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-35b883a5-27ea-4d1d-8e8a-dbdccfb88570 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "dad06110-8c8a-432a-91d5-8d1b840b26ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.413s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG nova.network.neutron [req-f2002ffe-379b-4cc5-8e78-bd2db71089fe req-e085e8c9-1698-443d-b008-6a9d1fe775c9 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Updated VIF entry in instance network info cache for port d54026b3-10a6-44bb-9cc1-cb52b47fbfe2. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG nova.network.neutron [req-f2002ffe-379b-4cc5-8e78-bd2db71089fe req-e085e8c9-1698-443d-b008-6a9d1fe775c9 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Updating instance_info_cache with network_info: [{"id": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "address": "fa:16:3e:99:31:c4", "network": {"id": "b0e519b5-4707-426d-b7c1-d5fc433bfbaa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2015894405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54026b3-10", "ovs_interfaceid": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f2002ffe-379b-4cc5-8e78-bd2db71089fe req-e085e8c9-1698-443d-b008-6a9d1fe775c9 service nova] Releasing lock "refresh_cache-069eb3a9-59dc-45aa-a664-712ebbbad7e7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126359.3971257, e8b88f49-7f48-4170-af8a-aa1de706f218 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:05:59 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] VM Resumed (Lifecycle Event)
Aug 15 19:05:59 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:05:59 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Instance spawned successfully.
Aug 15 19:05:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:05:59 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:05:59 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126359.402357, e8b88f49-7f48-4170-af8a-aa1de706f218 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:05:59 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] VM Started (Lifecycle Event)
Aug 15 19:05:59 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:05:59 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:05:59 user nova-compute[73188]: INFO nova.compute.manager [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Took 8.05 seconds to spawn the instance on the hypervisor.
Aug 15 19:05:59 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:05:59 user nova-compute[73188]: INFO nova.compute.manager [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Took 9.12 seconds to build instance.
Aug 15 19:05:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c605effa-4cfb-44fc-8af5-e4417a711f6d tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Lock "e8b88f49-7f48-4170-af8a-aa1de706f218" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.242s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Successfully updated port: 21d69054-1e25-44d3-bd72-c036ff3f1498 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Acquiring lock "refresh_cache-0d5df01f-2a14-423a-9872-69132a3874ce" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Acquired lock "refresh_cache-0d5df01f-2a14-423a-9872-69132a3874ce" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG nova.compute.manager [req-792a34df-d9ce-41ea-ac34-e10f3e170757 req-a7367242-4588-405f-9711-dfe0f63384ea service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Received event network-changed-21d69054-1e25-44d3-bd72-c036ff3f1498 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG nova.compute.manager [req-792a34df-d9ce-41ea-ac34-e10f3e170757 req-a7367242-4588-405f-9711-dfe0f63384ea service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Refreshing instance network info cache due to event network-changed-21d69054-1e25-44d3-bd72-c036ff3f1498. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:05:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-792a34df-d9ce-41ea-ac34-e10f3e170757 req-a7367242-4588-405f-9711-dfe0f63384ea service nova] Acquiring lock "refresh_cache-0d5df01f-2a14-423a-9872-69132a3874ce" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8f28e2a-4286-425d-89a5-effb73284b2c req-53f877ff-08ab-4135-82e1-6d7e5410527e service nova] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Received event network-vif-plugged-8b93115d-3416-4846-9c43-a36a66f99e41 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8f28e2a-4286-425d-89a5-effb73284b2c req-53f877ff-08ab-4135-82e1-6d7e5410527e service nova] Acquiring lock "7caf434b-1484-4832-afee-0e2454bb5089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8f28e2a-4286-425d-89a5-effb73284b2c req-53f877ff-08ab-4135-82e1-6d7e5410527e service nova] Lock "7caf434b-1484-4832-afee-0e2454bb5089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8f28e2a-4286-425d-89a5-effb73284b2c req-53f877ff-08ab-4135-82e1-6d7e5410527e service nova] Lock "7caf434b-1484-4832-afee-0e2454bb5089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8f28e2a-4286-425d-89a5-effb73284b2c req-53f877ff-08ab-4135-82e1-6d7e5410527e service nova] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] No waiting events found dispatching network-vif-plugged-8b93115d-3416-4846-9c43-a36a66f99e41 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:06:00 user nova-compute[73188]: WARNING nova.compute.manager [req-f8f28e2a-4286-425d-89a5-effb73284b2c req-53f877ff-08ab-4135-82e1-6d7e5410527e service nova] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Received unexpected event network-vif-plugged-8b93115d-3416-4846-9c43-a36a66f99e41 for instance with vm_state active and task_state None.
Aug 15 19:06:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Updating instance_info_cache with network_info: [{"id": "21d69054-1e25-44d3-bd72-c036ff3f1498", "address": "fa:16:3e:22:74:a1", "network": {"id": "80270e7b-f136-47b6-8ff6-be6ff6bc6381", "bridge": "br-int", "label": "tempest-TestVolumeSwap-984990596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84ad86ad70c74685904ae5ef488e84f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d69054-1e", "ovs_interfaceid": "21d69054-1e25-44d3-bd72-c036ff3f1498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Releasing lock "refresh_cache-0d5df01f-2a14-423a-9872-69132a3874ce" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Instance network_info: |[{"id": "21d69054-1e25-44d3-bd72-c036ff3f1498", "address": "fa:16:3e:22:74:a1", "network": {"id": "80270e7b-f136-47b6-8ff6-be6ff6bc6381", "bridge": "br-int", "label": "tempest-TestVolumeSwap-984990596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84ad86ad70c74685904ae5ef488e84f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d69054-1e", "ovs_interfaceid": "21d69054-1e25-44d3-bd72-c036ff3f1498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-792a34df-d9ce-41ea-ac34-e10f3e170757 req-a7367242-4588-405f-9711-dfe0f63384ea service nova] Acquired lock "refresh_cache-0d5df01f-2a14-423a-9872-69132a3874ce" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.network.neutron [req-792a34df-d9ce-41ea-ac34-e10f3e170757 req-a7367242-4588-405f-9711-dfe0f63384ea service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Refreshing network info cache for port 21d69054-1e25-44d3-bd72-c036ff3f1498 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Start _get_guest_xml network_info=[{"id": "21d69054-1e25-44d3-bd72-c036ff3f1498", "address": "fa:16:3e:22:74:a1", "network": {"id": "80270e7b-f136-47b6-8ff6-be6ff6bc6381", "bridge": "br-int", "label": "tempest-TestVolumeSwap-984990596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84ad86ad70c74685904ae5ef488e84f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d69054-1e", "ovs_interfaceid": "21d69054-1e25-44d3-bd72-c036ff3f1498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:06:00 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:06:00 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-847195272',display_name='tempest-TestVolumeSwap-server-847195272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-847195272',id=8,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXLgBdOuGGSI2Gcx1o1boIlmvFQ+7RFJUMVgLSdLYqlMomb7RsMMdyhZjNyDa27FEEZtA0u+yovnpZ9rfnMIyfGtgycONM94fVEImJ++RsOvW7M/9VTTbUvLO2SykQAHg==',key_name='tempest-keypair-1036656956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84ad86ad70c74685904ae5ef488e84f6',ramdisk_id='',reservation_id='r-fopowlgx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-235731223',owner_user_name='tempest-TestVolumeSwap-235731223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:05:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48475ca817954e9fafd6801aff768985',uuid=0d5df01f-2a14-423a-9872-69132a3874ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21d69054-1e25-44d3-bd72-c036ff3f1498", "address": "fa:16:3e:22:74:a1", "network": {"id": "80270e7b-f136-47b6-8ff6-be6ff6bc6381", "bridge": "br-int", "label": "tempest-TestVolumeSwap-984990596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84ad86ad70c74685904ae5ef488e84f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d69054-1e", "ovs_interfaceid": "21d69054-1e25-44d3-bd72-c036ff3f1498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Converting VIF {"id": "21d69054-1e25-44d3-bd72-c036ff3f1498", "address": "fa:16:3e:22:74:a1", "network": {"id": "80270e7b-f136-47b6-8ff6-be6ff6bc6381", "bridge": "br-int", "label": "tempest-TestVolumeSwap-984990596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84ad86ad70c74685904ae5ef488e84f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d69054-1e", "ovs_interfaceid": "21d69054-1e25-44d3-bd72-c036ff3f1498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:74:a1,bridge_name='br-int',has_traffic_filtering=True,id=21d69054-1e25-44d3-bd72-c036ff3f1498,network=Network(80270e7b-f136-47b6-8ff6-be6ff6bc6381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d69054-1e') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.objects.instance [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d5df01f-2a14-423a-9872-69132a3874ce {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:06:00 user nova-compute[73188]:   <uuid>0d5df01f-2a14-423a-9872-69132a3874ce</uuid>
Aug 15 19:06:00 user nova-compute[73188]:   <name>instance-00000008</name>
Aug 15 19:06:00 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:06:00 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:06:00 user nova-compute[73188]:   <metadata>
Aug 15 19:06:00 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:06:00 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:06:00 user nova-compute[73188]:       <nova:name>tempest-TestVolumeSwap-server-847195272</nova:name>
Aug 15 19:06:00 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:06:00</nova:creationTime>
Aug 15 19:06:00 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:06:00 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:06:00 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:06:00 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:06:00 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:06:00 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:06:00 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:06:00 user nova-compute[73188]:       <nova:owner>
Aug 15 19:06:00 user nova-compute[73188]:         <nova:user uuid="48475ca817954e9fafd6801aff768985">tempest-TestVolumeSwap-235731223-project-member</nova:user>
Aug 15 19:06:00 user nova-compute[73188]:         <nova:project uuid="84ad86ad70c74685904ae5ef488e84f6">tempest-TestVolumeSwap-235731223</nova:project>
Aug 15 19:06:00 user nova-compute[73188]:       </nova:owner>
Aug 15 19:06:00 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:06:00 user nova-compute[73188]:       <nova:ports>
Aug 15 19:06:00 user nova-compute[73188]:         <nova:port uuid="21d69054-1e25-44d3-bd72-c036ff3f1498">
Aug 15 19:06:00 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 19:06:00 user nova-compute[73188]:         </nova:port>
Aug 15 19:06:00 user nova-compute[73188]:       </nova:ports>
Aug 15 19:06:00 user nova-compute[73188]:     </nova:instance>
Aug 15 19:06:00 user nova-compute[73188]:   </metadata>
Aug 15 19:06:00 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:06:00 user nova-compute[73188]:     <system>
Aug 15 19:06:00 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:06:00 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:06:00 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:06:00 user nova-compute[73188]:       <entry name="serial">0d5df01f-2a14-423a-9872-69132a3874ce</entry>
Aug 15 19:06:00 user nova-compute[73188]:       <entry name="uuid">0d5df01f-2a14-423a-9872-69132a3874ce</entry>
Aug 15 19:06:00 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:06:00 user nova-compute[73188]:     </system>
Aug 15 19:06:00 user nova-compute[73188]:   </sysinfo>
Aug 15 19:06:00 user nova-compute[73188]:   <os>
Aug 15 19:06:00 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:06:00 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:06:00 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:06:00 user nova-compute[73188]:   </os>
Aug 15 19:06:00 user nova-compute[73188]:   <features>
Aug 15 19:06:00 user nova-compute[73188]:     <acpi/>
Aug 15 19:06:00 user nova-compute[73188]:     <apic/>
Aug 15 19:06:00 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:06:00 user nova-compute[73188]:   </features>
Aug 15 19:06:00 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:06:00 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:06:00 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:06:00 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:06:00 user nova-compute[73188]:   </clock>
Aug 15 19:06:00 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:06:00 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:06:00 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:06:00 user nova-compute[73188]:   </cpu>
Aug 15 19:06:00 user nova-compute[73188]:   <devices>
Aug 15 19:06:00 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:06:00 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:06:00 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk"/>
Aug 15 19:06:00 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:06:00 user nova-compute[73188]:     </disk>
Aug 15 19:06:00 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:06:00 user nova-compute[73188]:       <mac address="fa:16:3e:22:74:a1"/>
Aug 15 19:06:00 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:06:00 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:06:00 user nova-compute[73188]:       <target dev="tap21d69054-1e"/>
Aug 15 19:06:00 user nova-compute[73188]:     </interface>
Aug 15 19:06:00 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:06:00 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/console.log" append="off"/>
Aug 15 19:06:00 user nova-compute[73188]:     </serial>
Aug 15 19:06:00 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:06:00 user nova-compute[73188]:     <video>
Aug 15 19:06:00 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:06:00 user nova-compute[73188]:     </video>
Aug 15 19:06:00 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:06:00 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:06:00 user nova-compute[73188]:     </rng>
Aug 15 19:06:00 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:06:00 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:06:00 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:06:00 user nova-compute[73188]:     </memballoon>
Aug 15 19:06:00 user nova-compute[73188]:   </devices>
Aug 15 19:06:00 user nova-compute[73188]: </domain>
Aug 15 19:06:00 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-847195272',display_name='tempest-TestVolumeSwap-server-847195272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-847195272',id=8,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXLgBdOuGGSI2Gcx1o1boIlmvFQ+7RFJUMVgLSdLYqlMomb7RsMMdyhZjNyDa27FEEZtA0u+yovnpZ9rfnMIyfGtgycONM94fVEImJ++RsOvW7M/9VTTbUvLO2SykQAHg==',key_name='tempest-keypair-1036656956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84ad86ad70c74685904ae5ef488e84f6',ramdisk_id='',reservation_id='r-fopowlgx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-235731223',owner_user_name='tempest-TestVolumeSwap-235731223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:05:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48475ca817954e9fafd6801aff768985',uuid=0d5df01f-2a14-423a-9872-69132a3874ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21d69054-1e25-44d3-bd72-c036ff3f1498", "address": "fa:16:3e:22:74:a1", "network": {"id": "80270e7b-f136-47b6-8ff6-be6ff6bc6381", "bridge": "br-int", "label": "tempest-TestVolumeSwap-984990596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84ad86ad70c74685904ae5ef488e84f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d69054-1e", "ovs_interfaceid": "21d69054-1e25-44d3-bd72-c036ff3f1498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Converting VIF {"id": "21d69054-1e25-44d3-bd72-c036ff3f1498", "address": "fa:16:3e:22:74:a1", "network": {"id": "80270e7b-f136-47b6-8ff6-be6ff6bc6381", "bridge": "br-int", "label": "tempest-TestVolumeSwap-984990596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84ad86ad70c74685904ae5ef488e84f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d69054-1e", "ovs_interfaceid": "21d69054-1e25-44d3-bd72-c036ff3f1498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:74:a1,bridge_name='br-int',has_traffic_filtering=True,id=21d69054-1e25-44d3-bd72-c036ff3f1498,network=Network(80270e7b-f136-47b6-8ff6-be6ff6bc6381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d69054-1e') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG os_vif [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:74:a1,bridge_name='br-int',has_traffic_filtering=True,id=21d69054-1e25-44d3-bd72-c036ff3f1498,network=Network(80270e7b-f136-47b6-8ff6-be6ff6bc6381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d69054-1e') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21d69054-1e, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap21d69054-1e, col_values=(('external_ids', {'iface-id': '21d69054-1e25-44d3-bd72-c036ff3f1498', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:74:a1', 'vm-uuid': '0d5df01f-2a14-423a-9872-69132a3874ce'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:06:00 user nova-compute[73188]: INFO os_vif [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:74:a1,bridge_name='br-int',has_traffic_filtering=True,id=21d69054-1e25-44d3-bd72-c036ff3f1498,network=Network(80270e7b-f136-47b6-8ff6-be6ff6bc6381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d69054-1e')
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] No VIF found with MAC fa:16:3e:22:74:a1, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.network.neutron [req-792a34df-d9ce-41ea-ac34-e10f3e170757 req-a7367242-4588-405f-9711-dfe0f63384ea service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Updated VIF entry in instance network info cache for port 21d69054-1e25-44d3-bd72-c036ff3f1498. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:06:00 user nova-compute[73188]: DEBUG nova.network.neutron [req-792a34df-d9ce-41ea-ac34-e10f3e170757 req-a7367242-4588-405f-9711-dfe0f63384ea service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Updating instance_info_cache with network_info: [{"id": "21d69054-1e25-44d3-bd72-c036ff3f1498", "address": "fa:16:3e:22:74:a1", "network": {"id": "80270e7b-f136-47b6-8ff6-be6ff6bc6381", "bridge": "br-int", "label": "tempest-TestVolumeSwap-984990596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84ad86ad70c74685904ae5ef488e84f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d69054-1e", "ovs_interfaceid": "21d69054-1e25-44d3-bd72-c036ff3f1498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:06:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-792a34df-d9ce-41ea-ac34-e10f3e170757 req-a7367242-4588-405f-9711-dfe0f63384ea service nova] Releasing lock "refresh_cache-0d5df01f-2a14-423a-9872-69132a3874ce" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:06:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:02 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126362.8917763, 069eb3a9-59dc-45aa-a664-712ebbbad7e7 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:06:02 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] VM Resumed (Lifecycle Event)
Aug 15 19:06:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:06:02 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:06:02 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Instance spawned successfully.
Aug 15 19:06:02 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:06:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:06:02 user nova-compute[73188]: DEBUG nova.compute.manager [req-6470566e-51ad-46cd-84ec-be6e208861be req-b348ad7d-18a9-46fe-9fc1-6cf1f5072ff9 service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Received event network-vif-plugged-21d69054-1e25-44d3-bd72-c036ff3f1498 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:06:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6470566e-51ad-46cd-84ec-be6e208861be req-b348ad7d-18a9-46fe-9fc1-6cf1f5072ff9 service nova] Acquiring lock "0d5df01f-2a14-423a-9872-69132a3874ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6470566e-51ad-46cd-84ec-be6e208861be req-b348ad7d-18a9-46fe-9fc1-6cf1f5072ff9 service nova] Lock "0d5df01f-2a14-423a-9872-69132a3874ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6470566e-51ad-46cd-84ec-be6e208861be req-b348ad7d-18a9-46fe-9fc1-6cf1f5072ff9 service nova] Lock "0d5df01f-2a14-423a-9872-69132a3874ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:02 user nova-compute[73188]: DEBUG nova.compute.manager [req-6470566e-51ad-46cd-84ec-be6e208861be req-b348ad7d-18a9-46fe-9fc1-6cf1f5072ff9 service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] No waiting events found dispatching network-vif-plugged-21d69054-1e25-44d3-bd72-c036ff3f1498 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:06:02 user nova-compute[73188]: WARNING nova.compute.manager [req-6470566e-51ad-46cd-84ec-be6e208861be req-b348ad7d-18a9-46fe-9fc1-6cf1f5072ff9 service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Received unexpected event network-vif-plugged-21d69054-1e25-44d3-bd72-c036ff3f1498 for instance with vm_state building and task_state spawning.
Aug 15 19:06:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:06:02 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:06:02 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:06:02 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:06:02 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:06:02 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:06:02 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:06:02 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:06:02 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126362.8936508, 069eb3a9-59dc-45aa-a664-712ebbbad7e7 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:06:02 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] VM Started (Lifecycle Event)
Aug 15 19:06:03 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:06:03 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:06:03 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:06:03 user nova-compute[73188]: INFO nova.compute.manager [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Took 8.78 seconds to spawn the instance on the hypervisor.
Aug 15 19:06:03 user nova-compute[73188]: DEBUG nova.compute.manager [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:06:03 user nova-compute[73188]: INFO nova.compute.manager [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Took 10.07 seconds to build instance.
Aug 15 19:06:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-08247e21-6ade-4f2a-a4cc-e4b63d76c1a9 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.193s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:04 user nova-compute[73188]: DEBUG nova.compute.manager [req-40df762e-22b5-458f-9a56-6d331549b8d3 req-7c56f86e-ab7f-4a2a-ae51-37e47ec54c99 service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Received event network-vif-plugged-21d69054-1e25-44d3-bd72-c036ff3f1498 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:06:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-40df762e-22b5-458f-9a56-6d331549b8d3 req-7c56f86e-ab7f-4a2a-ae51-37e47ec54c99 service nova] Acquiring lock "0d5df01f-2a14-423a-9872-69132a3874ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-40df762e-22b5-458f-9a56-6d331549b8d3 req-7c56f86e-ab7f-4a2a-ae51-37e47ec54c99 service nova] Lock "0d5df01f-2a14-423a-9872-69132a3874ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-40df762e-22b5-458f-9a56-6d331549b8d3 req-7c56f86e-ab7f-4a2a-ae51-37e47ec54c99 service nova] Lock "0d5df01f-2a14-423a-9872-69132a3874ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:04 user nova-compute[73188]: DEBUG nova.compute.manager [req-40df762e-22b5-458f-9a56-6d331549b8d3 req-7c56f86e-ab7f-4a2a-ae51-37e47ec54c99 service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] No waiting events found dispatching network-vif-plugged-21d69054-1e25-44d3-bd72-c036ff3f1498 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:06:04 user nova-compute[73188]: WARNING nova.compute.manager [req-40df762e-22b5-458f-9a56-6d331549b8d3 req-7c56f86e-ab7f-4a2a-ae51-37e47ec54c99 service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Received unexpected event network-vif-plugged-21d69054-1e25-44d3-bd72-c036ff3f1498 for instance with vm_state building and task_state spawning.
Aug 15 19:06:05 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126365.2746072, 0d5df01f-2a14-423a-9872-69132a3874ce => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:06:05 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] VM Resumed (Lifecycle Event)
Aug 15 19:06:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:06:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:06:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:06:05 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Instance spawned successfully.
Aug 15 19:06:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:06:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:06:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:06:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:06:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:06:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:06:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:06:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:06:05 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:06:05 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126365.2749832, 0d5df01f-2a14-423a-9872-69132a3874ce => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:06:05 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] VM Started (Lifecycle Event)
Aug 15 19:06:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:06:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:06:05 user nova-compute[73188]: INFO nova.compute.manager [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Took 7.87 seconds to spawn the instance on the hypervisor.
Aug 15 19:06:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:06:05 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:06:05 user nova-compute[73188]: INFO nova.compute.manager [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Took 8.90 seconds to build instance.
Aug 15 19:06:05 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:06:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Cleaning up deleted instances {{(pid=73188) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 19:06:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8b975d87-f7d9-407c-b61f-d34719cdf36f tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "0d5df01f-2a14-423a-9872-69132a3874ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.069s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] There are 0 instances to clean {{(pid=73188) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 19:06:05 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:06:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=73188) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 19:06:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:05 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:06:08 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:06:08 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:06:08 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:06:08 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:06:08 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:06:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:08 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:06:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json" returned: 0 in 0.331s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:10 user nova-compute[73188]: DEBUG nova.compute.manager [req-28c17cb0-8391-45f4-93ae-f8032a03671f req-61197660-087d-4fa9-b274-5c6bca4574dc service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Received event network-vif-plugged-d54026b3-10a6-44bb-9cc1-cb52b47fbfe2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:06:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-28c17cb0-8391-45f4-93ae-f8032a03671f req-61197660-087d-4fa9-b274-5c6bca4574dc service nova] Acquiring lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-28c17cb0-8391-45f4-93ae-f8032a03671f req-61197660-087d-4fa9-b274-5c6bca4574dc service nova] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-28c17cb0-8391-45f4-93ae-f8032a03671f req-61197660-087d-4fa9-b274-5c6bca4574dc service nova] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:10 user nova-compute[73188]: DEBUG nova.compute.manager [req-28c17cb0-8391-45f4-93ae-f8032a03671f req-61197660-087d-4fa9-b274-5c6bca4574dc service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] No waiting events found dispatching network-vif-plugged-d54026b3-10a6-44bb-9cc1-cb52b47fbfe2 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:06:10 user nova-compute[73188]: WARNING nova.compute.manager [req-28c17cb0-8391-45f4-93ae-f8032a03671f req-61197660-087d-4fa9-b274-5c6bca4574dc service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Received unexpected event network-vif-plugged-d54026b3-10a6-44bb-9cc1-cb52b47fbfe2 for instance with vm_state active and task_state None.
Aug 15 19:06:10 user nova-compute[73188]: DEBUG nova.compute.manager [req-711185cc-b21f-41ab-a88a-268447aee096 req-bfd1fe83-a1af-47a3-813a-6016ee0ad740 service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Received event network-vif-plugged-933ca0dd-f8d4-4a81-86e9-83a706d12d82 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:06:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-711185cc-b21f-41ab-a88a-268447aee096 req-bfd1fe83-a1af-47a3-813a-6016ee0ad740 service nova] Acquiring lock "c3ca002b-c535-4b87-8d39-861ce6847f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-711185cc-b21f-41ab-a88a-268447aee096 req-bfd1fe83-a1af-47a3-813a-6016ee0ad740 service nova] Lock "c3ca002b-c535-4b87-8d39-861ce6847f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-711185cc-b21f-41ab-a88a-268447aee096 req-bfd1fe83-a1af-47a3-813a-6016ee0ad740 service nova] Lock "c3ca002b-c535-4b87-8d39-861ce6847f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:10 user nova-compute[73188]: DEBUG nova.compute.manager [req-711185cc-b21f-41ab-a88a-268447aee096 req-bfd1fe83-a1af-47a3-813a-6016ee0ad740 service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] No waiting events found dispatching network-vif-plugged-933ca0dd-f8d4-4a81-86e9-83a706d12d82 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:06:10 user nova-compute[73188]: WARNING nova.compute.manager [req-711185cc-b21f-41ab-a88a-268447aee096 req-bfd1fe83-a1af-47a3-813a-6016ee0ad740 service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Received unexpected event network-vif-plugged-933ca0dd-f8d4-4a81-86e9-83a706d12d82 for instance with vm_state active and task_state None.
Aug 15 19:06:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/disk --force-share --output=json" returned: 0 in 0.366s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:12 user nova-compute[73188]: DEBUG nova.compute.manager [req-86126d74-865a-4947-a5a1-b2876095460a req-c731d8d1-9323-470a-a8aa-b022387352fc service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Received event network-vif-plugged-d54026b3-10a6-44bb-9cc1-cb52b47fbfe2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:06:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-86126d74-865a-4947-a5a1-b2876095460a req-c731d8d1-9323-470a-a8aa-b022387352fc service nova] Acquiring lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-86126d74-865a-4947-a5a1-b2876095460a req-c731d8d1-9323-470a-a8aa-b022387352fc service nova] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-86126d74-865a-4947-a5a1-b2876095460a req-c731d8d1-9323-470a-a8aa-b022387352fc service nova] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:12 user nova-compute[73188]: DEBUG nova.compute.manager [req-86126d74-865a-4947-a5a1-b2876095460a req-c731d8d1-9323-470a-a8aa-b022387352fc service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] No waiting events found dispatching network-vif-plugged-d54026b3-10a6-44bb-9cc1-cb52b47fbfe2 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:06:12 user nova-compute[73188]: WARNING nova.compute.manager [req-86126d74-865a-4947-a5a1-b2876095460a req-c731d8d1-9323-470a-a8aa-b022387352fc service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Received unexpected event network-vif-plugged-d54026b3-10a6-44bb-9cc1-cb52b47fbfe2 for instance with vm_state active and task_state None.
Aug 15 19:06:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:12 user nova-compute[73188]: DEBUG nova.compute.manager [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Received event network-vif-plugged-933ca0dd-f8d4-4a81-86e9-83a706d12d82 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:06:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] Acquiring lock "c3ca002b-c535-4b87-8d39-861ce6847f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] Lock "c3ca002b-c535-4b87-8d39-861ce6847f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] Lock "c3ca002b-c535-4b87-8d39-861ce6847f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:13 user nova-compute[73188]: DEBUG nova.compute.manager [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] No waiting events found dispatching network-vif-plugged-933ca0dd-f8d4-4a81-86e9-83a706d12d82 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:06:13 user nova-compute[73188]: WARNING nova.compute.manager [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Received unexpected event network-vif-plugged-933ca0dd-f8d4-4a81-86e9-83a706d12d82 for instance with vm_state active and task_state None.
Aug 15 19:06:13 user nova-compute[73188]: DEBUG nova.compute.manager [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Received event network-vif-plugged-5d901c10-1493-4a6b-b706-cc3979a6b29e {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:06:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] Acquiring lock "dad06110-8c8a-432a-91d5-8d1b840b26ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] Lock "dad06110-8c8a-432a-91d5-8d1b840b26ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] Lock "dad06110-8c8a-432a-91d5-8d1b840b26ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:13 user nova-compute[73188]: DEBUG nova.compute.manager [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] No waiting events found dispatching network-vif-plugged-5d901c10-1493-4a6b-b706-cc3979a6b29e {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:06:13 user nova-compute[73188]: WARNING nova.compute.manager [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Received unexpected event network-vif-plugged-5d901c10-1493-4a6b-b706-cc3979a6b29e for instance with vm_state active and task_state None.
Aug 15 19:06:13 user nova-compute[73188]: DEBUG nova.compute.manager [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Received event network-vif-plugged-5d901c10-1493-4a6b-b706-cc3979a6b29e {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:06:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] Acquiring lock "dad06110-8c8a-432a-91d5-8d1b840b26ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] Lock "dad06110-8c8a-432a-91d5-8d1b840b26ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] Lock "dad06110-8c8a-432a-91d5-8d1b840b26ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:13 user nova-compute[73188]: DEBUG nova.compute.manager [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] No waiting events found dispatching network-vif-plugged-5d901c10-1493-4a6b-b706-cc3979a6b29e {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:06:13 user nova-compute[73188]: WARNING nova.compute.manager [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Received unexpected event network-vif-plugged-5d901c10-1493-4a6b-b706-cc3979a6b29e for instance with vm_state active and task_state None.
Aug 15 19:06:13 user nova-compute[73188]: DEBUG nova.compute.manager [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Received event network-vif-plugged-a9ef2f68-c2c1-464b-8942-572fe28ceba3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:06:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] Acquiring lock "e8b88f49-7f48-4170-af8a-aa1de706f218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] Lock "e8b88f49-7f48-4170-af8a-aa1de706f218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] Lock "e8b88f49-7f48-4170-af8a-aa1de706f218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:13 user nova-compute[73188]: DEBUG nova.compute.manager [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] No waiting events found dispatching network-vif-plugged-a9ef2f68-c2c1-464b-8942-572fe28ceba3 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:06:13 user nova-compute[73188]: WARNING nova.compute.manager [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Received unexpected event network-vif-plugged-a9ef2f68-c2c1-464b-8942-572fe28ceba3 for instance with vm_state active and task_state None.
Aug 15 19:06:13 user nova-compute[73188]: DEBUG nova.compute.manager [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Received event network-vif-plugged-a9ef2f68-c2c1-464b-8942-572fe28ceba3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:06:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] Acquiring lock "e8b88f49-7f48-4170-af8a-aa1de706f218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] Lock "e8b88f49-7f48-4170-af8a-aa1de706f218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] Lock "e8b88f49-7f48-4170-af8a-aa1de706f218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:13 user nova-compute[73188]: DEBUG nova.compute.manager [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] No waiting events found dispatching network-vif-plugged-a9ef2f68-c2c1-464b-8942-572fe28ceba3 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:06:13 user nova-compute[73188]: WARNING nova.compute.manager [req-b5e0d27d-3021-4f07-bb8a-3e1a38402e47 req-caa21fb2-65d6-460c-95c6-d11f881f5dff service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Received unexpected event network-vif-plugged-a9ef2f68-c2c1-464b-8942-572fe28ceba3 for instance with vm_state active and task_state None.
Aug 15 19:06:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:14 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:06:14 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:06:14 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=7644MB free_disk=25.804241180419922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:06:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:14 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:06:14 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance d1b5f5bf-9672-40a8-83da-3a8f25007e91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:06:14 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 7caf434b-1484-4832-afee-0e2454bb5089 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:06:14 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance c3ca002b-c535-4b87-8d39-861ce6847f12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:06:14 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance dad06110-8c8a-432a-91d5-8d1b840b26ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:06:14 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e8b88f49-7f48-4170-af8a-aa1de706f218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:06:14 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 069eb3a9-59dc-45aa-a664-712ebbbad7e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:06:14 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 0d5df01f-2a14-423a-9872-69132a3874ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:06:14 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:06:14 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:06:14 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing inventories for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 19:06:14 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Updating ProviderTree inventory for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 19:06:14 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Updating inventory in ProviderTree for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 19:06:14 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing aggregate associations for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5, aggregates: None {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 19:06:14 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing trait associations for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 19:06:15 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:06:15 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:06:15 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:06:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.190s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:16 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:06:16 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:06:16 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:06:16 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:06:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:06:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:06:16 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:06:16 user nova-compute[73188]: DEBUG nova.objects.instance [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lazy-loading 'info_cache' on Instance uuid ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:06:17 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Updating instance_info_cache with network_info: [{"id": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "address": "fa:16:3e:df:71:ad", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85966f51-bc", "ovs_interfaceid": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:06:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:06:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:06:17 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:06:17 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:06:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:06:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Acquiring lock "fd74b385-fcfa-4a38-b869-0f5a8328188c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:18 user nova-compute[73188]: DEBUG nova.compute.manager [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:06:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:06:18 user nova-compute[73188]: INFO nova.compute.claims [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Claim successful on node user
Aug 15 19:06:18 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:06:18 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:06:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:18 user nova-compute[73188]: DEBUG nova.compute.manager [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:06:19 user nova-compute[73188]: DEBUG nova.compute.manager [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:06:19 user nova-compute[73188]: DEBUG nova.network.neutron [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:06:19 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:06:19 user nova-compute[73188]: DEBUG nova.compute.manager [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:06:19 user nova-compute[73188]: DEBUG nova.policy [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f94daba64eb347959248376b01bce161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1509fdfe31e4f26baac3a8be4b8d894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:06:19 user nova-compute[73188]: INFO nova.virt.block_device [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Booting with volume 5f013040-56d6-4ad2-aa09-4346f46f544b at /dev/vda
Aug 15 19:06:19 user nova-compute[73188]: DEBUG os_brick.utils [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:06:19 user nova-compute[73188]: INFO oslo.privsep.daemon [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpcjwglekt/privsep.sock']
Aug 15 19:06:19 user sudo[83925]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpcjwglekt/privsep.sock
Aug 15 19:06:19 user sudo[83925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 19:06:19 user nova-compute[73188]: DEBUG nova.network.neutron [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Successfully created port: e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:06:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:20 user nova-compute[73188]: DEBUG nova.network.neutron [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Successfully updated port: e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:06:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Acquiring lock "refresh_cache-fd74b385-fcfa-4a38-b869-0f5a8328188c" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:06:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Acquired lock "refresh_cache-fd74b385-fcfa-4a38-b869-0f5a8328188c" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:06:20 user nova-compute[73188]: DEBUG nova.network.neutron [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:06:20 user nova-compute[73188]: DEBUG nova.compute.manager [req-26d063b1-df20-4feb-be3e-6298b330cc66 req-25cf9e25-20ac-44a0-8e2a-351dba95661d service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Received event network-changed-e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:06:20 user nova-compute[73188]: DEBUG nova.compute.manager [req-26d063b1-df20-4feb-be3e-6298b330cc66 req-25cf9e25-20ac-44a0-8e2a-351dba95661d service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Refreshing instance network info cache due to event network-changed-e4790711-6bf9-4e86-bacd-c9e822edc6a9. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:06:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-26d063b1-df20-4feb-be3e-6298b330cc66 req-25cf9e25-20ac-44a0-8e2a-351dba95661d service nova] Acquiring lock "refresh_cache-fd74b385-fcfa-4a38-b869-0f5a8328188c" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:06:20 user nova-compute[73188]: DEBUG nova.network.neutron [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:06:21 user sudo[83925]: pam_unix(sudo:session): session closed for user root
Aug 15 19:06:21 user nova-compute[73188]: DEBUG nova.network.neutron [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Updating instance_info_cache with network_info: [{"id": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "address": "fa:16:3e:f2:d4:61", "network": {"id": "b9a20327-d2f1-4377-943b-0d2cc3a7dbd9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1246109159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1509fdfe31e4f26baac3a8be4b8d894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4790711-6b", "ovs_interfaceid": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:06:21 user nova-compute[73188]: INFO oslo.privsep.daemon [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Spawned new privsep daemon via rootwrap
Aug 15 19:06:21 user nova-compute[73188]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 19:06:21 user nova-compute[73188]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 19:06:21 user nova-compute[73188]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 15 19:06:21 user nova-compute[73188]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83967
Aug 15 19:06:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1490dc6-198e-4954-b6c7-fb2e21e7aa99]: (2,) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Releasing lock "refresh_cache-fd74b385-fcfa-4a38-b869-0f5a8328188c" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG nova.compute.manager [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Instance network_info: |[{"id": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "address": "fa:16:3e:f2:d4:61", "network": {"id": "b9a20327-d2f1-4377-943b-0d2cc3a7dbd9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1246109159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1509fdfe31e4f26baac3a8be4b8d894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4790711-6b", "ovs_interfaceid": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-26d063b1-df20-4feb-be3e-6298b330cc66 req-25cf9e25-20ac-44a0-8e2a-351dba95661d service nova] Acquired lock "refresh_cache-fd74b385-fcfa-4a38-b869-0f5a8328188c" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG nova.network.neutron [req-26d063b1-df20-4feb-be3e-6298b330cc66 req-25cf9e25-20ac-44a0-8e2a-351dba95661d service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Refreshing network info cache for port e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed25e4f3-99b6-4096-a3c1-e73f3f8a981b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:21 user nova-compute[73188]: WARNING os_brick.initiator.connectors.nvmeof [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 15 19:06:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0968ce-992e-4e00-8e74-84f4f6166c50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc75db21-9876-4240-8c1b-dd835baf5ac0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[961f22f1-833b-45b8-9996-ecb227e85d3a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:06:21 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:06:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be7c18a-bcbc-48d5-9acb-b35d74036d1a]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG os_brick.utils [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] <== get_connector_properties: return (2374ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:06:21 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Updating existing volume attachment record: 77ddf284-dafa-4316-8662-996f5ac5ece3 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:06:22 user nova-compute[73188]: DEBUG nova.network.neutron [req-26d063b1-df20-4feb-be3e-6298b330cc66 req-25cf9e25-20ac-44a0-8e2a-351dba95661d service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Updated VIF entry in instance network info cache for port e4790711-6bf9-4e86-bacd-c9e822edc6a9. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:06:22 user nova-compute[73188]: DEBUG nova.network.neutron [req-26d063b1-df20-4feb-be3e-6298b330cc66 req-25cf9e25-20ac-44a0-8e2a-351dba95661d service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Updating instance_info_cache with network_info: [{"id": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "address": "fa:16:3e:f2:d4:61", "network": {"id": "b9a20327-d2f1-4377-943b-0d2cc3a7dbd9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1246109159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1509fdfe31e4f26baac3a8be4b8d894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4790711-6b", "ovs_interfaceid": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:06:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-26d063b1-df20-4feb-be3e-6298b330cc66 req-25cf9e25-20ac-44a0-8e2a-351dba95661d service nova] Releasing lock "refresh_cache-fd74b385-fcfa-4a38-b869-0f5a8328188c" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:06:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG nova.compute.manager [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:06:31 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Creating image(s)
Aug 15 19:06:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Did not create local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Ensure instance console log exists: /opt/stack/data/nova/instances/fd74b385-fcfa-4a38-b869-0f5a8328188c/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Start _get_guest_xml network_info=[{"id": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "address": "fa:16:3e:f2:d4:61", "network": {"id": "b9a20327-d2f1-4377-943b-0d2cc3a7dbd9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1246109159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1509fdfe31e4f26baac3a8be4b8d894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4790711-6b", "ovs_interfaceid": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwoJimEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fd74b385-fcfa-4a38-b869-0f5a8328188c', 'attached_at': '', 'detached_at': '', 'volume_id': '5f013040-56d6-4ad2-aa09-4346f46f544b', 'serial': '5f013040-56d6-4ad2-aa09-4346f46f544b'}, 'attachment_id': '77ddf284-dafa-4316-8662-996f5ac5ece3', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:06:31 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:06:31 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:06:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG os_brick.initiator.connector [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Factory for ISCSI on None {{(pid=73188) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.009s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwoJimEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:06:31 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:06:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:06:31 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:06:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:06:31 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a96831-7fbe-48d6-b674-ef9ffd343c13]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:06:31 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8cdc60-5328-4a0a-b821-35c55d3dc665]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b] added
Aug 15 19:06:31 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac232c6-42ea-4985-83e0-f2c364bd0fab]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2762663f-ffe6-434c-aa04-78a9a023e457]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lwoJimEr {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lwoJimEr" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5a0b60-6941-447e-9bb1-0fe3b47d993b]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lwoJimEr'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb2b599-b4af-44ea-b80a-3bf9658894bc]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc48ed22-d8bd-4edc-ba01-c307ecd2721c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 19:06:31 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:06:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 19:06:31 user nova-compute[73188]:  {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:06:31 user nova-compute[73188]: WARNING os_brick.initiator.connectors.iscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 19:06:31 user nova-compute[73188]: 
Aug 15 19:06:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --login" returned: 0 in 1.050s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61f6ebb-7608-4298-9534-4d90b43e8260]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b, portal: 172.16.0.220,3260]
Aug 15 19:06:32 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b, portal: 172.16.0.220,3260] successful.
Aug 15 19:06:32 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:06:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[140a5164-9538-48b3-9f1c-1f93ebf0c175]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:06:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ec6469-f26c-4131-8320-276b22a8a96a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:06:32 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:06:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:06:32 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:06:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.267s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:06:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:06:32 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:06:32 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:06:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[04682ad9-0a45-4ea3-9c3f-0a02a89b3770]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:32 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwoJimEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.297s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] <== connect_volume: return (2299ms) {'type': 'block', 'scsi_wwn': '23161346437393466', 'path': '/dev/sdb'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161346437393466', 'path': '/dev/sdb'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-465202991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-465202991',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaBGa9KkwqWE1Q78AJMY7JlCjjnEVbtGOA19dY6uOf/g7Nc83Gf5QTFxXyhKxitOoCVD+9s7ju99GRuHp8fE8zuC/kBIVt9HsyWnGOgpWJZiCHV3u4bydMPINjm7GJs7w==',key_name='tempest-keypair-1090329827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1509fdfe31e4f26baac3a8be4b8d894',ramdisk_id='',reservation_id='r-fj96x5lg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-893119363',owner_user_name='tempest-ServerActionsV293TestJSON-893119363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f94daba64eb347959248376b01bce161',uuid=fd74b385-fcfa-4a38-b869-0f5a8328188c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "address": "fa:16:3e:f2:d4:61", "network": {"id": "b9a20327-d2f1-4377-943b-0d2cc3a7dbd9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1246109159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1509fdfe31e4f26baac3a8be4b8d894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4790711-6b", "ovs_interfaceid": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Converting VIF {"id": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "address": "fa:16:3e:f2:d4:61", "network": {"id": "b9a20327-d2f1-4377-943b-0d2cc3a7dbd9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1246109159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1509fdfe31e4f26baac3a8be4b8d894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4790711-6b", "ovs_interfaceid": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:d4:61,bridge_name='br-int',has_traffic_filtering=True,id=e4790711-6bf9-4e86-bacd-c9e822edc6a9,network=Network(b9a20327-d2f1-4377-943b-0d2cc3a7dbd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4790711-6b') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG nova.objects.instance [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lazy-loading 'pci_devices' on Instance uuid fd74b385-fcfa-4a38-b869-0f5a8328188c {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:06:33 user nova-compute[73188]:   <uuid>fd74b385-fcfa-4a38-b869-0f5a8328188c</uuid>
Aug 15 19:06:33 user nova-compute[73188]:   <name>instance-00000009</name>
Aug 15 19:06:33 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:06:33 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:06:33 user nova-compute[73188]:   <metadata>
Aug 15 19:06:33 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:06:33 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:06:33 user nova-compute[73188]:       <nova:name>tempest-ServerActionsV293TestJSON-server-465202991</nova:name>
Aug 15 19:06:33 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:06:31</nova:creationTime>
Aug 15 19:06:33 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:06:33 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:06:33 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:06:33 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:06:33 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:06:33 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:06:33 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:06:33 user nova-compute[73188]:       <nova:owner>
Aug 15 19:06:33 user nova-compute[73188]:         <nova:user uuid="f94daba64eb347959248376b01bce161">tempest-ServerActionsV293TestJSON-893119363-project-member</nova:user>
Aug 15 19:06:33 user nova-compute[73188]:         <nova:project uuid="f1509fdfe31e4f26baac3a8be4b8d894">tempest-ServerActionsV293TestJSON-893119363</nova:project>
Aug 15 19:06:33 user nova-compute[73188]:       </nova:owner>
Aug 15 19:06:33 user nova-compute[73188]:       <nova:ports>
Aug 15 19:06:33 user nova-compute[73188]:         <nova:port uuid="e4790711-6bf9-4e86-bacd-c9e822edc6a9">
Aug 15 19:06:33 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 19:06:33 user nova-compute[73188]:         </nova:port>
Aug 15 19:06:33 user nova-compute[73188]:       </nova:ports>
Aug 15 19:06:33 user nova-compute[73188]:     </nova:instance>
Aug 15 19:06:33 user nova-compute[73188]:   </metadata>
Aug 15 19:06:33 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:06:33 user nova-compute[73188]:     <system>
Aug 15 19:06:33 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:06:33 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:06:33 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:06:33 user nova-compute[73188]:       <entry name="serial">fd74b385-fcfa-4a38-b869-0f5a8328188c</entry>
Aug 15 19:06:33 user nova-compute[73188]:       <entry name="uuid">fd74b385-fcfa-4a38-b869-0f5a8328188c</entry>
Aug 15 19:06:33 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:06:33 user nova-compute[73188]:     </system>
Aug 15 19:06:33 user nova-compute[73188]:   </sysinfo>
Aug 15 19:06:33 user nova-compute[73188]:   <os>
Aug 15 19:06:33 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:06:33 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:06:33 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:06:33 user nova-compute[73188]:   </os>
Aug 15 19:06:33 user nova-compute[73188]:   <features>
Aug 15 19:06:33 user nova-compute[73188]:     <acpi/>
Aug 15 19:06:33 user nova-compute[73188]:     <apic/>
Aug 15 19:06:33 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:06:33 user nova-compute[73188]:   </features>
Aug 15 19:06:33 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:06:33 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:06:33 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:06:33 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:06:33 user nova-compute[73188]:   </clock>
Aug 15 19:06:33 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:06:33 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:06:33 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:06:33 user nova-compute[73188]:   </cpu>
Aug 15 19:06:33 user nova-compute[73188]:   <devices>
Aug 15 19:06:33 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:06:33 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:06:33 user nova-compute[73188]:       <source dev="/dev/sdb"/>
Aug 15 19:06:33 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:06:33 user nova-compute[73188]:       <serial>5f013040-56d6-4ad2-aa09-4346f46f544b</serial>
Aug 15 19:06:33 user nova-compute[73188]:     </disk>
Aug 15 19:06:33 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:06:33 user nova-compute[73188]:       <mac address="fa:16:3e:f2:d4:61"/>
Aug 15 19:06:33 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:06:33 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:06:33 user nova-compute[73188]:       <target dev="tape4790711-6b"/>
Aug 15 19:06:33 user nova-compute[73188]:     </interface>
Aug 15 19:06:33 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:06:33 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/fd74b385-fcfa-4a38-b869-0f5a8328188c/console.log" append="off"/>
Aug 15 19:06:33 user nova-compute[73188]:     </serial>
Aug 15 19:06:33 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:06:33 user nova-compute[73188]:     <video>
Aug 15 19:06:33 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:06:33 user nova-compute[73188]:     </video>
Aug 15 19:06:33 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:06:33 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:06:33 user nova-compute[73188]:     </rng>
Aug 15 19:06:33 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:06:33 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:06:33 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:06:33 user nova-compute[73188]:     </memballoon>
Aug 15 19:06:33 user nova-compute[73188]:   </devices>
Aug 15 19:06:33 user nova-compute[73188]: </domain>
Aug 15 19:06:33 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-465202991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-465202991',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaBGa9KkwqWE1Q78AJMY7JlCjjnEVbtGOA19dY6uOf/g7Nc83Gf5QTFxXyhKxitOoCVD+9s7ju99GRuHp8fE8zuC/kBIVt9HsyWnGOgpWJZiCHV3u4bydMPINjm7GJs7w==',key_name='tempest-keypair-1090329827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1509fdfe31e4f26baac3a8be4b8d894',ramdisk_id='',reservation_id='r-fj96x5lg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-893119363',owner_user_name='tempest-ServerActionsV293TestJSON-893119363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f94daba64eb347959248376b01bce161',uuid=fd74b385-fcfa-4a38-b869-0f5a8328188c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "address": "fa:16:3e:f2:d4:61", "network": {"id": "b9a20327-d2f1-4377-943b-0d2cc3a7dbd9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1246109159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1509fdfe31e4f26baac3a8be4b8d894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4790711-6b", "ovs_interfaceid": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Converting VIF {"id": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "address": "fa:16:3e:f2:d4:61", "network": {"id": "b9a20327-d2f1-4377-943b-0d2cc3a7dbd9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1246109159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1509fdfe31e4f26baac3a8be4b8d894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4790711-6b", "ovs_interfaceid": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:d4:61,bridge_name='br-int',has_traffic_filtering=True,id=e4790711-6bf9-4e86-bacd-c9e822edc6a9,network=Network(b9a20327-d2f1-4377-943b-0d2cc3a7dbd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4790711-6b') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG os_vif [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:d4:61,bridge_name='br-int',has_traffic_filtering=True,id=e4790711-6bf9-4e86-bacd-c9e822edc6a9,network=Network(b9a20327-d2f1-4377-943b-0d2cc3a7dbd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4790711-6b') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4790711-6b, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4790711-6b, col_values=(('external_ids', {'iface-id': 'e4790711-6bf9-4e86-bacd-c9e822edc6a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:d4:61', 'vm-uuid': 'fd74b385-fcfa-4a38-b869-0f5a8328188c'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:33 user nova-compute[73188]: INFO os_vif [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:d4:61,bridge_name='br-int',has_traffic_filtering=True,id=e4790711-6bf9-4e86-bacd-c9e822edc6a9,network=Network(b9a20327-d2f1-4377-943b-0d2cc3a7dbd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4790711-6b')
Aug 15 19:06:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:06:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] No VIF found with MAC fa:16:3e:f2:d4:61, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:06:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-918abc6d-6816-4347-9649-cac5505101e7 req-989db4bc-0714-44a8-b59f-a0c3cdecf445 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Received event network-vif-plugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:06:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-918abc6d-6816-4347-9649-cac5505101e7 req-989db4bc-0714-44a8-b59f-a0c3cdecf445 service nova] Acquiring lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-918abc6d-6816-4347-9649-cac5505101e7 req-989db4bc-0714-44a8-b59f-a0c3cdecf445 service nova] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-918abc6d-6816-4347-9649-cac5505101e7 req-989db4bc-0714-44a8-b59f-a0c3cdecf445 service nova] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-918abc6d-6816-4347-9649-cac5505101e7 req-989db4bc-0714-44a8-b59f-a0c3cdecf445 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] No waiting events found dispatching network-vif-plugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:06:35 user nova-compute[73188]: WARNING nova.compute.manager [req-918abc6d-6816-4347-9649-cac5505101e7 req-989db4bc-0714-44a8-b59f-a0c3cdecf445 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Received unexpected event network-vif-plugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 for instance with vm_state building and task_state spawning.
Aug 15 19:06:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:37 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126397.072513, fd74b385-fcfa-4a38-b869-0f5a8328188c => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:06:37 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] VM Resumed (Lifecycle Event)
Aug 15 19:06:37 user nova-compute[73188]: DEBUG nova.compute.manager [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:06:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:06:37 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Instance spawned successfully.
Aug 15 19:06:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:06:37 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:06:37 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:06:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:06:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:06:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:06:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:06:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:06:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:06:37 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:06:37 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126397.0741107, fd74b385-fcfa-4a38-b869-0f5a8328188c => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:06:37 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] VM Started (Lifecycle Event)
Aug 15 19:06:37 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:06:37 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:06:37 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:06:37 user nova-compute[73188]: DEBUG nova.compute.manager [req-319b9482-0dab-4f17-a81f-399ef5e7a791 req-be6df279-196b-4e3a-b57a-728bcde6b142 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Received event network-vif-plugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:06:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-319b9482-0dab-4f17-a81f-399ef5e7a791 req-be6df279-196b-4e3a-b57a-728bcde6b142 service nova] Acquiring lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-319b9482-0dab-4f17-a81f-399ef5e7a791 req-be6df279-196b-4e3a-b57a-728bcde6b142 service nova] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-319b9482-0dab-4f17-a81f-399ef5e7a791 req-be6df279-196b-4e3a-b57a-728bcde6b142 service nova] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:37 user nova-compute[73188]: DEBUG nova.compute.manager [req-319b9482-0dab-4f17-a81f-399ef5e7a791 req-be6df279-196b-4e3a-b57a-728bcde6b142 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] No waiting events found dispatching network-vif-plugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:06:37 user nova-compute[73188]: WARNING nova.compute.manager [req-319b9482-0dab-4f17-a81f-399ef5e7a791 req-be6df279-196b-4e3a-b57a-728bcde6b142 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Received unexpected event network-vif-plugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 for instance with vm_state building and task_state spawning.
Aug 15 19:06:37 user nova-compute[73188]: INFO nova.compute.manager [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Took 6.19 seconds to spawn the instance on the hypervisor.
Aug 15 19:06:37 user nova-compute[73188]: DEBUG nova.compute.manager [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:06:37 user nova-compute[73188]: INFO nova.compute.manager [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Took 18.84 seconds to build instance.
Aug 15 19:06:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-890cff0a-93b3-4d05-93d8-176dd08bb723 tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.015s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:06:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:06:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:06:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:06:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:53 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:06:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:06:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:06:53 user nova-compute[73188]: INFO nova.compute.claims [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Claim successful on node user
Aug 15 19:06:54 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:06:54 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:06:54 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:06:54 user nova-compute[73188]: INFO nova.virt.block_device [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Booting with volume a2ab6393-d020-4b11-8272-837dac22413c at /dev/vda
Aug 15 19:06:54 user nova-compute[73188]: DEBUG os_brick.utils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[326e9834-39da-40c5-b1f4-1dae3c885b11]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG nova.policy [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e174da762209454a8cab943a1bc8e010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0915a1c5e7e14afe8831b426b42d0d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[895f60af-26ac-463e-a2c8-c2d53bae37da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a949b9-a5ac-495b-9bd9-8aa38c874d87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4977c4f8-2499-4e09-a2ed-e2ccd004fa36]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:06:54 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:06:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e18438a-f792-4fbe-828b-05e8a164032f]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG os_brick.utils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:06:54 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Updating existing volume attachment record: a591920a-9b0f-4177-bf56-e805d4ba1ea0 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:06:55 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Successfully created port: f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:06:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "deb3ccb4-136f-4873-959d-edecdc436291" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:55 user nova-compute[73188]: DEBUG nova.compute.manager [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:06:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:06:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:06:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:06:55 user nova-compute[73188]: INFO nova.compute.claims [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Claim successful on node user
Aug 15 19:06:55 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Successfully created port: 6bdc6fd6-8a71-4118-b8ed-164cc4315200 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:06:55 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:06:55 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG nova.compute.manager [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG nova.compute.manager [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:06:56 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:06:56 user nova-compute[73188]: DEBUG nova.compute.manager [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:06:56 user nova-compute[73188]: INFO nova.virt.block_device [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Booting with volume a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 at /dev/vda
Aug 15 19:06:56 user nova-compute[73188]: DEBUG os_brick.utils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d732531a-7f99-4da0-ae83-f06dd47f8167]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c592f265-8ead-4555-bc8c-ead6d93ed51b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f51673d-c300-41bf-9cdf-d2f6eb841688]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[603adef0-e278-4886-ab53-3e39efc893fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:06:56 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:06:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b24aa9-424d-4ed0-aa33-f59557f81ea1]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG os_brick.utils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Updating existing volume attachment record: 36478f8f-c63e-4314-b921-8f3920227f4c {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG nova.policy [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0d1232acc0d4041872c5ee40b4c826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df3ab2300ae46699d4d309268f83415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:06:56 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Successfully created port: 3cab9f9c-aa69-41e1-b2b1-1397b068fb0f {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:06:58 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Successfully created port: 76516ed7-f500-4002-9ea5-14cb411ef40e {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:06:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:06:58 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Successfully created port: 38f2e9d4-a1e3-4d92-a45c-114c4dcb5920 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:06:59 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Successfully created port: 59186294-47fd-4da4-8961-419b39b16970 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:07:00 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Successfully created port: 95cc8c62-5790-417a-bc3f-ebf4028f99e3 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:07:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:00 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Successfully created port: b570288f-2a5e-422e-a42f-20acf7269946 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:07:01 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Successfully updated port: f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:07:01 user nova-compute[73188]: DEBUG nova.compute.manager [req-01c60695-72df-4af4-8e03-c68b92cdd22f req-d40934d0-3ebf-46ac-af06-affa9cde026b service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-changed-f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:01 user nova-compute[73188]: DEBUG nova.compute.manager [req-01c60695-72df-4af4-8e03-c68b92cdd22f req-d40934d0-3ebf-46ac-af06-affa9cde026b service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Refreshing instance network info cache due to event network-changed-f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:07:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-01c60695-72df-4af4-8e03-c68b92cdd22f req-d40934d0-3ebf-46ac-af06-affa9cde026b service nova] Acquiring lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-01c60695-72df-4af4-8e03-c68b92cdd22f req-d40934d0-3ebf-46ac-af06-affa9cde026b service nova] Acquired lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:01 user nova-compute[73188]: DEBUG nova.network.neutron [req-01c60695-72df-4af4-8e03-c68b92cdd22f req-d40934d0-3ebf-46ac-af06-affa9cde026b service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Refreshing network info cache for port f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:07:01 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Successfully created port: b6171fcf-6d3c-4e00-b032-e62467a9ff71 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:07:01 user nova-compute[73188]: DEBUG nova.network.neutron [req-01c60695-72df-4af4-8e03-c68b92cdd22f req-d40934d0-3ebf-46ac-af06-affa9cde026b service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:07:02 user nova-compute[73188]: DEBUG nova.network.neutron [req-01c60695-72df-4af4-8e03-c68b92cdd22f req-d40934d0-3ebf-46ac-af06-affa9cde026b service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-01c60695-72df-4af4-8e03-c68b92cdd22f req-d40934d0-3ebf-46ac-af06-affa9cde026b service nova] Releasing lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:03 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Successfully created port: 4e53f593-c9c9-478d-bc1b-f0315d8eb2a5 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:07:03 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Successfully updated port: dab59fd7-0d18-4dd9-88f2-27b156f957c4 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:07:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:03 user nova-compute[73188]: DEBUG nova.compute.manager [req-baa90526-e328-418a-8d67-2f7fc8aa0d31 req-0cb267c5-bd75-4143-b551-37347a73d4cb service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-changed-dab59fd7-0d18-4dd9-88f2-27b156f957c4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:03 user nova-compute[73188]: DEBUG nova.compute.manager [req-baa90526-e328-418a-8d67-2f7fc8aa0d31 req-0cb267c5-bd75-4143-b551-37347a73d4cb service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Refreshing instance network info cache due to event network-changed-dab59fd7-0d18-4dd9-88f2-27b156f957c4. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:07:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-baa90526-e328-418a-8d67-2f7fc8aa0d31 req-0cb267c5-bd75-4143-b551-37347a73d4cb service nova] Acquiring lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-baa90526-e328-418a-8d67-2f7fc8aa0d31 req-0cb267c5-bd75-4143-b551-37347a73d4cb service nova] Acquired lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:03 user nova-compute[73188]: DEBUG nova.network.neutron [req-baa90526-e328-418a-8d67-2f7fc8aa0d31 req-0cb267c5-bd75-4143-b551-37347a73d4cb service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Refreshing network info cache for port dab59fd7-0d18-4dd9-88f2-27b156f957c4 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:07:03 user nova-compute[73188]: DEBUG nova.network.neutron [req-baa90526-e328-418a-8d67-2f7fc8aa0d31 req-0cb267c5-bd75-4143-b551-37347a73d4cb service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:07:03 user nova-compute[73188]: INFO nova.virt.block_device [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Booting with volume ae554626-7b3b-410b-9fca-505913bf4133 at /dev/vdb
Aug 15 19:07:03 user nova-compute[73188]: DEBUG nova.network.neutron [req-baa90526-e328-418a-8d67-2f7fc8aa0d31 req-0cb267c5-bd75-4143-b551-37347a73d4cb service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-baa90526-e328-418a-8d67-2f7fc8aa0d31 req-0cb267c5-bd75-4143-b551-37347a73d4cb service nova] Releasing lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG os_brick.utils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c9bb2d-0522-4f21-a21f-f5dace28984a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3c6de4-6b2a-489f-8c96-d9f14f32ceb5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8086cc6f-a43f-4d84-8f98-631200ac8437]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9c5be3-c3f6-46c3-b9bf-09cb2e9ce648]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:07:04 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:07:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[812c114c-bb8f-46c9-81a5-d11fb06a2aad]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG os_brick.utils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Updating existing volume attachment record: 2ad2896a-744b-4d03-9b73-b22fa9f4608b {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:07:04 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Successfully updated port: 76516ed7-f500-4002-9ea5-14cb411ef40e {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:07:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:07:05 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Successfully updated port: 00607676-9218-41f8-945f-8c4ed6834882 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:07:05 user nova-compute[73188]: INFO nova.compute.manager [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] instance snapshotting
Aug 15 19:07:05 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Beginning live snapshot process
Aug 15 19:07:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json -f qcow2 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json -f qcow2 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:05 user nova-compute[73188]: DEBUG nova.compute.manager [req-e648b4a4-993e-4a43-a92d-23d48ff0f371 req-949f74fa-2917-4470-a6f5-2cec7c71cd8f service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-changed-76516ed7-f500-4002-9ea5-14cb411ef40e {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:05 user nova-compute[73188]: DEBUG nova.compute.manager [req-e648b4a4-993e-4a43-a92d-23d48ff0f371 req-949f74fa-2917-4470-a6f5-2cec7c71cd8f service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Refreshing instance network info cache due to event network-changed-76516ed7-f500-4002-9ea5-14cb411ef40e. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:07:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e648b4a4-993e-4a43-a92d-23d48ff0f371 req-949f74fa-2917-4470-a6f5-2cec7c71cd8f service nova] Acquiring lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e648b4a4-993e-4a43-a92d-23d48ff0f371 req-949f74fa-2917-4470-a6f5-2cec7c71cd8f service nova] Acquired lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:05 user nova-compute[73188]: DEBUG nova.network.neutron [req-e648b4a4-993e-4a43-a92d-23d48ff0f371 req-949f74fa-2917-4470-a6f5-2cec7c71cd8f service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Refreshing network info cache for port 76516ed7-f500-4002-9ea5-14cb411ef40e {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:07:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:05 user nova-compute[73188]: DEBUG nova.network.neutron [req-e648b4a4-993e-4a43-a92d-23d48ff0f371 req-949f74fa-2917-4470-a6f5-2cec7c71cd8f service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:07:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.197s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzt3v70xa/75d31f18e3654ec8a4218bd8c007553c.delta 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG nova.network.neutron [req-e648b4a4-993e-4a43-a92d-23d48ff0f371 req-949f74fa-2917-4470-a6f5-2cec7c71cd8f service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzt3v70xa/75d31f18e3654ec8a4218bd8c007553c.delta 1073741824" returned: 0 in 0.060s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:06 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 19:07:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e648b4a4-993e-4a43-a92d-23d48ff0f371 req-949f74fa-2917-4470-a6f5-2cec7c71cd8f service nova] Releasing lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG nova.compute.manager [req-e648b4a4-993e-4a43-a92d-23d48ff0f371 req-949f74fa-2917-4470-a6f5-2cec7c71cd8f service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-changed-00607676-9218-41f8-945f-8c4ed6834882 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG nova.compute.manager [req-e648b4a4-993e-4a43-a92d-23d48ff0f371 req-949f74fa-2917-4470-a6f5-2cec7c71cd8f service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Refreshing instance network info cache due to event network-changed-00607676-9218-41f8-945f-8c4ed6834882. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e648b4a4-993e-4a43-a92d-23d48ff0f371 req-949f74fa-2917-4470-a6f5-2cec7c71cd8f service nova] Acquiring lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e648b4a4-993e-4a43-a92d-23d48ff0f371 req-949f74fa-2917-4470-a6f5-2cec7c71cd8f service nova] Acquired lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG nova.network.neutron [req-e648b4a4-993e-4a43-a92d-23d48ff0f371 req-949f74fa-2917-4470-a6f5-2cec7c71cd8f service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Refreshing network info cache for port 00607676-9218-41f8-945f-8c4ed6834882 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73188) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 15 19:07:06 user nova-compute[73188]: INFO nova.virt.libvirt.host [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] UEFI support detected
Aug 15 19:07:06 user nova-compute[73188]: INFO nova.virt.block_device [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Booting with volume e5cc80c9-2627-41d5-b417-df4d88cc657d at /dev/vdb
Aug 15 19:07:06 user nova-compute[73188]: DEBUG os_brick.utils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG nova.network.neutron [req-e648b4a4-993e-4a43-a92d-23d48ff0f371 req-949f74fa-2917-4470-a6f5-2cec7c71cd8f service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[293d19ee-a8a7-4a60-8514-711aa0e9a12f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecd3210-14da-46b8-aa85-9f5ddbe1b792]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bb08ad-63dd-4b0e-ad46-d5805a0355ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[603d476e-d3dd-4e17-bfb8-b5566618a97e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:07:06 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:07:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fff2ab8-4727-41be-b979-eecab6159149]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG os_brick.utils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Updating existing volume attachment record: 0e901a70-34fa-4055-aa9f-fc7213af58c9 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG nova.network.neutron [req-e648b4a4-993e-4a43-a92d-23d48ff0f371 req-949f74fa-2917-4470-a6f5-2cec7c71cd8f service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e648b4a4-993e-4a43-a92d-23d48ff0f371 req-949f74fa-2917-4470-a6f5-2cec7c71cd8f service nova] Releasing lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Successfully updated port: c169fd9d-21c0-4104-af83-51ee360612b5 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:07:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73188) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 19:07:07 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Successfully updated port: 6bdc6fd6-8a71-4118-b8ed-164cc4315200 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:07:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] COPY block job progress, current cursor: 75497471 final cursor: 75497472 {{(pid=73188) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 19:07:07 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Successfully updated port: 9a3682d0-74e3-46c7-89cc-bc90a5da8de0 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:07:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73188) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 19:07:07 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 19:07:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-changed-c169fd9d-21c0-4104-af83-51ee360612b5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Refreshing instance network info cache due to event network-changed-c169fd9d-21c0-4104-af83-51ee360612b5. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:07:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] Acquiring lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] Acquired lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:07 user nova-compute[73188]: DEBUG nova.network.neutron [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Refreshing network info cache for port c169fd9d-21c0-4104-af83-51ee360612b5 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:07:07 user nova-compute[73188]: DEBUG nova.privsep.utils [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73188) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 19:07:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzt3v70xa/75d31f18e3654ec8a4218bd8c007553c.delta /opt/stack/data/nova/instances/snapshots/tmpzt3v70xa/75d31f18e3654ec8a4218bd8c007553c {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:07 user nova-compute[73188]: DEBUG nova.network.neutron [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:07:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzt3v70xa/75d31f18e3654ec8a4218bd8c007553c.delta /opt/stack/data/nova/instances/snapshots/tmpzt3v70xa/75d31f18e3654ec8a4218bd8c007553c" returned: 0 in 0.474s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:08 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Snapshot extracted, beginning image upload
Aug 15 19:07:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:08 user nova-compute[73188]: DEBUG nova.network.neutron [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] Releasing lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-changed-6bdc6fd6-8a71-4118-b8ed-164cc4315200 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Refreshing instance network info cache due to event network-changed-6bdc6fd6-8a71-4118-b8ed-164cc4315200. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:07:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] Acquiring lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] Acquired lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:08 user nova-compute[73188]: DEBUG nova.network.neutron [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Refreshing network info cache for port 6bdc6fd6-8a71-4118-b8ed-164cc4315200 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:07:08 user nova-compute[73188]: DEBUG nova.network.neutron [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:07:08 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Successfully updated port: 3cab9f9c-aa69-41e1-b2b1-1397b068fb0f {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:07:08 user nova-compute[73188]: DEBUG nova.network.neutron [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] Releasing lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-changed-9a3682d0-74e3-46c7-89cc-bc90a5da8de0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Refreshing instance network info cache due to event network-changed-9a3682d0-74e3-46c7-89cc-bc90a5da8de0. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:07:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] Acquiring lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] Acquired lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:08 user nova-compute[73188]: DEBUG nova.network.neutron [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Refreshing network info cache for port 9a3682d0-74e3-46c7-89cc-bc90a5da8de0 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:07:08 user nova-compute[73188]: DEBUG nova.network.neutron [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:07:09 user nova-compute[73188]: DEBUG nova.network.neutron [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5fe4b140-4699-418b-bd3f-066f9758aa60 req-40f73e1b-43ed-46ca-b0d5-e3be98b76bf1 service nova] Releasing lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:09 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:07:09 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Successfully updated port: 59186294-47fd-4da4-8961-419b39b16970 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:07:09 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:07:09 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:07:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:09 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:07:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-46df80cb-3503-4fb2-bb17-6824ac7feb97 req-534de1cc-59c2-46ce-b87f-3b1947ce4edf service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-changed-3cab9f9c-aa69-41e1-b2b1-1397b068fb0f {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-46df80cb-3503-4fb2-bb17-6824ac7feb97 req-534de1cc-59c2-46ce-b87f-3b1947ce4edf service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Refreshing instance network info cache due to event network-changed-3cab9f9c-aa69-41e1-b2b1-1397b068fb0f. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:07:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-46df80cb-3503-4fb2-bb17-6824ac7feb97 req-534de1cc-59c2-46ce-b87f-3b1947ce4edf service nova] Acquiring lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-46df80cb-3503-4fb2-bb17-6824ac7feb97 req-534de1cc-59c2-46ce-b87f-3b1947ce4edf service nova] Acquired lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:09 user nova-compute[73188]: DEBUG nova.network.neutron [req-46df80cb-3503-4fb2-bb17-6824ac7feb97 req-534de1cc-59c2-46ce-b87f-3b1947ce4edf service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Refreshing network info cache for port 3cab9f9c-aa69-41e1-b2b1-1397b068fb0f {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG nova.network.neutron [req-46df80cb-3503-4fb2-bb17-6824ac7feb97 req-534de1cc-59c2-46ce-b87f-3b1947ce4edf service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG nova.network.neutron [req-46df80cb-3503-4fb2-bb17-6824ac7feb97 req-534de1cc-59c2-46ce-b87f-3b1947ce4edf service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-46df80cb-3503-4fb2-bb17-6824ac7feb97 req-534de1cc-59c2-46ce-b87f-3b1947ce4edf service nova] Releasing lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG nova.compute.manager [req-46df80cb-3503-4fb2-bb17-6824ac7feb97 req-534de1cc-59c2-46ce-b87f-3b1947ce4edf service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-changed-59186294-47fd-4da4-8961-419b39b16970 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG nova.compute.manager [req-46df80cb-3503-4fb2-bb17-6824ac7feb97 req-534de1cc-59c2-46ce-b87f-3b1947ce4edf service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Refreshing instance network info cache due to event network-changed-59186294-47fd-4da4-8961-419b39b16970. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-46df80cb-3503-4fb2-bb17-6824ac7feb97 req-534de1cc-59c2-46ce-b87f-3b1947ce4edf service nova] Acquiring lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-46df80cb-3503-4fb2-bb17-6824ac7feb97 req-534de1cc-59c2-46ce-b87f-3b1947ce4edf service nova] Acquired lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG nova.network.neutron [req-46df80cb-3503-4fb2-bb17-6824ac7feb97 req-534de1cc-59c2-46ce-b87f-3b1947ce4edf service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Refreshing network info cache for port 59186294-47fd-4da4-8961-419b39b16970 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Updating instance_info_cache with network_info: [{"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG nova.network.neutron [req-46df80cb-3503-4fb2-bb17-6824ac7feb97 req-534de1cc-59c2-46ce-b87f-3b1947ce4edf service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:07:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:11 user nova-compute[73188]: DEBUG nova.network.neutron [req-46df80cb-3503-4fb2-bb17-6824ac7feb97 req-534de1cc-59c2-46ce-b87f-3b1947ce4edf service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-46df80cb-3503-4fb2-bb17-6824ac7feb97 req-534de1cc-59c2-46ce-b87f-3b1947ce4edf service nova] Releasing lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:11 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Snapshot image upload complete
Aug 15 19:07:11 user nova-compute[73188]: INFO nova.compute.manager [None req-6a1450c9-ab87-4349-a414-66457ee80bdb tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Took 6.45 seconds to snapshot the instance on the hypervisor.
Aug 15 19:07:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:11 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Successfully updated port: 38f2e9d4-a1e3-4d92-a45c-114c4dcb5920 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:07:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-fb3598dc-6706-4f33-b427-0ed3b216235c req-fa6db7a2-e642-4a84-9828-20e34b94d831 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-changed-38f2e9d4-a1e3-4d92-a45c-114c4dcb5920 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-fb3598dc-6706-4f33-b427-0ed3b216235c req-fa6db7a2-e642-4a84-9828-20e34b94d831 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Refreshing instance network info cache due to event network-changed-38f2e9d4-a1e3-4d92-a45c-114c4dcb5920. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:07:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fb3598dc-6706-4f33-b427-0ed3b216235c req-fa6db7a2-e642-4a84-9828-20e34b94d831 service nova] Acquiring lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fb3598dc-6706-4f33-b427-0ed3b216235c req-fa6db7a2-e642-4a84-9828-20e34b94d831 service nova] Acquired lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:11 user nova-compute[73188]: DEBUG nova.network.neutron [req-fb3598dc-6706-4f33-b427-0ed3b216235c req-fa6db7a2-e642-4a84-9828-20e34b94d831 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Refreshing network info cache for port 38f2e9d4-a1e3-4d92-a45c-114c4dcb5920 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:07:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:12 user nova-compute[73188]: DEBUG nova.network.neutron [req-fb3598dc-6706-4f33-b427-0ed3b216235c req-fa6db7a2-e642-4a84-9828-20e34b94d831 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:07:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:12 user nova-compute[73188]: DEBUG nova.network.neutron [req-fb3598dc-6706-4f33-b427-0ed3b216235c req-fa6db7a2-e642-4a84-9828-20e34b94d831 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fb3598dc-6706-4f33-b427-0ed3b216235c req-fa6db7a2-e642-4a84-9828-20e34b94d831 service nova] Releasing lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:12 user nova-compute[73188]: DEBUG nova.compute.manager [req-e634fcb3-8bf1-4126-ab35-d8791a43994c req-34d89f42-cbb4-48d4-906a-1aa77f665cfe service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received event network-changed-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:12 user nova-compute[73188]: DEBUG nova.compute.manager [req-e634fcb3-8bf1-4126-ab35-d8791a43994c req-34d89f42-cbb4-48d4-906a-1aa77f665cfe service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Refreshing instance network info cache due to event network-changed-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:07:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e634fcb3-8bf1-4126-ab35-d8791a43994c req-34d89f42-cbb4-48d4-906a-1aa77f665cfe service nova] Acquiring lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e634fcb3-8bf1-4126-ab35-d8791a43994c req-34d89f42-cbb4-48d4-906a-1aa77f665cfe service nova] Acquired lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:12 user nova-compute[73188]: DEBUG nova.network.neutron [req-e634fcb3-8bf1-4126-ab35-d8791a43994c req-34d89f42-cbb4-48d4-906a-1aa77f665cfe service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Refreshing network info cache for port d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:07:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:12 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Successfully updated port: b570288f-2a5e-422e-a42f-20acf7269946 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:07:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:13 user nova-compute[73188]: DEBUG nova.network.neutron [req-e634fcb3-8bf1-4126-ab35-d8791a43994c req-34d89f42-cbb4-48d4-906a-1aa77f665cfe service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Updated VIF entry in instance network info cache for port d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:07:13 user nova-compute[73188]: DEBUG nova.network.neutron [req-e634fcb3-8bf1-4126-ab35-d8791a43994c req-34d89f42-cbb4-48d4-906a-1aa77f665cfe service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Updating instance_info_cache with network_info: [{"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e634fcb3-8bf1-4126-ab35-d8791a43994c req-34d89f42-cbb4-48d4-906a-1aa77f665cfe service nova] Releasing lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:07:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:13 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Successfully updated port: 95cc8c62-5790-417a-bc3f-ebf4028f99e3 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:07:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Acquiring lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Acquired lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:13 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:07:13 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:07:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:14 user nova-compute[73188]: DEBUG nova.compute.manager [req-f958d396-6646-4503-87a6-e8abc0747c2a req-3eaad11a-070d-4c76-8961-887c54838f47 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-changed-b570288f-2a5e-422e-a42f-20acf7269946 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:14 user nova-compute[73188]: DEBUG nova.compute.manager [req-f958d396-6646-4503-87a6-e8abc0747c2a req-3eaad11a-070d-4c76-8961-887c54838f47 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Refreshing instance network info cache due to event network-changed-b570288f-2a5e-422e-a42f-20acf7269946. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:07:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f958d396-6646-4503-87a6-e8abc0747c2a req-3eaad11a-070d-4c76-8961-887c54838f47 service nova] Acquiring lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f958d396-6646-4503-87a6-e8abc0747c2a req-3eaad11a-070d-4c76-8961-887c54838f47 service nova] Acquired lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:14 user nova-compute[73188]: DEBUG nova.network.neutron [req-f958d396-6646-4503-87a6-e8abc0747c2a req-3eaad11a-070d-4c76-8961-887c54838f47 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Refreshing network info cache for port b570288f-2a5e-422e-a42f-20acf7269946 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:07:14 user nova-compute[73188]: DEBUG nova.network.neutron [req-f958d396-6646-4503-87a6-e8abc0747c2a req-3eaad11a-070d-4c76-8961-887c54838f47 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:07:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:14 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Successfully updated port: b6171fcf-6d3c-4e00-b032-e62467a9ff71 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:07:14 user nova-compute[73188]: DEBUG nova.network.neutron [req-f958d396-6646-4503-87a6-e8abc0747c2a req-3eaad11a-070d-4c76-8961-887c54838f47 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f958d396-6646-4503-87a6-e8abc0747c2a req-3eaad11a-070d-4c76-8961-887c54838f47 service nova] Releasing lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:14 user nova-compute[73188]: DEBUG nova.compute.manager [req-f958d396-6646-4503-87a6-e8abc0747c2a req-3eaad11a-070d-4c76-8961-887c54838f47 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-changed-95cc8c62-5790-417a-bc3f-ebf4028f99e3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:14 user nova-compute[73188]: DEBUG nova.compute.manager [req-f958d396-6646-4503-87a6-e8abc0747c2a req-3eaad11a-070d-4c76-8961-887c54838f47 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Refreshing instance network info cache due to event network-changed-95cc8c62-5790-417a-bc3f-ebf4028f99e3. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:07:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f958d396-6646-4503-87a6-e8abc0747c2a req-3eaad11a-070d-4c76-8961-887c54838f47 service nova] Acquiring lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Acquiring lock "588767b7-fc11-4c92-9404-cf1333b53748" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "588767b7-fc11-4c92-9404-cf1333b53748" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:14 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:07:14 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:07:14 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=7168MB free_disk=25.610393524169922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:07:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 588767b7-fc11-4c92-9404-cf1333b53748 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 7caf434b-1484-4832-afee-0e2454bb5089 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance dad06110-8c8a-432a-91d5-8d1b840b26ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance deb3ccb4-136f-4873-959d-edecdc436291 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance d1b5f5bf-9672-40a8-83da-3a8f25007e91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance c3ca002b-c535-4b87-8d39-861ce6847f12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 0d5df01f-2a14-423a-9872-69132a3874ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e8b88f49-7f48-4170-af8a-aa1de706f218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 069eb3a9-59dc-45aa-a664-712ebbbad7e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance fd74b385-fcfa-4a38-b869-0f5a8328188c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:15 user nova-compute[73188]: INFO nova.virt.block_device [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Booting with volume 804d1e95-bd0e-4563-a254-f31e66fa0b1f at /dev/vdc
Aug 15 19:07:15 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG os_brick.utils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.563s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65cf42b-860a-4a70-9d5d-d621aed2f673]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.432s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:07:15 user nova-compute[73188]: INFO nova.compute.claims [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Claim successful on node user
Aug 15 19:07:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf4afb9-ccc1-471c-b658-284d2f22f7e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e11f158-7af5-4f4e-9513-8380c97e812e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3539be4c-c4d2-44c6-b5d9-713adc513d08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:07:15 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:07:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[457ec096-90ea-4931-8391-3794933dde86]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG os_brick.utils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Updating existing volume attachment record: be672b4f-e7de-4d56-a012-991246fb38c9 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:07:15 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG nova.compute.manager [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG nova.compute.manager [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG nova.network.neutron [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:07:16 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:07:16 user nova-compute[73188]: DEBUG nova.compute.manager [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG nova.compute.manager [req-d433eec2-3689-4e77-81fb-8ce884f1d996 req-8771fe9b-ecb3-4eeb-bb2a-0bcf4037a685 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-changed-b6171fcf-6d3c-4e00-b032-e62467a9ff71 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG nova.compute.manager [req-d433eec2-3689-4e77-81fb-8ce884f1d996 req-8771fe9b-ecb3-4eeb-bb2a-0bcf4037a685 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Refreshing instance network info cache due to event network-changed-b6171fcf-6d3c-4e00-b032-e62467a9ff71. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d433eec2-3689-4e77-81fb-8ce884f1d996 req-8771fe9b-ecb3-4eeb-bb2a-0bcf4037a685 service nova] Acquiring lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d433eec2-3689-4e77-81fb-8ce884f1d996 req-8771fe9b-ecb3-4eeb-bb2a-0bcf4037a685 service nova] Acquired lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG nova.network.neutron [req-d433eec2-3689-4e77-81fb-8ce884f1d996 req-8771fe9b-ecb3-4eeb-bb2a-0bcf4037a685 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Refreshing network info cache for port b6171fcf-6d3c-4e00-b032-e62467a9ff71 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG nova.compute.manager [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:07:16 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Creating image(s)
Aug 15 19:07:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Acquiring lock "/opt/stack/data/nova/instances/588767b7-fc11-4c92-9404-cf1333b53748/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "/opt/stack/data/nova/instances/588767b7-fc11-4c92-9404-cf1333b53748/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "/opt/stack/data/nova/instances/588767b7-fc11-4c92-9404-cf1333b53748/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG nova.network.neutron [req-d433eec2-3689-4e77-81fb-8ce884f1d996 req-8771fe9b-ecb3-4eeb-bb2a-0bcf4037a685 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG nova.policy [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86c870adbae94c43808f8418d9c8aebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f959aaaf0fe4406a723804e59eb47ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Successfully updated port: 4e53f593-c9c9-478d-bc1b-f0315d8eb2a5 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Acquiring lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.203s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG nova.network.neutron [req-d433eec2-3689-4e77-81fb-8ce884f1d996 req-8771fe9b-ecb3-4eeb-bb2a-0bcf4037a685 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d433eec2-3689-4e77-81fb-8ce884f1d996 req-8771fe9b-ecb3-4eeb-bb2a-0bcf4037a685 service nova] Releasing lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Acquired lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.212s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/588767b7-fc11-4c92-9404-cf1333b53748/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/588767b7-fc11-4c92-9404-cf1333b53748/disk 1073741824" returned: 0 in 0.050s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG nova.network.neutron [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Successfully created port: fc0af479-6591-486e-b7c7-bd9a9205ead9 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.198s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Checking if we can resize image /opt/stack/data/nova/instances/588767b7-fc11-4c92-9404-cf1333b53748/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:07:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/588767b7-fc11-4c92-9404-cf1333b53748/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/588767b7-fc11-4c92-9404-cf1333b53748/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Cannot resize image /opt/stack/data/nova/instances/588767b7-fc11-4c92-9404-cf1333b53748/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG nova.objects.instance [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lazy-loading 'migration_context' on Instance uuid 588767b7-fc11-4c92-9404-cf1333b53748 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Ensure instance console log exists: /opt/stack/data/nova/instances/588767b7-fc11-4c92-9404-cf1333b53748/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:17 user nova-compute[73188]: INFO nova.virt.block_device [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Booting with volume 9671649a-4f11-4f60-a64d-a0093c2d8d75 at /dev/vdc
Aug 15 19:07:17 user nova-compute[73188]: DEBUG nova.network.neutron [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Successfully updated port: fc0af479-6591-486e-b7c7-bd9a9205ead9 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG os_brick.utils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Acquiring lock "refresh_cache-588767b7-fc11-4c92-9404-cf1333b53748" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Acquired lock "refresh_cache-588767b7-fc11-4c92-9404-cf1333b53748" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG nova.network.neutron [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c97f1f-ecf8-4c2c-bc03-8514bb2fd3ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-cec870c2-c356-4396-8af3-02988acb08f7 req-75d4367e-e2c2-4ae2-928e-ab33a6e3d852 service nova] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Received event network-changed-fc0af479-6591-486e-b7c7-bd9a9205ead9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-cec870c2-c356-4396-8af3-02988acb08f7 req-75d4367e-e2c2-4ae2-928e-ab33a6e3d852 service nova] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Refreshing instance network info cache due to event network-changed-fc0af479-6591-486e-b7c7-bd9a9205ead9. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cec870c2-c356-4396-8af3-02988acb08f7 req-75d4367e-e2c2-4ae2-928e-ab33a6e3d852 service nova] Acquiring lock "refresh_cache-588767b7-fc11-4c92-9404-cf1333b53748" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[748ce4b6-d0e5-4ab8-b6d5-8eb4db992e4e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fd5081-1dfe-4d85-9195-202d4f0e1853]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca109bf-6e9e-4516-807e-6b2f5912a64e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG nova.network.neutron [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:07:17 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[03484793-0ff3-4a29-884c-19eb3356bbd1]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG os_brick.utils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Updating existing volume attachment record: 05050451-c805-4384-9990-2fc0429d4dee {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Updating instance_info_cache with network_info: [{"id": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "address": "fa:16:3e:81:58:43", "network": {"id": "788628d4-c380-4e07-8d19-602530f78430", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1614362335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af6d04-8c", "ovs_interfaceid": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "address": "fa:16:3e:8a:45:a9", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab59fd7-0d", "ovs_interfaceid": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "00607676-9218-41f8-945f-8c4ed6834882", "address": "fa:16:3e:51:84:98", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00607676-92", "ovs_interfaceid": "00607676-9218-41f8-945f-8c4ed6834882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6bdc6fd6-8a71-4118-b8ed-164cc4315200", "address": "fa:16:3e:f3:e1:e7", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bdc6fd6-8a", "ovs_interfaceid": "6bdc6fd6-8a71-4118-b8ed-164cc4315200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "address": "fa:16:3e:38:cd:12", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cab9f9c-aa", "ovs_interfaceid": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "address": "fa:16:3e:72:b0:39", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f2e9d4-a1", "ovs_interfaceid": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "address": "fa:16:3e:a3:bd:93", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc8c62-57", "ovs_interfaceid": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Releasing lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Instance network_info: |[{"id": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "address": "fa:16:3e:81:58:43", "network": {"id": "788628d4-c380-4e07-8d19-602530f78430", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1614362335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af6d04-8c", "ovs_interfaceid": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "address": "fa:16:3e:8a:45:a9", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab59fd7-0d", "ovs_interfaceid": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "00607676-9218-41f8-945f-8c4ed6834882", "address": "fa:16:3e:51:84:98", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00607676-92", "ovs_interfaceid": "00607676-9218-41f8-945f-8c4ed6834882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6bdc6fd6-8a71-4118-b8ed-164cc4315200", "address": "fa:16:3e:f3:e1:e7", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bdc6fd6-8a", "ovs_interfaceid": "6bdc6fd6-8a71-4118-b8ed-164cc4315200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "address": "fa:16:3e:38:cd:12", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cab9f9c-aa", "ovs_interfaceid": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "address": "fa:16:3e:72:b0:39", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f2e9d4-a1", "ovs_interfaceid": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "address": "fa:16:3e:a3:bd:93", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc8c62-57", "ovs_interfaceid": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f958d396-6646-4503-87a6-e8abc0747c2a req-3eaad11a-070d-4c76-8961-887c54838f47 service nova] Acquired lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:17 user nova-compute[73188]: DEBUG nova.network.neutron [req-f958d396-6646-4503-87a6-e8abc0747c2a req-3eaad11a-070d-4c76-8961-887c54838f47 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Refreshing network info cache for port 95cc8c62-5790-417a-bc3f-ebf4028f99e3 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.network.neutron [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Updating instance_info_cache with network_info: [{"id": "fc0af479-6591-486e-b7c7-bd9a9205ead9", "address": "fa:16:3e:1e:8f:5e", "network": {"id": "8c59b78f-940b-409a-a485-2ee269ef8a5f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2048234860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f959aaaf0fe4406a723804e59eb47ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0af479-65", "ovs_interfaceid": "fc0af479-6591-486e-b7c7-bd9a9205ead9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Releasing lock "refresh_cache-588767b7-fc11-4c92-9404-cf1333b53748" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.compute.manager [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Instance network_info: |[{"id": "fc0af479-6591-486e-b7c7-bd9a9205ead9", "address": "fa:16:3e:1e:8f:5e", "network": {"id": "8c59b78f-940b-409a-a485-2ee269ef8a5f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2048234860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f959aaaf0fe4406a723804e59eb47ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0af479-65", "ovs_interfaceid": "fc0af479-6591-486e-b7c7-bd9a9205ead9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cec870c2-c356-4396-8af3-02988acb08f7 req-75d4367e-e2c2-4ae2-928e-ab33a6e3d852 service nova] Acquired lock "refresh_cache-588767b7-fc11-4c92-9404-cf1333b53748" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.network.neutron [req-cec870c2-c356-4396-8af3-02988acb08f7 req-75d4367e-e2c2-4ae2-928e-ab33a6e3d852 service nova] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Refreshing network info cache for port fc0af479-6591-486e-b7c7-bd9a9205ead9 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Start _get_guest_xml network_info=[{"id": "fc0af479-6591-486e-b7c7-bd9a9205ead9", "address": "fa:16:3e:1e:8f:5e", "network": {"id": "8c59b78f-940b-409a-a485-2ee269ef8a5f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2048234860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f959aaaf0fe4406a723804e59eb47ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0af479-65", "ovs_interfaceid": "fc0af479-6591-486e-b7c7-bd9a9205ead9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:07:18 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:07:18 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1237541807',display_name='tempest-ServersNegativeTestJSON-server-1237541807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1237541807',id=12,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f959aaaf0fe4406a723804e59eb47ae',ramdisk_id='',reservation_id='r-lj6ilu3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1086586370',owner_user_name='tempest-ServersNegativeTestJSON-1086586370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:07:16Z,user_data=None,user_id='86c870adbae94c43808f8418d9c8aebd',uuid=588767b7-fc11-4c92-9404-cf1333b53748,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc0af479-6591-486e-b7c7-bd9a9205ead9", "address": "fa:16:3e:1e:8f:5e", "network": {"id": "8c59b78f-940b-409a-a485-2ee269ef8a5f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2048234860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f959aaaf0fe4406a723804e59eb47ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0af479-65", "ovs_interfaceid": "fc0af479-6591-486e-b7c7-bd9a9205ead9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Converting VIF {"id": "fc0af479-6591-486e-b7c7-bd9a9205ead9", "address": "fa:16:3e:1e:8f:5e", "network": {"id": "8c59b78f-940b-409a-a485-2ee269ef8a5f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2048234860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f959aaaf0fe4406a723804e59eb47ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0af479-65", "ovs_interfaceid": "fc0af479-6591-486e-b7c7-bd9a9205ead9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:8f:5e,bridge_name='br-int',has_traffic_filtering=True,id=fc0af479-6591-486e-b7c7-bd9a9205ead9,network=Network(8c59b78f-940b-409a-a485-2ee269ef8a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc0af479-65') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.objects.instance [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lazy-loading 'pci_devices' on Instance uuid 588767b7-fc11-4c92-9404-cf1333b53748 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.compute.manager [req-3623d056-9c52-4877-b5a6-c51258765b42 req-929b3e7a-6be7-4b82-b520-b51a7f53d085 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-changed-4e53f593-c9c9-478d-bc1b-f0315d8eb2a5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.compute.manager [req-3623d056-9c52-4877-b5a6-c51258765b42 req-929b3e7a-6be7-4b82-b520-b51a7f53d085 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Refreshing instance network info cache due to event network-changed-4e53f593-c9c9-478d-bc1b-f0315d8eb2a5. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3623d056-9c52-4877-b5a6-c51258765b42 req-929b3e7a-6be7-4b82-b520-b51a7f53d085 service nova] Acquiring lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:07:18 user nova-compute[73188]:   <uuid>588767b7-fc11-4c92-9404-cf1333b53748</uuid>
Aug 15 19:07:18 user nova-compute[73188]:   <name>instance-0000000c</name>
Aug 15 19:07:18 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:07:18 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:07:18 user nova-compute[73188]:   <metadata>
Aug 15 19:07:18 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:07:18 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:07:18 user nova-compute[73188]:       <nova:name>tempest-ServersNegativeTestJSON-server-1237541807</nova:name>
Aug 15 19:07:18 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:07:18</nova:creationTime>
Aug 15 19:07:18 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:07:18 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:07:18 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:07:18 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:07:18 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:07:18 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:07:18 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:07:18 user nova-compute[73188]:       <nova:owner>
Aug 15 19:07:18 user nova-compute[73188]:         <nova:user uuid="86c870adbae94c43808f8418d9c8aebd">tempest-ServersNegativeTestJSON-1086586370-project-member</nova:user>
Aug 15 19:07:18 user nova-compute[73188]:         <nova:project uuid="2f959aaaf0fe4406a723804e59eb47ae">tempest-ServersNegativeTestJSON-1086586370</nova:project>
Aug 15 19:07:18 user nova-compute[73188]:       </nova:owner>
Aug 15 19:07:18 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:07:18 user nova-compute[73188]:       <nova:ports>
Aug 15 19:07:18 user nova-compute[73188]:         <nova:port uuid="fc0af479-6591-486e-b7c7-bd9a9205ead9">
Aug 15 19:07:18 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 19:07:18 user nova-compute[73188]:         </nova:port>
Aug 15 19:07:18 user nova-compute[73188]:       </nova:ports>
Aug 15 19:07:18 user nova-compute[73188]:     </nova:instance>
Aug 15 19:07:18 user nova-compute[73188]:   </metadata>
Aug 15 19:07:18 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:07:18 user nova-compute[73188]:     <system>
Aug 15 19:07:18 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:07:18 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:07:18 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:07:18 user nova-compute[73188]:       <entry name="serial">588767b7-fc11-4c92-9404-cf1333b53748</entry>
Aug 15 19:07:18 user nova-compute[73188]:       <entry name="uuid">588767b7-fc11-4c92-9404-cf1333b53748</entry>
Aug 15 19:07:18 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:07:18 user nova-compute[73188]:     </system>
Aug 15 19:07:18 user nova-compute[73188]:   </sysinfo>
Aug 15 19:07:18 user nova-compute[73188]:   <os>
Aug 15 19:07:18 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:07:18 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:07:18 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:07:18 user nova-compute[73188]:   </os>
Aug 15 19:07:18 user nova-compute[73188]:   <features>
Aug 15 19:07:18 user nova-compute[73188]:     <acpi/>
Aug 15 19:07:18 user nova-compute[73188]:     <apic/>
Aug 15 19:07:18 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:07:18 user nova-compute[73188]:   </features>
Aug 15 19:07:18 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:07:18 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:07:18 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:07:18 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:07:18 user nova-compute[73188]:   </clock>
Aug 15 19:07:18 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:07:18 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:07:18 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:07:18 user nova-compute[73188]:   </cpu>
Aug 15 19:07:18 user nova-compute[73188]:   <devices>
Aug 15 19:07:18 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:07:18 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:07:18 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/588767b7-fc11-4c92-9404-cf1333b53748/disk"/>
Aug 15 19:07:18 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:07:18 user nova-compute[73188]:     </disk>
Aug 15 19:07:18 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:07:18 user nova-compute[73188]:       <mac address="fa:16:3e:1e:8f:5e"/>
Aug 15 19:07:18 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:07:18 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:07:18 user nova-compute[73188]:       <target dev="tapfc0af479-65"/>
Aug 15 19:07:18 user nova-compute[73188]:     </interface>
Aug 15 19:07:18 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:07:18 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/588767b7-fc11-4c92-9404-cf1333b53748/console.log" append="off"/>
Aug 15 19:07:18 user nova-compute[73188]:     </serial>
Aug 15 19:07:18 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:07:18 user nova-compute[73188]:     <video>
Aug 15 19:07:18 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:07:18 user nova-compute[73188]:     </video>
Aug 15 19:07:18 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:07:18 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:07:18 user nova-compute[73188]:     </rng>
Aug 15 19:07:18 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:07:18 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:07:18 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:07:18 user nova-compute[73188]:     </memballoon>
Aug 15 19:07:18 user nova-compute[73188]:   </devices>
Aug 15 19:07:18 user nova-compute[73188]: </domain>
Aug 15 19:07:18 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1237541807',display_name='tempest-ServersNegativeTestJSON-server-1237541807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1237541807',id=12,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f959aaaf0fe4406a723804e59eb47ae',ramdisk_id='',reservation_id='r-lj6ilu3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1086586370',owner_user_name='tempest-ServersNegativeTestJSON-1086586370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:07:16Z,user_data=None,user_id='86c870adbae94c43808f8418d9c8aebd',uuid=588767b7-fc11-4c92-9404-cf1333b53748,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc0af479-6591-486e-b7c7-bd9a9205ead9", "address": "fa:16:3e:1e:8f:5e", "network": {"id": "8c59b78f-940b-409a-a485-2ee269ef8a5f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2048234860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f959aaaf0fe4406a723804e59eb47ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0af479-65", "ovs_interfaceid": "fc0af479-6591-486e-b7c7-bd9a9205ead9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Converting VIF {"id": "fc0af479-6591-486e-b7c7-bd9a9205ead9", "address": "fa:16:3e:1e:8f:5e", "network": {"id": "8c59b78f-940b-409a-a485-2ee269ef8a5f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2048234860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f959aaaf0fe4406a723804e59eb47ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0af479-65", "ovs_interfaceid": "fc0af479-6591-486e-b7c7-bd9a9205ead9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:8f:5e,bridge_name='br-int',has_traffic_filtering=True,id=fc0af479-6591-486e-b7c7-bd9a9205ead9,network=Network(8c59b78f-940b-409a-a485-2ee269ef8a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc0af479-65') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG os_vif [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:8f:5e,bridge_name='br-int',has_traffic_filtering=True,id=fc0af479-6591-486e-b7c7-bd9a9205ead9,network=Network(8c59b78f-940b-409a-a485-2ee269ef8a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc0af479-65') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.network.neutron [req-f958d396-6646-4503-87a6-e8abc0747c2a req-3eaad11a-070d-4c76-8961-887c54838f47 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Updated VIF entry in instance network info cache for port 95cc8c62-5790-417a-bc3f-ebf4028f99e3. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.network.neutron [req-f958d396-6646-4503-87a6-e8abc0747c2a req-3eaad11a-070d-4c76-8961-887c54838f47 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Updating instance_info_cache with network_info: [{"id": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "address": "fa:16:3e:81:58:43", "network": {"id": "788628d4-c380-4e07-8d19-602530f78430", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1614362335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af6d04-8c", "ovs_interfaceid": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "address": "fa:16:3e:8a:45:a9", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab59fd7-0d", "ovs_interfaceid": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "00607676-9218-41f8-945f-8c4ed6834882", "address": "fa:16:3e:51:84:98", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00607676-92", "ovs_interfaceid": "00607676-9218-41f8-945f-8c4ed6834882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6bdc6fd6-8a71-4118-b8ed-164cc4315200", "address": "fa:16:3e:f3:e1:e7", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bdc6fd6-8a", "ovs_interfaceid": "6bdc6fd6-8a71-4118-b8ed-164cc4315200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "address": "fa:16:3e:38:cd:12", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cab9f9c-aa", "ovs_interfaceid": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "address": "fa:16:3e:72:b0:39", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f2e9d4-a1", "ovs_interfaceid": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "address": "fa:16:3e:a3:bd:93", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc8c62-57", "ovs_interfaceid": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc0af479-65, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc0af479-65, col_values=(('external_ids', {'iface-id': 'fc0af479-6591-486e-b7c7-bd9a9205ead9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:8f:5e', 'vm-uuid': '588767b7-fc11-4c92-9404-cf1333b53748'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f958d396-6646-4503-87a6-e8abc0747c2a req-3eaad11a-070d-4c76-8961-887c54838f47 service nova] Releasing lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:18 user nova-compute[73188]: INFO os_vif [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:8f:5e,bridge_name='br-int',has_traffic_filtering=True,id=fc0af479-6591-486e-b7c7-bd9a9205ead9,network=Network(8c59b78f-940b-409a-a485-2ee269ef8a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc0af479-65')
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] No VIF found with MAC fa:16:3e:1e:8f:5e, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.network.neutron [req-cec870c2-c356-4396-8af3-02988acb08f7 req-75d4367e-e2c2-4ae2-928e-ab33a6e3d852 service nova] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Updated VIF entry in instance network info cache for port fc0af479-6591-486e-b7c7-bd9a9205ead9. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.network.neutron [req-cec870c2-c356-4396-8af3-02988acb08f7 req-75d4367e-e2c2-4ae2-928e-ab33a6e3d852 service nova] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Updating instance_info_cache with network_info: [{"id": "fc0af479-6591-486e-b7c7-bd9a9205ead9", "address": "fa:16:3e:1e:8f:5e", "network": {"id": "8c59b78f-940b-409a-a485-2ee269ef8a5f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2048234860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f959aaaf0fe4406a723804e59eb47ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0af479-65", "ovs_interfaceid": "fc0af479-6591-486e-b7c7-bd9a9205ead9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cec870c2-c356-4396-8af3-02988acb08f7 req-75d4367e-e2c2-4ae2-928e-ab33a6e3d852 service nova] Releasing lock "refresh_cache-588767b7-fc11-4c92-9404-cf1333b53748" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Updating instance_info_cache with network_info: [{"id": "76516ed7-f500-4002-9ea5-14cb411ef40e", "address": "fa:16:3e:98:81:f4", "network": {"id": "c2d692fb-b4f7-4e5f-bc90-2de58035637b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-476302846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516ed7-f5", "ovs_interfaceid": "76516ed7-f500-4002-9ea5-14cb411ef40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c169fd9d-21c0-4104-af83-51ee360612b5", "address": "fa:16:3e:5b:5c:7e", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc169fd9d-21", "ovs_interfaceid": "c169fd9d-21c0-4104-af83-51ee360612b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "address": "fa:16:3e:05:3c:92", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a3682d0-74", "ovs_interfaceid": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "59186294-47fd-4da4-8961-419b39b16970", "address": "fa:16:3e:31:38:e2", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59186294-47", "ovs_interfaceid": "59186294-47fd-4da4-8961-419b39b16970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b570288f-2a5e-422e-a42f-20acf7269946", "address": "fa:16:3e:02:ca:a7", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb570288f-2a", "ovs_interfaceid": "b570288f-2a5e-422e-a42f-20acf7269946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "address": "fa:16:3e:a4:22:08", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6171fcf-6d", "ovs_interfaceid": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "address": "fa:16:3e:84:8d:cb", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53f593-c9", "ovs_interfaceid": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Releasing lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.compute.manager [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Instance network_info: |[{"id": "76516ed7-f500-4002-9ea5-14cb411ef40e", "address": "fa:16:3e:98:81:f4", "network": {"id": "c2d692fb-b4f7-4e5f-bc90-2de58035637b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-476302846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516ed7-f5", "ovs_interfaceid": "76516ed7-f500-4002-9ea5-14cb411ef40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c169fd9d-21c0-4104-af83-51ee360612b5", "address": "fa:16:3e:5b:5c:7e", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc169fd9d-21", "ovs_interfaceid": "c169fd9d-21c0-4104-af83-51ee360612b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "address": "fa:16:3e:05:3c:92", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a3682d0-74", "ovs_interfaceid": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "59186294-47fd-4da4-8961-419b39b16970", "address": "fa:16:3e:31:38:e2", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59186294-47", "ovs_interfaceid": "59186294-47fd-4da4-8961-419b39b16970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b570288f-2a5e-422e-a42f-20acf7269946", "address": "fa:16:3e:02:ca:a7", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb570288f-2a", "ovs_interfaceid": "b570288f-2a5e-422e-a42f-20acf7269946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "address": "fa:16:3e:a4:22:08", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6171fcf-6d", "ovs_interfaceid": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "address": "fa:16:3e:84:8d:cb", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53f593-c9", "ovs_interfaceid": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3623d056-9c52-4877-b5a6-c51258765b42 req-929b3e7a-6be7-4b82-b520-b51a7f53d085 service nova] Acquired lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:18 user nova-compute[73188]: DEBUG nova.network.neutron [req-3623d056-9c52-4877-b5a6-c51258765b42 req-929b3e7a-6be7-4b82-b520-b51a7f53d085 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Refreshing network info cache for port 4e53f593-c9c9-478d-bc1b-f0315d8eb2a5 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:07:19 user nova-compute[73188]: DEBUG nova.network.neutron [req-3623d056-9c52-4877-b5a6-c51258765b42 req-929b3e7a-6be7-4b82-b520-b51a7f53d085 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Updated VIF entry in instance network info cache for port 4e53f593-c9c9-478d-bc1b-f0315d8eb2a5. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:07:19 user nova-compute[73188]: DEBUG nova.network.neutron [req-3623d056-9c52-4877-b5a6-c51258765b42 req-929b3e7a-6be7-4b82-b520-b51a7f53d085 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Updating instance_info_cache with network_info: [{"id": "76516ed7-f500-4002-9ea5-14cb411ef40e", "address": "fa:16:3e:98:81:f4", "network": {"id": "c2d692fb-b4f7-4e5f-bc90-2de58035637b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-476302846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516ed7-f5", "ovs_interfaceid": "76516ed7-f500-4002-9ea5-14cb411ef40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c169fd9d-21c0-4104-af83-51ee360612b5", "address": "fa:16:3e:5b:5c:7e", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc169fd9d-21", "ovs_interfaceid": "c169fd9d-21c0-4104-af83-51ee360612b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "address": "fa:16:3e:05:3c:92", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a3682d0-74", "ovs_interfaceid": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "59186294-47fd-4da4-8961-419b39b16970", "address": "fa:16:3e:31:38:e2", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59186294-47", "ovs_interfaceid": "59186294-47fd-4da4-8961-419b39b16970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b570288f-2a5e-422e-a42f-20acf7269946", "address": "fa:16:3e:02:ca:a7", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb570288f-2a", "ovs_interfaceid": "b570288f-2a5e-422e-a42f-20acf7269946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "address": "fa:16:3e:a4:22:08", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6171fcf-6d", "ovs_interfaceid": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "address": "fa:16:3e:84:8d:cb", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53f593-c9", "ovs_interfaceid": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3623d056-9c52-4877-b5a6-c51258765b42 req-929b3e7a-6be7-4b82-b520-b51a7f53d085 service nova] Releasing lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:20 user nova-compute[73188]: DEBUG nova.compute.manager [req-bd781e2a-0ab1-43c8-ab9e-245e26e5f139 req-e4070842-6413-4297-829f-062a32e2ccbb service nova] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Received event network-vif-plugged-fc0af479-6591-486e-b7c7-bd9a9205ead9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-bd781e2a-0ab1-43c8-ab9e-245e26e5f139 req-e4070842-6413-4297-829f-062a32e2ccbb service nova] Acquiring lock "588767b7-fc11-4c92-9404-cf1333b53748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-bd781e2a-0ab1-43c8-ab9e-245e26e5f139 req-e4070842-6413-4297-829f-062a32e2ccbb service nova] Lock "588767b7-fc11-4c92-9404-cf1333b53748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-bd781e2a-0ab1-43c8-ab9e-245e26e5f139 req-e4070842-6413-4297-829f-062a32e2ccbb service nova] Lock "588767b7-fc11-4c92-9404-cf1333b53748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:20 user nova-compute[73188]: DEBUG nova.compute.manager [req-bd781e2a-0ab1-43c8-ab9e-245e26e5f139 req-e4070842-6413-4297-829f-062a32e2ccbb service nova] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] No waiting events found dispatching network-vif-plugged-fc0af479-6591-486e-b7c7-bd9a9205ead9 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:20 user nova-compute[73188]: WARNING nova.compute.manager [req-bd781e2a-0ab1-43c8-ab9e-245e26e5f139 req-e4070842-6413-4297-829f-062a32e2ccbb service nova] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Received unexpected event network-vif-plugged-fc0af479-6591-486e-b7c7-bd9a9205ead9 for instance with vm_state building and task_state spawning.
Aug 15 19:07:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:22 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126442.04162, 588767b7-fc11-4c92-9404-cf1333b53748 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:07:22 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] VM Resumed (Lifecycle Event)
Aug 15 19:07:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:07:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:07:22 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Instance spawned successfully.
Aug 15 19:07:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:07:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:07:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:07:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:07:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:07:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:07:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:07:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:07:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:07:22 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:07:22 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126442.0430553, 588767b7-fc11-4c92-9404-cf1333b53748 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:07:22 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] VM Started (Lifecycle Event)
Aug 15 19:07:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:07:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:07:22 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:07:22 user nova-compute[73188]: INFO nova.compute.manager [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Took 5.92 seconds to spawn the instance on the hypervisor.
Aug 15 19:07:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:07:22 user nova-compute[73188]: INFO nova.compute.manager [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Took 7.22 seconds to build instance.
Aug 15 19:07:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-68b63220-c991-4045-8053-ed891da19aa4 req-18fb4e37-a665-4728-9a35-fb7adaef1b46 service nova] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Received event network-vif-plugged-fc0af479-6591-486e-b7c7-bd9a9205ead9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-68b63220-c991-4045-8053-ed891da19aa4 req-18fb4e37-a665-4728-9a35-fb7adaef1b46 service nova] Acquiring lock "588767b7-fc11-4c92-9404-cf1333b53748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-68b63220-c991-4045-8053-ed891da19aa4 req-18fb4e37-a665-4728-9a35-fb7adaef1b46 service nova] Lock "588767b7-fc11-4c92-9404-cf1333b53748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-68b63220-c991-4045-8053-ed891da19aa4 req-18fb4e37-a665-4728-9a35-fb7adaef1b46 service nova] Lock "588767b7-fc11-4c92-9404-cf1333b53748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-68b63220-c991-4045-8053-ed891da19aa4 req-18fb4e37-a665-4728-9a35-fb7adaef1b46 service nova] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] No waiting events found dispatching network-vif-plugged-fc0af479-6591-486e-b7c7-bd9a9205ead9 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:22 user nova-compute[73188]: WARNING nova.compute.manager [req-68b63220-c991-4045-8053-ed891da19aa4 req-18fb4e37-a665-4728-9a35-fb7adaef1b46 service nova] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Received unexpected event network-vif-plugged-fc0af479-6591-486e-b7c7-bd9a9205ead9 for instance with vm_state active and task_state None.
Aug 15 19:07:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a5364fd3-7618-467e-a727-3632aedbbcd3 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "588767b7-fc11-4c92-9404-cf1333b53748" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.356s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:07:25 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Creating image(s)
Aug 15 19:07:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Did not create local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Ensure instance console log exists: /opt/stack/data/nova/instances/03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Start _get_guest_xml network_info=[{"id": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "address": "fa:16:3e:81:58:43", "network": {"id": "788628d4-c380-4e07-8d19-602530f78430", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1614362335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af6d04-8c", "ovs_interfaceid": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "address": "fa:16:3e:8a:45:a9", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab59fd7-0d", "ovs_interfaceid": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "00607676-9218-41f8-945f-8c4ed6834882", "address": "fa:16:3e:51:84:98", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00607676-92", "ovs_interfaceid": "00607676-9218-41f8-945f-8c4ed6834882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6bdc6fd6-8a71-4118-b8ed-164cc4315200", "address": "fa:16:3e:f3:e1:e7", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bdc6fd6-8a", "ovs_interfaceid": "6bdc6fd6-8a71-4118-b8ed-164cc4315200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "address": "fa:16:3e:38:cd:12", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cab9f9c-aa", "ovs_interfaceid": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "address": "fa:16:3e:72:b0:39", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f2e9d4-a1", "ovs_interfaceid": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "address": "fa:16:3e:a3:bd:93", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc8c62-57", "ovs_interfaceid": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XragvTUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b', 'attached_at': '', 'detached_at': '', 'volume_id': 'a2ab6393-d020-4b11-8272-837dac22413c', 'serial': 'a2ab6393-d020-4b11-8272-837dac22413c'}, 'attachment_id': 'a591920a-9b0f-4177-bf56-e805d4ba1ea0', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIEWTCKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae554626-7b3b-410b-9fca-505913bf4133', 'serial': 'ae554626-7b3b-410b-9fca-505913bf4133'}, 'attachment_id': '2ad2896a-744b-4d03-9b73-b22fa9f4608b', 'boot_index': 1, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZCXBQdbI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b', 'attached_at': '', 'detached_at': '', 'volume_id': '804d1e95-bd0e-4563-a254-f31e66fa0b1f', 'serial': '804d1e95-bd0e-4563-a254-f31e66fa0b1f'}, 'attachment_id': 'be672b4f-e7de-4d56-a012-991246fb38c9', 'boot_index': 2, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:07:25 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:07:25 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:07:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XragvTUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:07:25 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:07:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:07:25 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:07:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:07:25 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f796459-9351-4f9c-94be-8751477c86aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:07:25 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3342d59b-73f3-4bcf-ad40-a78160728692]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c] added
Aug 15 19:07:25 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cc5d74-7db0-4548-8326-548e64bab8c6]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7ed299-e178-4865-bc3d-c307b5887f65]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XragvTUO {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XragvTUO" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a2ca2c-8e23-473f-8232-ca35ef595a75]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XragvTUO'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[95932ee5-a39b-41fe-84f5-e084fd8ed5b0]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d31b2ff-e39c-4e75-a7a0-07ab21b1abd6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:25 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:25 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a6e7f9-920f-4993-bb47-46cdf18e25db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c, portal: 172.16.0.220,3260]
Aug 15 19:07:25 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c, portal: 172.16.0.220,3260] successful.
Aug 15 19:07:25 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:26 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b07564e-a9dd-41f0-b7ac-db8c07aa3a00]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:26 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5511c21-aedb-4fd7-916d-b75a24f0e498]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:26 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:26 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:07:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:26 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:26 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:07:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:07:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:07:26 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:07:26 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:07:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:26 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53fd67d-a145-4a1b-a596-ef6e594aae76]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:26 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:07:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XragvTUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23934303461616131', 'path': '/dev/sdc'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934303461616131', 'path': '/dev/sdc'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIEWTCKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:07:27 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:07:27 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:07:27 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fb0d3f-ea15-48b6-bb9c-989969651050]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:07:27 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d958f5-7580-4f7f-b39f-516c917b27d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133] added
Aug 15 19:07:27 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a34238-1b4b-4046-9a7f-17dcd51805d2]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be56d06-dc2a-4dca-8f7c-ff38824224d1]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIEWTCKG {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIEWTCKG" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ad8954-7061-492d-bc79-049d46d23028]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yIEWTCKG'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0b2262-e72e-4585-92a2-b9bc7857c9c2]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[84712299-ac72-4b30-9eb3-bc93ce1a365d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:27 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:27 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:27 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:27 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f77fa4-3a16-49f2-8a03-7ca58e9136f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133, portal: 172.16.0.220,3260]
Aug 15 19:07:27 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133, portal: 172.16.0.220,3260] successful.
Aug 15 19:07:27 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f2f04e-d08f-49f6-8bca-ef6f76ad24b8]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fae6753-74f9-44fc-af04-6205d489226a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:27 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:27 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:27 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:27 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:27 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:27 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d52d2c-a637-4463-a814-96bbd8f5c5e1]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:07:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIEWTCKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.compute.manager [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:07:28 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Creating image(s)
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Did not create local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Ensure instance console log exists: /opt/stack/data/nova/instances/deb3ccb4-136f-4873-959d-edecdc436291/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Start _get_guest_xml network_info=[{"id": "76516ed7-f500-4002-9ea5-14cb411ef40e", "address": "fa:16:3e:98:81:f4", "network": {"id": "c2d692fb-b4f7-4e5f-bc90-2de58035637b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-476302846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516ed7-f5", "ovs_interfaceid": "76516ed7-f500-4002-9ea5-14cb411ef40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c169fd9d-21c0-4104-af83-51ee360612b5", "address": "fa:16:3e:5b:5c:7e", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc169fd9d-21", "ovs_interfaceid": "c169fd9d-21c0-4104-af83-51ee360612b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "address": "fa:16:3e:05:3c:92", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a3682d0-74", "ovs_interfaceid": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "59186294-47fd-4da4-8961-419b39b16970", "address": "fa:16:3e:31:38:e2", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59186294-47", "ovs_interfaceid": "59186294-47fd-4da4-8961-419b39b16970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b570288f-2a5e-422e-a42f-20acf7269946", "address": "fa:16:3e:02:ca:a7", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb570288f-2a", "ovs_interfaceid": "b570288f-2a5e-422e-a42f-20acf7269946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "address": "fa:16:3e:a4:22:08", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6171fcf-6d", "ovs_interfaceid": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "address": "fa:16:3e:84:8d:cb", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53f593-c9", "ovs_interfaceid": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGykxVWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'deb3ccb4-136f-4873-959d-edecdc436291', 'attached_at': '', 'detached_at': '', 'volume_id': 'a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4', 'serial': 'a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4'}, 'attachment_id': '36478f8f-c63e-4314-b921-8f3920227f4c', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CHjalEfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'deb3ccb4-136f-4873-959d-edecdc436291', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5cc80c9-2627-41d5-b417-df4d88cc657d', 'serial': 'e5cc80c9-2627-41d5-b417-df4d88cc657d'}, 'attachment_id': '0e901a70-34fa-4055-aa9f-fc7213af58c9', 'boot_index': 1, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfcSAumY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'deb3ccb4-136f-4873-959d-edecdc436291', 'attached_at': '', 'detached_at': '', 'volume_id': '9671649a-4f11-4f60-a64d-a0093c2d8d75', 'serial': '9671649a-4f11-4f60-a64d-a0093c2d8d75'}, 'attachment_id': '05050451-c805-4384-9990-2fc0429d4dee', 'boot_index': 2, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:07:28 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:07:28 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGykxVWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:07:28 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26430386162353166', 'path': '/dev/sdd'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430386162353166', 'path': '/dev/sdd'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.125s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:07:28 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:07:28 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4800c55d-7335-480e-a438-5714fd378af9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:07:28 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZCXBQdbI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:07:28 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[badbd520-373a-42c6-a760-2104bc3c2b35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4] added
Aug 15 19:07:28 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ef083a-af41-4334-9163-1ba837035b04]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[172f1ffe-2ec9-4ae3-9499-5ad9f95aa29b]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CGykxVWQ {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CGykxVWQ" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf12759-ff5b-4db1-81ee-33486e62fc1d]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CGykxVWQ'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[08858f94-057c-4899-bb34-34cc76ec9e42]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e918922-65a5-42c4-a54e-ef325c33a8d8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:28 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:28 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:28 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:28 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:28 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:28 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06c0e1b-7c52-4da8-a163-38841eb99789]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4, portal: 172.16.0.220,3260]
Aug 15 19:07:28 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4, portal: 172.16.0.220,3260] successful.
Aug 15 19:07:28 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7da3fe-d137-4117-ae68-4c7ee994877f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea4ec00-2603-4834-ad26-324d6cd7d516]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:28 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:28 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:28 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:28 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:28 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:28 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:28 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:28 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce32948d-55c7-4a44-8dd0-bd02a34b8bb6]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:28 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGykxVWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '26535323637353837', 'path': '/dev/sde'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535323637353837', 'path': '/dev/sde'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.276s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:07:29 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:07:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:07:29 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a78b1a-cf97-483d-8f02-76585a856ee0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:07:29 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CHjalEfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:07:29 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:07:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b31cafc-0a30-4eae-acb7-2ca633b8c6aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f] added
Aug 15 19:07:29 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c316a403-9032-436b-b161-48015b079260]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f79817d-56d1-4df6-a216-9245f50af3f4]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZCXBQdbI {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZCXBQdbI" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae27522-6186-446e-8069-b43a4058ebb0]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZCXBQdbI'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35ae35e-63c9-492b-a4cf-68128f2e524e]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea0c8e7-bbfc-4690-b78b-32b567e5ba43]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:29 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:29 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:29 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:29 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:29 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:29 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:29 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:29 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e4ceee-2254-44f6-a9db-b2c78aa64076]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f, portal: 172.16.0.220,3260]
Aug 15 19:07:29 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f, portal: 172.16.0.220,3260] successful.
Aug 15 19:07:29 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf870ae-5314-4d9b-a74c-7863db143f49]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:30 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba41f405-14de-401a-867b-90b12bebd240]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:30 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:30 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:30 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:30 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:30 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:07:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:30 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:30 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:30 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:30 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:30 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:07:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:07:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:07:30 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:07:30 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:07:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:30 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0020b473-4fb9-48ad-877b-632fdc9c2732]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:30 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:07:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZCXBQdbI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:07:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] <== connect_volume: return (2609ms) {'type': 'block', 'scsi_wwn': '23533303532373032', 'path': '/dev/sdf'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533303532373032', 'path': '/dev/sdf'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.283s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:07:31 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:07:31 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3047af4e-7a00-4968-9ab3-894d5cf5ed7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:07:31 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114388087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114388087',id=10,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1idcKZ1xBbWg0gYfVVvOJ4qKeCJ/9fHvAZz/gBB7d+sI7S/Wu2WW23N0v1n+rEzVqwKc3OTOLXDu8ZE2aPLsO4i+R6405lRbPdsNEMKO6raHFlQEQsmUo+TGOLSa69uQ==',key_name='tempest-keypair-286492792',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0915a1c5e7e14afe8831b426b42d0d35',ramdisk_id='',reservation_id='r-ak0gitqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2132869133',owner_user_name='tempest-TaggedBootDevicesTest-2132869133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e174da762209454a8cab943a1bc8e010',uuid=03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "address": "fa:16:3e:81:58:43", "network": {"id": "788628d4-c380-4e07-8d19-602530f78430", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1614362335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af6d04-8c", "ovs_interfaceid": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converting VIF {"id": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "address": "fa:16:3e:81:58:43", "network": {"id": "788628d4-c380-4e07-8d19-602530f78430", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1614362335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af6d04-8c", "ovs_interfaceid": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:58:43,bridge_name='br-int',has_traffic_filtering=True,id=f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4,network=Network(788628d4-c380-4e07-8d19-602530f78430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3af6d04-8c') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114388087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114388087',id=10,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1idcKZ1xBbWg0gYfVVvOJ4qKeCJ/9fHvAZz/gBB7d+sI7S/Wu2WW23N0v1n+rEzVqwKc3OTOLXDu8ZE2aPLsO4i+R6405lRbPdsNEMKO6raHFlQEQsmUo+TGOLSa69uQ==',key_name='tempest-keypair-286492792',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0915a1c5e7e14afe8831b426b42d0d35',ramdisk_id='',reservation_id='r-ak0gitqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2132869133',owner_user_name='tempest-TaggedBootDevicesTest-2132869133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e174da762209454a8cab943a1bc8e010',uuid=03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "address": "fa:16:3e:8a:45:a9", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab59fd7-0d", "ovs_interfaceid": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converting VIF {"id": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "address": "fa:16:3e:8a:45:a9", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab59fd7-0d", "ovs_interfaceid": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:45:a9,bridge_name='br-int',has_traffic_filtering=True,id=dab59fd7-0d18-4dd9-88f2-27b156f957c4,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdab59fd7-0d') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114388087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114388087',id=10,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1idcKZ1xBbWg0gYfVVvOJ4qKeCJ/9fHvAZz/gBB7d+sI7S/Wu2WW23N0v1n+rEzVqwKc3OTOLXDu8ZE2aPLsO4i+R6405lRbPdsNEMKO6raHFlQEQsmUo+TGOLSa69uQ==',key_name='tempest-keypair-286492792',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0915a1c5e7e14afe8831b426b42d0d35',ramdisk_id='',reservation_id='r-ak0gitqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2132869133',owner_user_name='tempest-TaggedBootDevicesTest-2132869133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e174da762209454a8cab943a1bc8e010',uuid=03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00607676-9218-41f8-945f-8c4ed6834882", "address": "fa:16:3e:51:84:98", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00607676-92", "ovs_interfaceid": "00607676-9218-41f8-945f-8c4ed6834882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converting VIF {"id": "00607676-9218-41f8-945f-8c4ed6834882", "address": "fa:16:3e:51:84:98", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00607676-92", "ovs_interfaceid": "00607676-9218-41f8-945f-8c4ed6834882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:84:98,bridge_name='br-int',has_traffic_filtering=True,id=00607676-9218-41f8-945f-8c4ed6834882,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap00607676-92') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114388087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114388087',id=10,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1idcKZ1xBbWg0gYfVVvOJ4qKeCJ/9fHvAZz/gBB7d+sI7S/Wu2WW23N0v1n+rEzVqwKc3OTOLXDu8ZE2aPLsO4i+R6405lRbPdsNEMKO6raHFlQEQsmUo+TGOLSa69uQ==',key_name='tempest-keypair-286492792',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0915a1c5e7e14afe8831b426b42d0d35',ramdisk_id='',reservation_id='r-ak0gitqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2132869133',owner_user_name='tempest-TaggedBootDevicesTest-2132869133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e174da762209454a8cab943a1bc8e010',uuid=03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bdc6fd6-8a71-4118-b8ed-164cc4315200", "address": "fa:16:3e:f3:e1:e7", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bdc6fd6-8a", "ovs_interfaceid": "6bdc6fd6-8a71-4118-b8ed-164cc4315200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converting VIF {"id": "6bdc6fd6-8a71-4118-b8ed-164cc4315200", "address": "fa:16:3e:f3:e1:e7", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bdc6fd6-8a", "ovs_interfaceid": "6bdc6fd6-8a71-4118-b8ed-164cc4315200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e1:e7,bridge_name='br-int',has_traffic_filtering=True,id=6bdc6fd6-8a71-4118-b8ed-164cc4315200,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bdc6fd6-8a') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114388087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114388087',id=10,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1idcKZ1xBbWg0gYfVVvOJ4qKeCJ/9fHvAZz/gBB7d+sI7S/Wu2WW23N0v1n+rEzVqwKc3OTOLXDu8ZE2aPLsO4i+R6405lRbPdsNEMKO6raHFlQEQsmUo+TGOLSa69uQ==',key_name='tempest-keypair-286492792',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0915a1c5e7e14afe8831b426b42d0d35',ramdisk_id='',reservation_id='r-ak0gitqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2132869133',owner_user_name='tempest-TaggedBootDevicesTest-2132869133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e174da762209454a8cab943a1bc8e010',uuid=03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "address": "fa:16:3e:38:cd:12", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cab9f9c-aa", "ovs_interfaceid": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converting VIF {"id": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "address": "fa:16:3e:38:cd:12", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cab9f9c-aa", "ovs_interfaceid": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:cd:12,bridge_name='br-int',has_traffic_filtering=True,id=3cab9f9c-aa69-41e1-b2b1-1397b068fb0f,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cab9f9c-aa') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114388087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114388087',id=10,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1idcKZ1xBbWg0gYfVVvOJ4qKeCJ/9fHvAZz/gBB7d+sI7S/Wu2WW23N0v1n+rEzVqwKc3OTOLXDu8ZE2aPLsO4i+R6405lRbPdsNEMKO6raHFlQEQsmUo+TGOLSa69uQ==',key_name='tempest-keypair-286492792',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0915a1c5e7e14afe8831b426b42d0d35',ramdisk_id='',reservation_id='r-ak0gitqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2132869133',owner_user_name='tempest-TaggedBootDevicesTest-2132869133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e174da762209454a8cab943a1bc8e010',uuid=03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "address": "fa:16:3e:72:b0:39", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f2e9d4-a1", "ovs_interfaceid": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converting VIF {"id": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "address": "fa:16:3e:72:b0:39", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f2e9d4-a1", "ovs_interfaceid": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:b0:39,bridge_name='br-int',has_traffic_filtering=True,id=38f2e9d4-a1e3-4d92-a45c-114c4dcb5920,network=Network(e3585509-12cc-4551-ad46-7f06ce049df0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f2e9d4-a1') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114388087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114388087',id=10,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1idcKZ1xBbWg0gYfVVvOJ4qKeCJ/9fHvAZz/gBB7d+sI7S/Wu2WW23N0v1n+rEzVqwKc3OTOLXDu8ZE2aPLsO4i+R6405lRbPdsNEMKO6raHFlQEQsmUo+TGOLSa69uQ==',key_name='tempest-keypair-286492792',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0915a1c5e7e14afe8831b426b42d0d35',ramdisk_id='',reservation_id='r-ak0gitqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2132869133',owner_user_name='tempest-TaggedBootDevicesTest-2132869133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e174da762209454a8cab943a1bc8e010',uuid=03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "address": "fa:16:3e:a3:bd:93", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc8c62-57", "ovs_interfaceid": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converting VIF {"id": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "address": "fa:16:3e:a3:bd:93", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc8c62-57", "ovs_interfaceid": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:bd:93,bridge_name='br-int',has_traffic_filtering=True,id=95cc8c62-5790-417a-bc3f-ebf4028f99e3,network=Network(e3585509-12cc-4551-ad46-7f06ce049df0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cc8c62-57') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.objects.instance [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lazy-loading 'pci_devices' on Instance uuid 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcf3920-1bd9-4c2a-bcfa-40615e2d2d91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d] added
Aug 15 19:07:31 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:07:31 user nova-compute[73188]:   <uuid>03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b</uuid>
Aug 15 19:07:31 user nova-compute[73188]:   <name>instance-0000000a</name>
Aug 15 19:07:31 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:07:31 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:07:31 user nova-compute[73188]:   <metadata>
Aug 15 19:07:31 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:07:31 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:07:31 user nova-compute[73188]:       <nova:name>tempest-device-tagging-server-114388087</nova:name>
Aug 15 19:07:31 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:07:25</nova:creationTime>
Aug 15 19:07:31 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:07:31 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:07:31 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:07:31 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:07:31 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:07:31 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:07:31 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:07:31 user nova-compute[73188]:       <nova:owner>
Aug 15 19:07:31 user nova-compute[73188]:         <nova:user uuid="e174da762209454a8cab943a1bc8e010">tempest-TaggedBootDevicesTest-2132869133-project-member</nova:user>
Aug 15 19:07:31 user nova-compute[73188]:         <nova:project uuid="0915a1c5e7e14afe8831b426b42d0d35">tempest-TaggedBootDevicesTest-2132869133</nova:project>
Aug 15 19:07:31 user nova-compute[73188]:       </nova:owner>
Aug 15 19:07:31 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:07:31 user nova-compute[73188]:       <nova:ports>
Aug 15 19:07:31 user nova-compute[73188]:         <nova:port uuid="f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4">
Aug 15 19:07:31 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 19:07:31 user nova-compute[73188]:         </nova:port>
Aug 15 19:07:31 user nova-compute[73188]:         <nova:port uuid="dab59fd7-0d18-4dd9-88f2-27b156f957c4">
Aug 15 19:07:31 user nova-compute[73188]:           <nova:ip type="fixed" address="10.1.1.197" ipVersion="4"/>
Aug 15 19:07:31 user nova-compute[73188]:         </nova:port>
Aug 15 19:07:31 user nova-compute[73188]:         <nova:port uuid="00607676-9218-41f8-945f-8c4ed6834882">
Aug 15 19:07:31 user nova-compute[73188]:           <nova:ip type="fixed" address="10.1.1.32" ipVersion="4"/>
Aug 15 19:07:31 user nova-compute[73188]:         </nova:port>
Aug 15 19:07:31 user nova-compute[73188]:         <nova:port uuid="6bdc6fd6-8a71-4118-b8ed-164cc4315200">
Aug 15 19:07:31 user nova-compute[73188]:           <nova:ip type="fixed" address="10.1.1.103" ipVersion="4"/>
Aug 15 19:07:31 user nova-compute[73188]:         </nova:port>
Aug 15 19:07:31 user nova-compute[73188]:         <nova:port uuid="3cab9f9c-aa69-41e1-b2b1-1397b068fb0f">
Aug 15 19:07:31 user nova-compute[73188]:           <nova:ip type="fixed" address="10.1.1.142" ipVersion="4"/>
Aug 15 19:07:31 user nova-compute[73188]:         </nova:port>
Aug 15 19:07:31 user nova-compute[73188]:         <nova:port uuid="38f2e9d4-a1e3-4d92-a45c-114c4dcb5920">
Aug 15 19:07:31 user nova-compute[73188]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 15 19:07:31 user nova-compute[73188]:         </nova:port>
Aug 15 19:07:31 user nova-compute[73188]:         <nova:port uuid="95cc8c62-5790-417a-bc3f-ebf4028f99e3">
Aug 15 19:07:31 user nova-compute[73188]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 15 19:07:31 user nova-compute[73188]:         </nova:port>
Aug 15 19:07:31 user nova-compute[73188]:       </nova:ports>
Aug 15 19:07:31 user nova-compute[73188]:     </nova:instance>
Aug 15 19:07:31 user nova-compute[73188]:   </metadata>
Aug 15 19:07:31 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:07:31 user nova-compute[73188]:     <system>
Aug 15 19:07:31 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:07:31 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:07:31 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:07:31 user nova-compute[73188]:       <entry name="serial">03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b</entry>
Aug 15 19:07:31 user nova-compute[73188]:       <entry name="uuid">03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b</entry>
Aug 15 19:07:31 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:07:31 user nova-compute[73188]:     </system>
Aug 15 19:07:31 user nova-compute[73188]:   </sysinfo>
Aug 15 19:07:31 user nova-compute[73188]:   <os>
Aug 15 19:07:31 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:07:31 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:07:31 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:07:31 user nova-compute[73188]:   </os>
Aug 15 19:07:31 user nova-compute[73188]:   <features>
Aug 15 19:07:31 user nova-compute[73188]:     <acpi/>
Aug 15 19:07:31 user nova-compute[73188]:     <apic/>
Aug 15 19:07:31 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:07:31 user nova-compute[73188]:   </features>
Aug 15 19:07:31 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:07:31 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:07:31 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:07:31 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:07:31 user nova-compute[73188]:   </clock>
Aug 15 19:07:31 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:07:31 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:07:31 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:07:31 user nova-compute[73188]:   </cpu>
Aug 15 19:07:31 user nova-compute[73188]:   <devices>
Aug 15 19:07:31 user nova-compute[73188]:     <disk type="file" device="cdrom">
Aug 15 19:07:31 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 19:07:31 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b/disk.config"/>
Aug 15 19:07:31 user nova-compute[73188]:       <target dev="hda" bus="ide"/>
Aug 15 19:07:31 user nova-compute[73188]:     </disk>
Aug 15 19:07:31 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:07:31 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:07:31 user nova-compute[73188]:       <source dev="/dev/sdc"/>
Aug 15 19:07:31 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:07:31 user nova-compute[73188]:       <serial>a2ab6393-d020-4b11-8272-837dac22413c</serial>
Aug 15 19:07:31 user nova-compute[73188]:     </disk>
Aug 15 19:07:31 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:07:31 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:07:31 user nova-compute[73188]:       <source dev="/dev/sdd"/>
Aug 15 19:07:31 user nova-compute[73188]:       <target dev="vdb" bus="virtio"/>
Aug 15 19:07:31 user nova-compute[73188]:       <serial>ae554626-7b3b-410b-9fca-505913bf4133</serial>
Aug 15 19:07:31 user nova-compute[73188]:     </disk>
Aug 15 19:07:31 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:07:31 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:07:31 user nova-compute[73188]:       <source dev="/dev/sdf"/>
Aug 15 19:07:31 user nova-compute[73188]:       <target dev="vdc" bus="virtio"/>
Aug 15 19:07:31 user nova-compute[73188]:       <serial>804d1e95-bd0e-4563-a254-f31e66fa0b1f</serial>
Aug 15 19:07:31 user nova-compute[73188]:     </disk>
Aug 15 19:07:31 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:07:31 user nova-compute[73188]:       <mac address="fa:16:3e:81:58:43"/>
Aug 15 19:07:31 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:07:31 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:07:31 user nova-compute[73188]:       <target dev="tapf3af6d04-8c"/>
Aug 15 19:07:31 user nova-compute[73188]:     </interface>
Aug 15 19:07:31 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:07:31 user nova-compute[73188]:       <mac address="fa:16:3e:8a:45:a9"/>
Aug 15 19:07:31 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:07:31 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:07:31 user nova-compute[73188]:       <target dev="tapdab59fd7-0d"/>
Aug 15 19:07:31 user nova-compute[73188]:     </interface>
Aug 15 19:07:31 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:07:31 user nova-compute[73188]:       <mac address="fa:16:3e:51:84:98"/>
Aug 15 19:07:31 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:07:31 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:07:31 user nova-compute[73188]:       <target dev="tap00607676-92"/>
Aug 15 19:07:31 user nova-compute[73188]:     </interface>
Aug 15 19:07:31 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:07:31 user nova-compute[73188]:       <mac address="fa:16:3e:f3:e1:e7"/>
Aug 15 19:07:31 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:07:31 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:07:31 user nova-compute[73188]:       <target dev="tap6bdc6fd6-8a"/>
Aug 15 19:07:31 user nova-compute[73188]:     </interface>
Aug 15 19:07:31 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:07:31 user nova-compute[73188]:       <mac address="fa:16:3e:38:cd:12"/>
Aug 15 19:07:31 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:07:31 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:07:31 user nova-compute[73188]:       <target dev="tap3cab9f9c-aa"/>
Aug 15 19:07:31 user nova-compute[73188]:     </interface>
Aug 15 19:07:31 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:07:31 user nova-compute[73188]:       <mac address="fa:16:3e:72:b0:39"/>
Aug 15 19:07:31 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:07:31 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:07:31 user nova-compute[73188]:       <target dev="tap38f2e9d4-a1"/>
Aug 15 19:07:31 user nova-compute[73188]:     </interface>
Aug 15 19:07:31 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:07:31 user nova-compute[73188]:       <mac address="fa:16:3e:a3:bd:93"/>
Aug 15 19:07:31 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:07:31 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:07:31 user nova-compute[73188]:       <target dev="tap95cc8c62-57"/>
Aug 15 19:07:31 user nova-compute[73188]:     </interface>
Aug 15 19:07:31 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:07:31 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b/console.log" append="off"/>
Aug 15 19:07:31 user nova-compute[73188]:     </serial>
Aug 15 19:07:31 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:07:31 user nova-compute[73188]:     <video>
Aug 15 19:07:31 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:07:31 user nova-compute[73188]:     </video>
Aug 15 19:07:31 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:07:31 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:07:31 user nova-compute[73188]:     </rng>
Aug 15 19:07:31 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:07:31 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:07:31 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:07:31 user nova-compute[73188]:     </memballoon>
Aug 15 19:07:31 user nova-compute[73188]:   </devices>
Aug 15 19:07:31 user nova-compute[73188]: </domain>
Aug 15 19:07:31 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114388087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114388087',id=10,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1idcKZ1xBbWg0gYfVVvOJ4qKeCJ/9fHvAZz/gBB7d+sI7S/Wu2WW23N0v1n+rEzVqwKc3OTOLXDu8ZE2aPLsO4i+R6405lRbPdsNEMKO6raHFlQEQsmUo+TGOLSa69uQ==',key_name='tempest-keypair-286492792',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0915a1c5e7e14afe8831b426b42d0d35',ramdisk_id='',reservation_id='r-ak0gitqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2132869133',owner_user_name='tempest-TaggedBootDevicesTest-2132869133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e174da762209454a8cab943a1bc8e010',uuid=03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "address": "fa:16:3e:81:58:43", "network": {"id": "788628d4-c380-4e07-8d19-602530f78430", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1614362335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af6d04-8c", "ovs_interfaceid": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converting VIF {"id": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "address": "fa:16:3e:81:58:43", "network": {"id": "788628d4-c380-4e07-8d19-602530f78430", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1614362335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af6d04-8c", "ovs_interfaceid": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:58:43,bridge_name='br-int',has_traffic_filtering=True,id=f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4,network=Network(788628d4-c380-4e07-8d19-602530f78430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3af6d04-8c') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:58:43,bridge_name='br-int',has_traffic_filtering=True,id=f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4,network=Network(788628d4-c380-4e07-8d19-602530f78430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3af6d04-8c') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7defe5-79b8-467f-990b-fb8e20904ec1]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3af6d04-8c, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3af6d04-8c, col_values=(('external_ids', {'iface-id': 'f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:58:43', 'vm-uuid': '03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: INFO os_vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:58:43,bridge_name='br-int',has_traffic_filtering=True,id=f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4,network=Network(788628d4-c380-4e07-8d19-602530f78430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3af6d04-8c')
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114388087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114388087',id=10,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1idcKZ1xBbWg0gYfVVvOJ4qKeCJ/9fHvAZz/gBB7d+sI7S/Wu2WW23N0v1n+rEzVqwKc3OTOLXDu8ZE2aPLsO4i+R6405lRbPdsNEMKO6raHFlQEQsmUo+TGOLSa69uQ==',key_name='tempest-keypair-286492792',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0915a1c5e7e14afe8831b426b42d0d35',ramdisk_id='',reservation_id='r-ak0gitqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2132869133',owner_user_name='tempest-TaggedBootDevicesTest-2132869133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e174da762209454a8cab943a1bc8e010',uuid=03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "address": "fa:16:3e:8a:45:a9", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab59fd7-0d", "ovs_interfaceid": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converting VIF {"id": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "address": "fa:16:3e:8a:45:a9", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab59fd7-0d", "ovs_interfaceid": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:45:a9,bridge_name='br-int',has_traffic_filtering=True,id=dab59fd7-0d18-4dd9-88f2-27b156f957c4,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdab59fd7-0d') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:45:a9,bridge_name='br-int',has_traffic_filtering=True,id=dab59fd7-0d18-4dd9-88f2-27b156f957c4,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdab59fd7-0d') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a81af94-7ff2-41b0-98e5-4ba9aec82355]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdab59fd7-0d, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdab59fd7-0d, col_values=(('external_ids', {'iface-id': 'dab59fd7-0d18-4dd9-88f2-27b156f957c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:45:a9', 'vm-uuid': '03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CHjalEfB {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CHjalEfB" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7ae2db-43e1-4b67-97f0-2afb451ae040]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CHjalEfB'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:31 user nova-compute[73188]: INFO os_vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:45:a9,bridge_name='br-int',has_traffic_filtering=True,id=dab59fd7-0d18-4dd9-88f2-27b156f957c4,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdab59fd7-0d')
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114388087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114388087',id=10,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1idcKZ1xBbWg0gYfVVvOJ4qKeCJ/9fHvAZz/gBB7d+sI7S/Wu2WW23N0v1n+rEzVqwKc3OTOLXDu8ZE2aPLsO4i+R6405lRbPdsNEMKO6raHFlQEQsmUo+TGOLSa69uQ==',key_name='tempest-keypair-286492792',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0915a1c5e7e14afe8831b426b42d0d35',ramdisk_id='',reservation_id='r-ak0gitqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2132869133',owner_user_name='tempest-TaggedBootDevicesTest-2132869133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e174da762209454a8cab943a1bc8e010',uuid=03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00607676-9218-41f8-945f-8c4ed6834882", "address": "fa:16:3e:51:84:98", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00607676-92", "ovs_interfaceid": "00607676-9218-41f8-945f-8c4ed6834882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converting VIF {"id": "00607676-9218-41f8-945f-8c4ed6834882", "address": "fa:16:3e:51:84:98", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00607676-92", "ovs_interfaceid": "00607676-9218-41f8-945f-8c4ed6834882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:84:98,bridge_name='br-int',has_traffic_filtering=True,id=00607676-9218-41f8-945f-8c4ed6834882,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap00607676-92') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:84:98,bridge_name='br-int',has_traffic_filtering=True,id=00607676-9218-41f8-945f-8c4ed6834882,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap00607676-92') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00607676-92, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap00607676-92, col_values=(('external_ids', {'iface-id': '00607676-9218-41f8-945f-8c4ed6834882', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:84:98', 'vm-uuid': '03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[322db55a-727b-4b21-b530-026bde9637e3]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: INFO os_vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:84:98,bridge_name='br-int',has_traffic_filtering=True,id=00607676-9218-41f8-945f-8c4ed6834882,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap00607676-92')
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114388087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114388087',id=10,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1idcKZ1xBbWg0gYfVVvOJ4qKeCJ/9fHvAZz/gBB7d+sI7S/Wu2WW23N0v1n+rEzVqwKc3OTOLXDu8ZE2aPLsO4i+R6405lRbPdsNEMKO6raHFlQEQsmUo+TGOLSa69uQ==',key_name='tempest-keypair-286492792',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0915a1c5e7e14afe8831b426b42d0d35',ramdisk_id='',reservation_id='r-ak0gitqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2132869133',owner_user_name='tempest-TaggedBootDevicesTest-2132869133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e174da762209454a8cab943a1bc8e010',uuid=03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bdc6fd6-8a71-4118-b8ed-164cc4315200", "address": "fa:16:3e:f3:e1:e7", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bdc6fd6-8a", "ovs_interfaceid": "6bdc6fd6-8a71-4118-b8ed-164cc4315200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converting VIF {"id": "6bdc6fd6-8a71-4118-b8ed-164cc4315200", "address": "fa:16:3e:f3:e1:e7", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bdc6fd6-8a", "ovs_interfaceid": "6bdc6fd6-8a71-4118-b8ed-164cc4315200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e1:e7,bridge_name='br-int',has_traffic_filtering=True,id=6bdc6fd6-8a71-4118-b8ed-164cc4315200,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bdc6fd6-8a') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e1:e7,bridge_name='br-int',has_traffic_filtering=True,id=6bdc6fd6-8a71-4118-b8ed-164cc4315200,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bdc6fd6-8a') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3322efc0-62c2-4b29-b306-38fd4a5f7aed]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:31 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:31 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:31 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:31 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:31 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:31 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:31 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:31 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:31 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:31 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6bdc6fd6-8a, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6bdc6fd6-8a, col_values=(('external_ids', {'iface-id': '6bdc6fd6-8a71-4118-b8ed-164cc4315200', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:e1:e7', 'vm-uuid': '03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: INFO os_vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e1:e7,bridge_name='br-int',has_traffic_filtering=True,id=6bdc6fd6-8a71-4118-b8ed-164cc4315200,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bdc6fd6-8a')
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114388087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114388087',id=10,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1idcKZ1xBbWg0gYfVVvOJ4qKeCJ/9fHvAZz/gBB7d+sI7S/Wu2WW23N0v1n+rEzVqwKc3OTOLXDu8ZE2aPLsO4i+R6405lRbPdsNEMKO6raHFlQEQsmUo+TGOLSa69uQ==',key_name='tempest-keypair-286492792',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0915a1c5e7e14afe8831b426b42d0d35',ramdisk_id='',reservation_id='r-ak0gitqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2132869133',owner_user_name='tempest-TaggedBootDevicesTest-2132869133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e174da762209454a8cab943a1bc8e010',uuid=03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "address": "fa:16:3e:38:cd:12", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cab9f9c-aa", "ovs_interfaceid": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converting VIF {"id": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "address": "fa:16:3e:38:cd:12", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cab9f9c-aa", "ovs_interfaceid": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:cd:12,bridge_name='br-int',has_traffic_filtering=True,id=3cab9f9c-aa69-41e1-b2b1-1397b068fb0f,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cab9f9c-aa') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:cd:12,bridge_name='br-int',has_traffic_filtering=True,id=3cab9f9c-aa69-41e1-b2b1-1397b068fb0f,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cab9f9c-aa') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3cab9f9c-aa, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3cab9f9c-aa, col_values=(('external_ids', {'iface-id': '3cab9f9c-aa69-41e1-b2b1-1397b068fb0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:cd:12', 'vm-uuid': '03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9e826e-0354-4faf-8d17-ee3324c438e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d, portal: 172.16.0.220,3260]
Aug 15 19:07:31 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d, portal: 172.16.0.220,3260] successful.
Aug 15 19:07:31 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[697f741c-f00e-4816-9773-ff5a225086c1]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: INFO os_vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:cd:12,bridge_name='br-int',has_traffic_filtering=True,id=3cab9f9c-aa69-41e1-b2b1-1397b068fb0f,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cab9f9c-aa')
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114388087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114388087',id=10,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1idcKZ1xBbWg0gYfVVvOJ4qKeCJ/9fHvAZz/gBB7d+sI7S/Wu2WW23N0v1n+rEzVqwKc3OTOLXDu8ZE2aPLsO4i+R6405lRbPdsNEMKO6raHFlQEQsmUo+TGOLSa69uQ==',key_name='tempest-keypair-286492792',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0915a1c5e7e14afe8831b426b42d0d35',ramdisk_id='',reservation_id='r-ak0gitqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2132869133',owner_user_name='tempest-TaggedBootDevicesTest-2132869133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e174da762209454a8cab943a1bc8e010',uuid=03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "address": "fa:16:3e:72:b0:39", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f2e9d4-a1", "ovs_interfaceid": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converting VIF {"id": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "address": "fa:16:3e:72:b0:39", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f2e9d4-a1", "ovs_interfaceid": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:b0:39,bridge_name='br-int',has_traffic_filtering=True,id=38f2e9d4-a1e3-4d92-a45c-114c4dcb5920,network=Network(e3585509-12cc-4551-ad46-7f06ce049df0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f2e9d4-a1') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:b0:39,bridge_name='br-int',has_traffic_filtering=True,id=38f2e9d4-a1e3-4d92-a45c-114c4dcb5920,network=Network(e3585509-12cc-4551-ad46-7f06ce049df0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f2e9d4-a1') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38f2e9d4-a1, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap38f2e9d4-a1, col_values=(('external_ids', {'iface-id': '38f2e9d4-a1e3-4d92-a45c-114c4dcb5920', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:b0:39', 'vm-uuid': '03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7ef4b9-f24e-4d8a-adf0-33c8272b0dfa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:31 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:31 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:31 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:31 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:31 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:07:31 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:31 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:31 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:31 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:31 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:31 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:07:31 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4e7a04-d76a-4a96-beb1-a22748284cae]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CHjalEfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: INFO os_vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:b0:39,bridge_name='br-int',has_traffic_filtering=True,id=38f2e9d4-a1e3-4d92-a45c-114c4dcb5920,network=Network(e3585509-12cc-4551-ad46-7f06ce049df0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f2e9d4-a1')
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114388087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114388087',id=10,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1idcKZ1xBbWg0gYfVVvOJ4qKeCJ/9fHvAZz/gBB7d+sI7S/Wu2WW23N0v1n+rEzVqwKc3OTOLXDu8ZE2aPLsO4i+R6405lRbPdsNEMKO6raHFlQEQsmUo+TGOLSa69uQ==',key_name='tempest-keypair-286492792',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0915a1c5e7e14afe8831b426b42d0d35',ramdisk_id='',reservation_id='r-ak0gitqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2132869133',owner_user_name='tempest-TaggedBootDevicesTest-2132869133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e174da762209454a8cab943a1bc8e010',uuid=03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "address": "fa:16:3e:a3:bd:93", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc8c62-57", "ovs_interfaceid": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converting VIF {"id": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "address": "fa:16:3e:a3:bd:93", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc8c62-57", "ovs_interfaceid": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:bd:93,bridge_name='br-int',has_traffic_filtering=True,id=95cc8c62-5790-417a-bc3f-ebf4028f99e3,network=Network(e3585509-12cc-4551-ad46-7f06ce049df0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cc8c62-57') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG os_vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:bd:93,bridge_name='br-int',has_traffic_filtering=True,id=95cc8c62-5790-417a-bc3f-ebf4028f99e3,network=Network(e3585509-12cc-4551-ad46-7f06ce049df0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cc8c62-57') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95cc8c62-57, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap95cc8c62-57, col_values=(('external_ids', {'iface-id': '95cc8c62-5790-417a-bc3f-ebf4028f99e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:bd:93', 'vm-uuid': '03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:31 user nova-compute[73188]: INFO os_vif [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:bd:93,bridge_name='br-int',has_traffic_filtering=True,id=95cc8c62-5790-417a-bc3f-ebf4028f99e3,network=Network(e3585509-12cc-4551-ad46-7f06ce049df0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cc8c62-57')
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] No BDM found with device name hda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] No VIF found with MAC fa:16:3e:81:58:43, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] No VIF found with MAC fa:16:3e:38:cd:12, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:07:31 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Using config drive
Aug 15 19:07:31 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Creating config drive at /opt/stack/data/nova/instances/03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b/disk.config
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzau6ejnn {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzau6ejnn" returned: 0 in 0.057s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] <== connect_volume: return (2638ms) {'type': 'block', 'scsi_wwn': '23764346638636633', 'path': '/dev/sdg'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764346638636633', 'path': '/dev/sdg'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfcSAumY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:07:32 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:07:32 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:07:32 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66e8fa3-4d9a-4810-8011-a87b9c53f996]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:07:32 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3857d25-eb65-412a-bfa4-cddbf71cdbe6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75] added
Aug 15 19:07:32 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bd5a9c-31bc-4774-a1c9-13584de02927]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a50a10-bdaa-40fe-873d-c13a07c2f3e9]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pfcSAumY {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pfcSAumY" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa841bf-50da-46e3-b37e-98d78b03db9f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pfcSAumY'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6da120-5c09-4b5f-b73b-8fdcab1713fc]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a290a1a-2a7e-401d-8df8-c0ba3f7327ab]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:32 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:32 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:32 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:32 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:32 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:07:32 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:32 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:32 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:32 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:32 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:32 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:07:32 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[48893d20-96ee-4d17-869c-4371afd59ff0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75, portal: 172.16.0.220,3260]
Aug 15 19:07:32 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75, portal: 172.16.0.220,3260] successful.
Aug 15 19:07:32 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[286e8259-c970-4603-be40-3e8b5598ed82]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc99fce-79b2-42c2-af1f-9801d05c1248]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:32 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:32 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:32 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:32 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:32 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:07:32 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:07:32 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:32 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:32 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:32 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:32 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:32 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:07:32 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:07:32 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbddeaf0-7608-4ae5-a9e9-1147fc87d8e2]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:07:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfcSAumY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.compute.manager [req-52ad4716-448c-428d-98c2-9ee42ac4ab3f req-2dca9486-dcf1-4ff9-a920-5b5d93027faa service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-plugged-f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-52ad4716-448c-428d-98c2-9ee42ac4ab3f req-2dca9486-dcf1-4ff9-a920-5b5d93027faa service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-52ad4716-448c-428d-98c2-9ee42ac4ab3f req-2dca9486-dcf1-4ff9-a920-5b5d93027faa service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-52ad4716-448c-428d-98c2-9ee42ac4ab3f req-2dca9486-dcf1-4ff9-a920-5b5d93027faa service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.compute.manager [req-52ad4716-448c-428d-98c2-9ee42ac4ab3f req-2dca9486-dcf1-4ff9-a920-5b5d93027faa service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-plugged-f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:33 user nova-compute[73188]: WARNING nova.compute.manager [req-52ad4716-448c-428d-98c2-9ee42ac4ab3f req-2dca9486-dcf1-4ff9-a920-5b5d93027faa service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received unexpected event network-vif-plugged-f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4 for instance with vm_state building and task_state spawning.
Aug 15 19:07:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23963363365653361', 'path': '/dev/sdh'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963363365653361', 'path': '/dev/sdh'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.compute.manager [req-e281814a-7412-489b-91fa-7545be63709e req-7c1d34bf-6c27-4c22-8a49-1a6ef5de09c4 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-plugged-dab59fd7-0d18-4dd9-88f2-27b156f957c4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e281814a-7412-489b-91fa-7545be63709e req-7c1d34bf-6c27-4c22-8a49-1a6ef5de09c4 service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e281814a-7412-489b-91fa-7545be63709e req-7c1d34bf-6c27-4c22-8a49-1a6ef5de09c4 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e281814a-7412-489b-91fa-7545be63709e req-7c1d34bf-6c27-4c22-8a49-1a6ef5de09c4 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.compute.manager [req-e281814a-7412-489b-91fa-7545be63709e req-7c1d34bf-6c27-4c22-8a49-1a6ef5de09c4 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-plugged-dab59fd7-0d18-4dd9-88f2-27b156f957c4 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:33 user nova-compute[73188]: WARNING nova.compute.manager [req-e281814a-7412-489b-91fa-7545be63709e req-7c1d34bf-6c27-4c22-8a49-1a6ef5de09c4 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received unexpected event network-vif-plugged-dab59fd7-0d18-4dd9-88f2-27b156f957c4 for instance with vm_state building and task_state spawning.
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614732338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614732338',id=11,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBDQbv5n4VEeAvnAJ6tL9DsIUI/WahvlehI4iRSJ5keiKnx9QoeH7H+4PhwiyV7+zTpaUX9W8mjhZGfCB80JLMGAaZwM+VSUf0vH7rrELMUW4OCdj0q5KkBtNzCwU0SAA==',key_name='tempest-keypair-890925727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df3ab2300ae46699d4d309268f83415',ramdisk_id='',reservation_id='r-7nkntget',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1842772812',owner_user_name='tempest-TaggedBootDevicesTest_v242-1842772812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0d1232acc0d4041872c5ee40b4c826e',uuid=deb3ccb4-136f-4873-959d-edecdc436291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76516ed7-f500-4002-9ea5-14cb411ef40e", "address": "fa:16:3e:98:81:f4", "network": {"id": "c2d692fb-b4f7-4e5f-bc90-2de58035637b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-476302846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516ed7-f5", "ovs_interfaceid": "76516ed7-f500-4002-9ea5-14cb411ef40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converting VIF {"id": "76516ed7-f500-4002-9ea5-14cb411ef40e", "address": "fa:16:3e:98:81:f4", "network": {"id": "c2d692fb-b4f7-4e5f-bc90-2de58035637b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-476302846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516ed7-f5", "ovs_interfaceid": "76516ed7-f500-4002-9ea5-14cb411ef40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:81:f4,bridge_name='br-int',has_traffic_filtering=True,id=76516ed7-f500-4002-9ea5-14cb411ef40e,network=Network(c2d692fb-b4f7-4e5f-bc90-2de58035637b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516ed7-f5') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614732338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614732338',id=11,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBDQbv5n4VEeAvnAJ6tL9DsIUI/WahvlehI4iRSJ5keiKnx9QoeH7H+4PhwiyV7+zTpaUX9W8mjhZGfCB80JLMGAaZwM+VSUf0vH7rrELMUW4OCdj0q5KkBtNzCwU0SAA==',key_name='tempest-keypair-890925727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df3ab2300ae46699d4d309268f83415',ramdisk_id='',reservation_id='r-7nkntget',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1842772812',owner_user_name='tempest-TaggedBootDevicesTest_v242-1842772812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0d1232acc0d4041872c5ee40b4c826e',uuid=deb3ccb4-136f-4873-959d-edecdc436291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c169fd9d-21c0-4104-af83-51ee360612b5", "address": "fa:16:3e:5b:5c:7e", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc169fd9d-21", "ovs_interfaceid": "c169fd9d-21c0-4104-af83-51ee360612b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converting VIF {"id": "c169fd9d-21c0-4104-af83-51ee360612b5", "address": "fa:16:3e:5b:5c:7e", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc169fd9d-21", "ovs_interfaceid": "c169fd9d-21c0-4104-af83-51ee360612b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:5c:7e,bridge_name='br-int',has_traffic_filtering=True,id=c169fd9d-21c0-4104-af83-51ee360612b5,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc169fd9d-21') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614732338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614732338',id=11,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBDQbv5n4VEeAvnAJ6tL9DsIUI/WahvlehI4iRSJ5keiKnx9QoeH7H+4PhwiyV7+zTpaUX9W8mjhZGfCB80JLMGAaZwM+VSUf0vH7rrELMUW4OCdj0q5KkBtNzCwU0SAA==',key_name='tempest-keypair-890925727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df3ab2300ae46699d4d309268f83415',ramdisk_id='',reservation_id='r-7nkntget',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1842772812',owner_user_name='tempest-TaggedBootDevicesTest_v242-1842772812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0d1232acc0d4041872c5ee40b4c826e',uuid=deb3ccb4-136f-4873-959d-edecdc436291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "address": "fa:16:3e:05:3c:92", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a3682d0-74", "ovs_interfaceid": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converting VIF {"id": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "address": "fa:16:3e:05:3c:92", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a3682d0-74", "ovs_interfaceid": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:3c:92,bridge_name='br-int',has_traffic_filtering=True,id=9a3682d0-74e3-46c7-89cc-bc90a5da8de0,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9a3682d0-74') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614732338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614732338',id=11,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBDQbv5n4VEeAvnAJ6tL9DsIUI/WahvlehI4iRSJ5keiKnx9QoeH7H+4PhwiyV7+zTpaUX9W8mjhZGfCB80JLMGAaZwM+VSUf0vH7rrELMUW4OCdj0q5KkBtNzCwU0SAA==',key_name='tempest-keypair-890925727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df3ab2300ae46699d4d309268f83415',ramdisk_id='',reservation_id='r-7nkntget',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1842772812',owner_user_name='tempest-TaggedBootDevicesTest_v242-1842772812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0d1232acc0d4041872c5ee40b4c826e',uuid=deb3ccb4-136f-4873-959d-edecdc436291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59186294-47fd-4da4-8961-419b39b16970", "address": "fa:16:3e:31:38:e2", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59186294-47", "ovs_interfaceid": "59186294-47fd-4da4-8961-419b39b16970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converting VIF {"id": "59186294-47fd-4da4-8961-419b39b16970", "address": "fa:16:3e:31:38:e2", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59186294-47", "ovs_interfaceid": "59186294-47fd-4da4-8961-419b39b16970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:38:e2,bridge_name='br-int',has_traffic_filtering=True,id=59186294-47fd-4da4-8961-419b39b16970,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59186294-47') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614732338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614732338',id=11,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBDQbv5n4VEeAvnAJ6tL9DsIUI/WahvlehI4iRSJ5keiKnx9QoeH7H+4PhwiyV7+zTpaUX9W8mjhZGfCB80JLMGAaZwM+VSUf0vH7rrELMUW4OCdj0q5KkBtNzCwU0SAA==',key_name='tempest-keypair-890925727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df3ab2300ae46699d4d309268f83415',ramdisk_id='',reservation_id='r-7nkntget',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1842772812',owner_user_name='tempest-TaggedBootDevicesTest_v242-1842772812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0d1232acc0d4041872c5ee40b4c826e',uuid=deb3ccb4-136f-4873-959d-edecdc436291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b570288f-2a5e-422e-a42f-20acf7269946", "address": "fa:16:3e:02:ca:a7", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb570288f-2a", "ovs_interfaceid": "b570288f-2a5e-422e-a42f-20acf7269946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converting VIF {"id": "b570288f-2a5e-422e-a42f-20acf7269946", "address": "fa:16:3e:02:ca:a7", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb570288f-2a", "ovs_interfaceid": "b570288f-2a5e-422e-a42f-20acf7269946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:ca:a7,bridge_name='br-int',has_traffic_filtering=True,id=b570288f-2a5e-422e-a42f-20acf7269946,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb570288f-2a') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614732338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614732338',id=11,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBDQbv5n4VEeAvnAJ6tL9DsIUI/WahvlehI4iRSJ5keiKnx9QoeH7H+4PhwiyV7+zTpaUX9W8mjhZGfCB80JLMGAaZwM+VSUf0vH7rrELMUW4OCdj0q5KkBtNzCwU0SAA==',key_name='tempest-keypair-890925727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df3ab2300ae46699d4d309268f83415',ramdisk_id='',reservation_id='r-7nkntget',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1842772812',owner_user_name='tempest-TaggedBootDevicesTest_v242-1842772812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0d1232acc0d4041872c5ee40b4c826e',uuid=deb3ccb4-136f-4873-959d-edecdc436291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "address": "fa:16:3e:a4:22:08", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6171fcf-6d", "ovs_interfaceid": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converting VIF {"id": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "address": "fa:16:3e:a4:22:08", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6171fcf-6d", "ovs_interfaceid": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:22:08,bridge_name='br-int',has_traffic_filtering=True,id=b6171fcf-6d3c-4e00-b032-e62467a9ff71,network=Network(003b5e43-d77e-4b83-a772-3a0ccf66fc76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6171fcf-6d') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614732338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614732338',id=11,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBDQbv5n4VEeAvnAJ6tL9DsIUI/WahvlehI4iRSJ5keiKnx9QoeH7H+4PhwiyV7+zTpaUX9W8mjhZGfCB80JLMGAaZwM+VSUf0vH7rrELMUW4OCdj0q5KkBtNzCwU0SAA==',key_name='tempest-keypair-890925727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df3ab2300ae46699d4d309268f83415',ramdisk_id='',reservation_id='r-7nkntget',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1842772812',owner_user_name='tempest-TaggedBootDevicesTest_v242-1842772812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0d1232acc0d4041872c5ee40b4c826e',uuid=deb3ccb4-136f-4873-959d-edecdc436291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "address": "fa:16:3e:84:8d:cb", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53f593-c9", "ovs_interfaceid": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converting VIF {"id": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "address": "fa:16:3e:84:8d:cb", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53f593-c9", "ovs_interfaceid": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:8d:cb,bridge_name='br-int',has_traffic_filtering=True,id=4e53f593-c9c9-478d-bc1b-f0315d8eb2a5,network=Network(003b5e43-d77e-4b83-a772-3a0ccf66fc76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e53f593-c9') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.objects.instance [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lazy-loading 'pci_devices' on Instance uuid deb3ccb4-136f-4873-959d-edecdc436291 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:07:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:07:33 user nova-compute[73188]:   <uuid>deb3ccb4-136f-4873-959d-edecdc436291</uuid>
Aug 15 19:07:33 user nova-compute[73188]:   <name>instance-0000000b</name>
Aug 15 19:07:33 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:07:33 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:07:33 user nova-compute[73188]:   <metadata>
Aug 15 19:07:33 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:07:33 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:07:33 user nova-compute[73188]:       <nova:name>tempest-device-tagging-server-1614732338</nova:name>
Aug 15 19:07:33 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:07:28</nova:creationTime>
Aug 15 19:07:33 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:07:33 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:07:33 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:07:33 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:07:33 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:07:33 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:07:33 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:07:33 user nova-compute[73188]:       <nova:owner>
Aug 15 19:07:33 user nova-compute[73188]:         <nova:user uuid="c0d1232acc0d4041872c5ee40b4c826e">tempest-TaggedBootDevicesTest_v242-1842772812-project-member</nova:user>
Aug 15 19:07:33 user nova-compute[73188]:         <nova:project uuid="3df3ab2300ae46699d4d309268f83415">tempest-TaggedBootDevicesTest_v242-1842772812</nova:project>
Aug 15 19:07:33 user nova-compute[73188]:       </nova:owner>
Aug 15 19:07:33 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:07:33 user nova-compute[73188]:       <nova:ports>
Aug 15 19:07:33 user nova-compute[73188]:         <nova:port uuid="76516ed7-f500-4002-9ea5-14cb411ef40e">
Aug 15 19:07:33 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 19:07:33 user nova-compute[73188]:         </nova:port>
Aug 15 19:07:33 user nova-compute[73188]:         <nova:port uuid="c169fd9d-21c0-4104-af83-51ee360612b5">
Aug 15 19:07:33 user nova-compute[73188]:           <nova:ip type="fixed" address="10.1.1.226" ipVersion="4"/>
Aug 15 19:07:33 user nova-compute[73188]:         </nova:port>
Aug 15 19:07:33 user nova-compute[73188]:         <nova:port uuid="9a3682d0-74e3-46c7-89cc-bc90a5da8de0">
Aug 15 19:07:33 user nova-compute[73188]:           <nova:ip type="fixed" address="10.1.1.210" ipVersion="4"/>
Aug 15 19:07:33 user nova-compute[73188]:         </nova:port>
Aug 15 19:07:33 user nova-compute[73188]:         <nova:port uuid="59186294-47fd-4da4-8961-419b39b16970">
Aug 15 19:07:33 user nova-compute[73188]:           <nova:ip type="fixed" address="10.1.1.134" ipVersion="4"/>
Aug 15 19:07:33 user nova-compute[73188]:         </nova:port>
Aug 15 19:07:33 user nova-compute[73188]:         <nova:port uuid="b570288f-2a5e-422e-a42f-20acf7269946">
Aug 15 19:07:33 user nova-compute[73188]:           <nova:ip type="fixed" address="10.1.1.169" ipVersion="4"/>
Aug 15 19:07:33 user nova-compute[73188]:         </nova:port>
Aug 15 19:07:33 user nova-compute[73188]:         <nova:port uuid="b6171fcf-6d3c-4e00-b032-e62467a9ff71">
Aug 15 19:07:33 user nova-compute[73188]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 15 19:07:33 user nova-compute[73188]:         </nova:port>
Aug 15 19:07:33 user nova-compute[73188]:         <nova:port uuid="4e53f593-c9c9-478d-bc1b-f0315d8eb2a5">
Aug 15 19:07:33 user nova-compute[73188]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 15 19:07:33 user nova-compute[73188]:         </nova:port>
Aug 15 19:07:33 user nova-compute[73188]:       </nova:ports>
Aug 15 19:07:33 user nova-compute[73188]:     </nova:instance>
Aug 15 19:07:33 user nova-compute[73188]:   </metadata>
Aug 15 19:07:33 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:07:33 user nova-compute[73188]:     <system>
Aug 15 19:07:33 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:07:33 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:07:33 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:07:33 user nova-compute[73188]:       <entry name="serial">deb3ccb4-136f-4873-959d-edecdc436291</entry>
Aug 15 19:07:33 user nova-compute[73188]:       <entry name="uuid">deb3ccb4-136f-4873-959d-edecdc436291</entry>
Aug 15 19:07:33 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:07:33 user nova-compute[73188]:     </system>
Aug 15 19:07:33 user nova-compute[73188]:   </sysinfo>
Aug 15 19:07:33 user nova-compute[73188]:   <os>
Aug 15 19:07:33 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:07:33 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:07:33 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:07:33 user nova-compute[73188]:   </os>
Aug 15 19:07:33 user nova-compute[73188]:   <features>
Aug 15 19:07:33 user nova-compute[73188]:     <acpi/>
Aug 15 19:07:33 user nova-compute[73188]:     <apic/>
Aug 15 19:07:33 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:07:33 user nova-compute[73188]:   </features>
Aug 15 19:07:33 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:07:33 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:07:33 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:07:33 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:07:33 user nova-compute[73188]:   </clock>
Aug 15 19:07:33 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:07:33 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:07:33 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:07:33 user nova-compute[73188]:   </cpu>
Aug 15 19:07:33 user nova-compute[73188]:   <devices>
Aug 15 19:07:33 user nova-compute[73188]:     <disk type="file" device="cdrom">
Aug 15 19:07:33 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 19:07:33 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/deb3ccb4-136f-4873-959d-edecdc436291/disk.config"/>
Aug 15 19:07:33 user nova-compute[73188]:       <target dev="hda" bus="ide"/>
Aug 15 19:07:33 user nova-compute[73188]:     </disk>
Aug 15 19:07:33 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:07:33 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:07:33 user nova-compute[73188]:       <source dev="/dev/sde"/>
Aug 15 19:07:33 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:07:33 user nova-compute[73188]:       <serial>a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4</serial>
Aug 15 19:07:33 user nova-compute[73188]:     </disk>
Aug 15 19:07:33 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:07:33 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:07:33 user nova-compute[73188]:       <source dev="/dev/sdg"/>
Aug 15 19:07:33 user nova-compute[73188]:       <target dev="vdb" bus="virtio"/>
Aug 15 19:07:33 user nova-compute[73188]:       <serial>e5cc80c9-2627-41d5-b417-df4d88cc657d</serial>
Aug 15 19:07:33 user nova-compute[73188]:     </disk>
Aug 15 19:07:33 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:07:33 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:07:33 user nova-compute[73188]:       <source dev="/dev/sdh"/>
Aug 15 19:07:33 user nova-compute[73188]:       <target dev="vdc" bus="virtio"/>
Aug 15 19:07:33 user nova-compute[73188]:       <serial>9671649a-4f11-4f60-a64d-a0093c2d8d75</serial>
Aug 15 19:07:33 user nova-compute[73188]:     </disk>
Aug 15 19:07:33 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:07:33 user nova-compute[73188]:       <mac address="fa:16:3e:98:81:f4"/>
Aug 15 19:07:33 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:07:33 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:07:33 user nova-compute[73188]:       <target dev="tap76516ed7-f5"/>
Aug 15 19:07:33 user nova-compute[73188]:     </interface>
Aug 15 19:07:33 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:07:33 user nova-compute[73188]:       <mac address="fa:16:3e:5b:5c:7e"/>
Aug 15 19:07:33 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:07:33 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:07:33 user nova-compute[73188]:       <target dev="tapc169fd9d-21"/>
Aug 15 19:07:33 user nova-compute[73188]:     </interface>
Aug 15 19:07:33 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:07:33 user nova-compute[73188]:       <mac address="fa:16:3e:05:3c:92"/>
Aug 15 19:07:33 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:07:33 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:07:33 user nova-compute[73188]:       <target dev="tap9a3682d0-74"/>
Aug 15 19:07:33 user nova-compute[73188]:     </interface>
Aug 15 19:07:33 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:07:33 user nova-compute[73188]:       <mac address="fa:16:3e:31:38:e2"/>
Aug 15 19:07:33 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:07:33 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:07:33 user nova-compute[73188]:       <target dev="tap59186294-47"/>
Aug 15 19:07:33 user nova-compute[73188]:     </interface>
Aug 15 19:07:33 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:07:33 user nova-compute[73188]:       <mac address="fa:16:3e:02:ca:a7"/>
Aug 15 19:07:33 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:07:33 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:07:33 user nova-compute[73188]:       <target dev="tapb570288f-2a"/>
Aug 15 19:07:33 user nova-compute[73188]:     </interface>
Aug 15 19:07:33 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:07:33 user nova-compute[73188]:       <mac address="fa:16:3e:a4:22:08"/>
Aug 15 19:07:33 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:07:33 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:07:33 user nova-compute[73188]:       <target dev="tapb6171fcf-6d"/>
Aug 15 19:07:33 user nova-compute[73188]:     </interface>
Aug 15 19:07:33 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:07:33 user nova-compute[73188]:       <mac address="fa:16:3e:84:8d:cb"/>
Aug 15 19:07:33 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:07:33 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:07:33 user nova-compute[73188]:       <target dev="tap4e53f593-c9"/>
Aug 15 19:07:33 user nova-compute[73188]:     </interface>
Aug 15 19:07:33 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:07:33 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/deb3ccb4-136f-4873-959d-edecdc436291/console.log" append="off"/>
Aug 15 19:07:33 user nova-compute[73188]:     </serial>
Aug 15 19:07:33 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:07:33 user nova-compute[73188]:     <video>
Aug 15 19:07:33 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:07:33 user nova-compute[73188]:     </video>
Aug 15 19:07:33 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:07:33 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:07:33 user nova-compute[73188]:     </rng>
Aug 15 19:07:33 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:07:33 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:07:33 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:07:33 user nova-compute[73188]:     </memballoon>
Aug 15 19:07:33 user nova-compute[73188]:   </devices>
Aug 15 19:07:33 user nova-compute[73188]: </domain>
Aug 15 19:07:33 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614732338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614732338',id=11,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBDQbv5n4VEeAvnAJ6tL9DsIUI/WahvlehI4iRSJ5keiKnx9QoeH7H+4PhwiyV7+zTpaUX9W8mjhZGfCB80JLMGAaZwM+VSUf0vH7rrELMUW4OCdj0q5KkBtNzCwU0SAA==',key_name='tempest-keypair-890925727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df3ab2300ae46699d4d309268f83415',ramdisk_id='',reservation_id='r-7nkntget',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1842772812',owner_user_name='tempest-TaggedBootDevicesTest_v242-1842772812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0d1232acc0d4041872c5ee40b4c826e',uuid=deb3ccb4-136f-4873-959d-edecdc436291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76516ed7-f500-4002-9ea5-14cb411ef40e", "address": "fa:16:3e:98:81:f4", "network": {"id": "c2d692fb-b4f7-4e5f-bc90-2de58035637b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-476302846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516ed7-f5", "ovs_interfaceid": "76516ed7-f500-4002-9ea5-14cb411ef40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converting VIF {"id": "76516ed7-f500-4002-9ea5-14cb411ef40e", "address": "fa:16:3e:98:81:f4", "network": {"id": "c2d692fb-b4f7-4e5f-bc90-2de58035637b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-476302846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516ed7-f5", "ovs_interfaceid": "76516ed7-f500-4002-9ea5-14cb411ef40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:81:f4,bridge_name='br-int',has_traffic_filtering=True,id=76516ed7-f500-4002-9ea5-14cb411ef40e,network=Network(c2d692fb-b4f7-4e5f-bc90-2de58035637b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516ed7-f5') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG os_vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:81:f4,bridge_name='br-int',has_traffic_filtering=True,id=76516ed7-f500-4002-9ea5-14cb411ef40e,network=Network(c2d692fb-b4f7-4e5f-bc90-2de58035637b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516ed7-f5') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76516ed7-f5, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap76516ed7-f5, col_values=(('external_ids', {'iface-id': '76516ed7-f500-4002-9ea5-14cb411ef40e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:81:f4', 'vm-uuid': 'deb3ccb4-136f-4873-959d-edecdc436291'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: INFO os_vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:81:f4,bridge_name='br-int',has_traffic_filtering=True,id=76516ed7-f500-4002-9ea5-14cb411ef40e,network=Network(c2d692fb-b4f7-4e5f-bc90-2de58035637b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516ed7-f5')
Aug 15 19:07:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614732338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614732338',id=11,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBDQbv5n4VEeAvnAJ6tL9DsIUI/WahvlehI4iRSJ5keiKnx9QoeH7H+4PhwiyV7+zTpaUX9W8mjhZGfCB80JLMGAaZwM+VSUf0vH7rrELMUW4OCdj0q5KkBtNzCwU0SAA==',key_name='tempest-keypair-890925727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df3ab2300ae46699d4d309268f83415',ramdisk_id='',reservation_id='r-7nkntget',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1842772812',owner_user_name='tempest-TaggedBootDevicesTest_v242-1842772812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0d1232acc0d4041872c5ee40b4c826e',uuid=deb3ccb4-136f-4873-959d-edecdc436291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c169fd9d-21c0-4104-af83-51ee360612b5", "address": "fa:16:3e:5b:5c:7e", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc169fd9d-21", "ovs_interfaceid": "c169fd9d-21c0-4104-af83-51ee360612b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converting VIF {"id": "c169fd9d-21c0-4104-af83-51ee360612b5", "address": "fa:16:3e:5b:5c:7e", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc169fd9d-21", "ovs_interfaceid": "c169fd9d-21c0-4104-af83-51ee360612b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:5c:7e,bridge_name='br-int',has_traffic_filtering=True,id=c169fd9d-21c0-4104-af83-51ee360612b5,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc169fd9d-21') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG os_vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:5c:7e,bridge_name='br-int',has_traffic_filtering=True,id=c169fd9d-21c0-4104-af83-51ee360612b5,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc169fd9d-21') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc169fd9d-21, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc169fd9d-21, col_values=(('external_ids', {'iface-id': 'c169fd9d-21c0-4104-af83-51ee360612b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:5c:7e', 'vm-uuid': 'deb3ccb4-136f-4873-959d-edecdc436291'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: INFO os_vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:5c:7e,bridge_name='br-int',has_traffic_filtering=True,id=c169fd9d-21c0-4104-af83-51ee360612b5,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc169fd9d-21')
Aug 15 19:07:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614732338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614732338',id=11,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBDQbv5n4VEeAvnAJ6tL9DsIUI/WahvlehI4iRSJ5keiKnx9QoeH7H+4PhwiyV7+zTpaUX9W8mjhZGfCB80JLMGAaZwM+VSUf0vH7rrELMUW4OCdj0q5KkBtNzCwU0SAA==',key_name='tempest-keypair-890925727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df3ab2300ae46699d4d309268f83415',ramdisk_id='',reservation_id='r-7nkntget',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1842772812',owner_user_name='tempest-TaggedBootDevicesTest_v242-1842772812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0d1232acc0d4041872c5ee40b4c826e',uuid=deb3ccb4-136f-4873-959d-edecdc436291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "address": "fa:16:3e:05:3c:92", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a3682d0-74", "ovs_interfaceid": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converting VIF {"id": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "address": "fa:16:3e:05:3c:92", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a3682d0-74", "ovs_interfaceid": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:3c:92,bridge_name='br-int',has_traffic_filtering=True,id=9a3682d0-74e3-46c7-89cc-bc90a5da8de0,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9a3682d0-74') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG os_vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:3c:92,bridge_name='br-int',has_traffic_filtering=True,id=9a3682d0-74e3-46c7-89cc-bc90a5da8de0,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9a3682d0-74') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a3682d0-74, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a3682d0-74, col_values=(('external_ids', {'iface-id': '9a3682d0-74e3-46c7-89cc-bc90a5da8de0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:3c:92', 'vm-uuid': 'deb3ccb4-136f-4873-959d-edecdc436291'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: INFO os_vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:3c:92,bridge_name='br-int',has_traffic_filtering=True,id=9a3682d0-74e3-46c7-89cc-bc90a5da8de0,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9a3682d0-74')
Aug 15 19:07:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614732338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614732338',id=11,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBDQbv5n4VEeAvnAJ6tL9DsIUI/WahvlehI4iRSJ5keiKnx9QoeH7H+4PhwiyV7+zTpaUX9W8mjhZGfCB80JLMGAaZwM+VSUf0vH7rrELMUW4OCdj0q5KkBtNzCwU0SAA==',key_name='tempest-keypair-890925727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df3ab2300ae46699d4d309268f83415',ramdisk_id='',reservation_id='r-7nkntget',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1842772812',owner_user_name='tempest-TaggedBootDevicesTest_v242-1842772812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0d1232acc0d4041872c5ee40b4c826e',uuid=deb3ccb4-136f-4873-959d-edecdc436291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59186294-47fd-4da4-8961-419b39b16970", "address": "fa:16:3e:31:38:e2", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59186294-47", "ovs_interfaceid": "59186294-47fd-4da4-8961-419b39b16970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converting VIF {"id": "59186294-47fd-4da4-8961-419b39b16970", "address": "fa:16:3e:31:38:e2", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59186294-47", "ovs_interfaceid": "59186294-47fd-4da4-8961-419b39b16970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:38:e2,bridge_name='br-int',has_traffic_filtering=True,id=59186294-47fd-4da4-8961-419b39b16970,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59186294-47') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG os_vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:38:e2,bridge_name='br-int',has_traffic_filtering=True,id=59186294-47fd-4da4-8961-419b39b16970,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59186294-47') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59186294-47, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap59186294-47, col_values=(('external_ids', {'iface-id': '59186294-47fd-4da4-8961-419b39b16970', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:38:e2', 'vm-uuid': 'deb3ccb4-136f-4873-959d-edecdc436291'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: INFO os_vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:38:e2,bridge_name='br-int',has_traffic_filtering=True,id=59186294-47fd-4da4-8961-419b39b16970,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59186294-47')
Aug 15 19:07:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614732338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614732338',id=11,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBDQbv5n4VEeAvnAJ6tL9DsIUI/WahvlehI4iRSJ5keiKnx9QoeH7H+4PhwiyV7+zTpaUX9W8mjhZGfCB80JLMGAaZwM+VSUf0vH7rrELMUW4OCdj0q5KkBtNzCwU0SAA==',key_name='tempest-keypair-890925727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df3ab2300ae46699d4d309268f83415',ramdisk_id='',reservation_id='r-7nkntget',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1842772812',owner_user_name='tempest-TaggedBootDevicesTest_v242-1842772812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0d1232acc0d4041872c5ee40b4c826e',uuid=deb3ccb4-136f-4873-959d-edecdc436291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b570288f-2a5e-422e-a42f-20acf7269946", "address": "fa:16:3e:02:ca:a7", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb570288f-2a", "ovs_interfaceid": "b570288f-2a5e-422e-a42f-20acf7269946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converting VIF {"id": "b570288f-2a5e-422e-a42f-20acf7269946", "address": "fa:16:3e:02:ca:a7", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb570288f-2a", "ovs_interfaceid": "b570288f-2a5e-422e-a42f-20acf7269946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:ca:a7,bridge_name='br-int',has_traffic_filtering=True,id=b570288f-2a5e-422e-a42f-20acf7269946,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb570288f-2a') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG os_vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:ca:a7,bridge_name='br-int',has_traffic_filtering=True,id=b570288f-2a5e-422e-a42f-20acf7269946,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb570288f-2a') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb570288f-2a, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb570288f-2a, col_values=(('external_ids', {'iface-id': 'b570288f-2a5e-422e-a42f-20acf7269946', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:ca:a7', 'vm-uuid': 'deb3ccb4-136f-4873-959d-edecdc436291'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: INFO os_vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:ca:a7,bridge_name='br-int',has_traffic_filtering=True,id=b570288f-2a5e-422e-a42f-20acf7269946,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb570288f-2a')
Aug 15 19:07:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614732338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614732338',id=11,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBDQbv5n4VEeAvnAJ6tL9DsIUI/WahvlehI4iRSJ5keiKnx9QoeH7H+4PhwiyV7+zTpaUX9W8mjhZGfCB80JLMGAaZwM+VSUf0vH7rrELMUW4OCdj0q5KkBtNzCwU0SAA==',key_name='tempest-keypair-890925727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df3ab2300ae46699d4d309268f83415',ramdisk_id='',reservation_id='r-7nkntget',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1842772812',owner_user_name='tempest-TaggedBootDevicesTest_v242-1842772812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0d1232acc0d4041872c5ee40b4c826e',uuid=deb3ccb4-136f-4873-959d-edecdc436291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "address": "fa:16:3e:a4:22:08", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6171fcf-6d", "ovs_interfaceid": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converting VIF {"id": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "address": "fa:16:3e:a4:22:08", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6171fcf-6d", "ovs_interfaceid": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:22:08,bridge_name='br-int',has_traffic_filtering=True,id=b6171fcf-6d3c-4e00-b032-e62467a9ff71,network=Network(003b5e43-d77e-4b83-a772-3a0ccf66fc76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6171fcf-6d') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG os_vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:22:08,bridge_name='br-int',has_traffic_filtering=True,id=b6171fcf-6d3c-4e00-b032-e62467a9ff71,network=Network(003b5e43-d77e-4b83-a772-3a0ccf66fc76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6171fcf-6d') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6171fcf-6d, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb6171fcf-6d, col_values=(('external_ids', {'iface-id': 'b6171fcf-6d3c-4e00-b032-e62467a9ff71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:22:08', 'vm-uuid': 'deb3ccb4-136f-4873-959d-edecdc436291'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: INFO os_vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:22:08,bridge_name='br-int',has_traffic_filtering=True,id=b6171fcf-6d3c-4e00-b032-e62467a9ff71,network=Network(003b5e43-d77e-4b83-a772-3a0ccf66fc76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6171fcf-6d')
Aug 15 19:07:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614732338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614732338',id=11,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBDQbv5n4VEeAvnAJ6tL9DsIUI/WahvlehI4iRSJ5keiKnx9QoeH7H+4PhwiyV7+zTpaUX9W8mjhZGfCB80JLMGAaZwM+VSUf0vH7rrELMUW4OCdj0q5KkBtNzCwU0SAA==',key_name='tempest-keypair-890925727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3df3ab2300ae46699d4d309268f83415',ramdisk_id='',reservation_id='r-7nkntget',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1842772812',owner_user_name='tempest-TaggedBootDevicesTest_v242-1842772812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:06:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0d1232acc0d4041872c5ee40b4c826e',uuid=deb3ccb4-136f-4873-959d-edecdc436291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "address": "fa:16:3e:84:8d:cb", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53f593-c9", "ovs_interfaceid": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converting VIF {"id": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "address": "fa:16:3e:84:8d:cb", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53f593-c9", "ovs_interfaceid": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:8d:cb,bridge_name='br-int',has_traffic_filtering=True,id=4e53f593-c9c9-478d-bc1b-f0315d8eb2a5,network=Network(003b5e43-d77e-4b83-a772-3a0ccf66fc76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e53f593-c9') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG os_vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:8d:cb,bridge_name='br-int',has_traffic_filtering=True,id=4e53f593-c9c9-478d-bc1b-f0315d8eb2a5,network=Network(003b5e43-d77e-4b83-a772-3a0ccf66fc76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e53f593-c9') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e53f593-c9, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4e53f593-c9, col_values=(('external_ids', {'iface-id': '4e53f593-c9c9-478d-bc1b-f0315d8eb2a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:8d:cb', 'vm-uuid': 'deb3ccb4-136f-4873-959d-edecdc436291'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:07:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-6fefb526-2bd2-463b-86b6-f395dc54efcc req-98757cc4-45d0-4834-bb7a-f2625c37e744 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-plugged-6bdc6fd6-8a71-4118-b8ed-164cc4315200 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6fefb526-2bd2-463b-86b6-f395dc54efcc req-98757cc4-45d0-4834-bb7a-f2625c37e744 service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6fefb526-2bd2-463b-86b6-f395dc54efcc req-98757cc4-45d0-4834-bb7a-f2625c37e744 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6fefb526-2bd2-463b-86b6-f395dc54efcc req-98757cc4-45d0-4834-bb7a-f2625c37e744 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-6fefb526-2bd2-463b-86b6-f395dc54efcc req-98757cc4-45d0-4834-bb7a-f2625c37e744 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-plugged-6bdc6fd6-8a71-4118-b8ed-164cc4315200 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:35 user nova-compute[73188]: WARNING nova.compute.manager [req-6fefb526-2bd2-463b-86b6-f395dc54efcc req-98757cc4-45d0-4834-bb7a-f2625c37e744 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received unexpected event network-vif-plugged-6bdc6fd6-8a71-4118-b8ed-164cc4315200 for instance with vm_state building and task_state spawning.
Aug 15 19:07:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:35 user nova-compute[73188]: INFO os_vif [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:8d:cb,bridge_name='br-int',has_traffic_filtering=True,id=4e53f593-c9c9-478d-bc1b-f0315d8eb2a5,network=Network(003b5e43-d77e-4b83-a772-3a0ccf66fc76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e53f593-c9')
Aug 15 19:07:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] No BDM found with device name hda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] No VIF found with MAC fa:16:3e:98:81:f4, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] No VIF found with MAC fa:16:3e:02:ca:a7, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:07:35 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Using config drive
Aug 15 19:07:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-plugged-f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-plugged-f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:35 user nova-compute[73188]: WARNING nova.compute.manager [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received unexpected event network-vif-plugged-f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4 for instance with vm_state building and task_state spawning.
Aug 15 19:07:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-plugged-00607676-9218-41f8-945f-8c4ed6834882 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-plugged-00607676-9218-41f8-945f-8c4ed6834882 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:35 user nova-compute[73188]: WARNING nova.compute.manager [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received unexpected event network-vif-plugged-00607676-9218-41f8-945f-8c4ed6834882 for instance with vm_state building and task_state spawning.
Aug 15 19:07:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-plugged-00607676-9218-41f8-945f-8c4ed6834882 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-plugged-00607676-9218-41f8-945f-8c4ed6834882 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:35 user nova-compute[73188]: WARNING nova.compute.manager [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received unexpected event network-vif-plugged-00607676-9218-41f8-945f-8c4ed6834882 for instance with vm_state building and task_state spawning.
Aug 15 19:07:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-plugged-3cab9f9c-aa69-41e1-b2b1-1397b068fb0f {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-plugged-3cab9f9c-aa69-41e1-b2b1-1397b068fb0f {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:35 user nova-compute[73188]: WARNING nova.compute.manager [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received unexpected event network-vif-plugged-3cab9f9c-aa69-41e1-b2b1-1397b068fb0f for instance with vm_state building and task_state spawning.
Aug 15 19:07:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-plugged-3cab9f9c-aa69-41e1-b2b1-1397b068fb0f {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-plugged-3cab9f9c-aa69-41e1-b2b1-1397b068fb0f {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:35 user nova-compute[73188]: WARNING nova.compute.manager [req-0ae3d49f-844c-462e-89ee-748c17a8b717 req-37260ce7-9089-4975-8e2a-ea2d4c692d0c service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received unexpected event network-vif-plugged-3cab9f9c-aa69-41e1-b2b1-1397b068fb0f for instance with vm_state building and task_state spawning.
Aug 15 19:07:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:35 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Creating config drive at /opt/stack/data/nova/instances/deb3ccb4-136f-4873-959d-edecdc436291/disk.config
Aug 15 19:07:35 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/deb3ccb4-136f-4873-959d-edecdc436291/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp92p0ish6 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/deb3ccb4-136f-4873-959d-edecdc436291/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp92p0ish6" returned: 0 in 0.066s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:36 user nova-compute[73188]: DEBUG nova.compute.manager [req-c976d851-ba7f-4fc3-9948-ec6b5f4fceec req-3ecd4733-0937-4107-a81d-31088b828991 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-plugged-dab59fd7-0d18-4dd9-88f2-27b156f957c4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c976d851-ba7f-4fc3-9948-ec6b5f4fceec req-3ecd4733-0937-4107-a81d-31088b828991 service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c976d851-ba7f-4fc3-9948-ec6b5f4fceec req-3ecd4733-0937-4107-a81d-31088b828991 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c976d851-ba7f-4fc3-9948-ec6b5f4fceec req-3ecd4733-0937-4107-a81d-31088b828991 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:36 user nova-compute[73188]: DEBUG nova.compute.manager [req-c976d851-ba7f-4fc3-9948-ec6b5f4fceec req-3ecd4733-0937-4107-a81d-31088b828991 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-plugged-dab59fd7-0d18-4dd9-88f2-27b156f957c4 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:36 user nova-compute[73188]: WARNING nova.compute.manager [req-c976d851-ba7f-4fc3-9948-ec6b5f4fceec req-3ecd4733-0937-4107-a81d-31088b828991 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received unexpected event network-vif-plugged-dab59fd7-0d18-4dd9-88f2-27b156f957c4 for instance with vm_state building and task_state spawning.
Aug 15 19:07:36 user nova-compute[73188]: DEBUG nova.compute.manager [req-c976d851-ba7f-4fc3-9948-ec6b5f4fceec req-3ecd4733-0937-4107-a81d-31088b828991 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-plugged-95cc8c62-5790-417a-bc3f-ebf4028f99e3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c976d851-ba7f-4fc3-9948-ec6b5f4fceec req-3ecd4733-0937-4107-a81d-31088b828991 service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c976d851-ba7f-4fc3-9948-ec6b5f4fceec req-3ecd4733-0937-4107-a81d-31088b828991 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c976d851-ba7f-4fc3-9948-ec6b5f4fceec req-3ecd4733-0937-4107-a81d-31088b828991 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:36 user nova-compute[73188]: DEBUG nova.compute.manager [req-c976d851-ba7f-4fc3-9948-ec6b5f4fceec req-3ecd4733-0937-4107-a81d-31088b828991 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-plugged-95cc8c62-5790-417a-bc3f-ebf4028f99e3 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:36 user nova-compute[73188]: WARNING nova.compute.manager [req-c976d851-ba7f-4fc3-9948-ec6b5f4fceec req-3ecd4733-0937-4107-a81d-31088b828991 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received unexpected event network-vif-plugged-95cc8c62-5790-417a-bc3f-ebf4028f99e3 for instance with vm_state building and task_state spawning.
Aug 15 19:07:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:37 user nova-compute[73188]: DEBUG nova.compute.manager [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Received event network-changed-933ca0dd-f8d4-4a81-86e9-83a706d12d82 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:37 user nova-compute[73188]: DEBUG nova.compute.manager [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Refreshing instance network info cache due to event network-changed-933ca0dd-f8d4-4a81-86e9-83a706d12d82. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:07:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] Acquiring lock "refresh_cache-c3ca002b-c535-4b87-8d39-861ce6847f12" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] Acquired lock "refresh_cache-c3ca002b-c535-4b87-8d39-861ce6847f12" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:37 user nova-compute[73188]: DEBUG nova.network.neutron [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Refreshing network info cache for port 933ca0dd-f8d4-4a81-86e9-83a706d12d82 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:07:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.network.neutron [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Updated VIF entry in instance network info cache for port 933ca0dd-f8d4-4a81-86e9-83a706d12d82. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.network.neutron [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Updating instance_info_cache with network_info: [{"id": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "address": "fa:16:3e:ce:f4:29", "network": {"id": "574343fe-52ff-4be4-9622-e61a33db8396", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-946260414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4761b15a8dae4f7cab8c13ace5b42ddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933ca0dd-f8", "ovs_interfaceid": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-69815c6f-69b7-496f-ac00-41998f9782be req-b89a9223-f95d-4e11-b8aa-97067a9a3bbe service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-plugged-c169fd9d-21c0-4104-af83-51ee360612b5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-69815c6f-69b7-496f-ac00-41998f9782be req-b89a9223-f95d-4e11-b8aa-97067a9a3bbe service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-69815c6f-69b7-496f-ac00-41998f9782be req-b89a9223-f95d-4e11-b8aa-97067a9a3bbe service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-69815c6f-69b7-496f-ac00-41998f9782be req-b89a9223-f95d-4e11-b8aa-97067a9a3bbe service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-69815c6f-69b7-496f-ac00-41998f9782be req-b89a9223-f95d-4e11-b8aa-97067a9a3bbe service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-plugged-c169fd9d-21c0-4104-af83-51ee360612b5 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:38 user nova-compute[73188]: WARNING nova.compute.manager [req-69815c6f-69b7-496f-ac00-41998f9782be req-b89a9223-f95d-4e11-b8aa-97067a9a3bbe service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received unexpected event network-vif-plugged-c169fd9d-21c0-4104-af83-51ee360612b5 for instance with vm_state building and task_state spawning.
Aug 15 19:07:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] Releasing lock "refresh_cache-c3ca002b-c535-4b87-8d39-861ce6847f12" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-plugged-6bdc6fd6-8a71-4118-b8ed-164cc4315200 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-plugged-6bdc6fd6-8a71-4118-b8ed-164cc4315200 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:38 user nova-compute[73188]: WARNING nova.compute.manager [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received unexpected event network-vif-plugged-6bdc6fd6-8a71-4118-b8ed-164cc4315200 for instance with vm_state building and task_state spawning.
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-plugged-38f2e9d4-a1e3-4d92-a45c-114c4dcb5920 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-plugged-38f2e9d4-a1e3-4d92-a45c-114c4dcb5920 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:38 user nova-compute[73188]: WARNING nova.compute.manager [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received unexpected event network-vif-plugged-38f2e9d4-a1e3-4d92-a45c-114c4dcb5920 for instance with vm_state building and task_state spawning.
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-plugged-38f2e9d4-a1e3-4d92-a45c-114c4dcb5920 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-plugged-38f2e9d4-a1e3-4d92-a45c-114c4dcb5920 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:38 user nova-compute[73188]: WARNING nova.compute.manager [req-082f87e7-928d-4fcd-bb08-de042a8d2821 req-bc4f3b5d-bb61-4136-a0c0-401be38ee4a0 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received unexpected event network-vif-plugged-38f2e9d4-a1e3-4d92-a45c-114c4dcb5920 for instance with vm_state building and task_state spawning.
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-92c169d1-2c0f-4266-a337-2f7b77ea6550 req-b71746e9-b122-4514-9082-0f6d04cb60ed service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-plugged-95cc8c62-5790-417a-bc3f-ebf4028f99e3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-92c169d1-2c0f-4266-a337-2f7b77ea6550 req-b71746e9-b122-4514-9082-0f6d04cb60ed service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-92c169d1-2c0f-4266-a337-2f7b77ea6550 req-b71746e9-b122-4514-9082-0f6d04cb60ed service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-92c169d1-2c0f-4266-a337-2f7b77ea6550 req-b71746e9-b122-4514-9082-0f6d04cb60ed service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-92c169d1-2c0f-4266-a337-2f7b77ea6550 req-b71746e9-b122-4514-9082-0f6d04cb60ed service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-plugged-95cc8c62-5790-417a-bc3f-ebf4028f99e3 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:38 user nova-compute[73188]: WARNING nova.compute.manager [req-92c169d1-2c0f-4266-a337-2f7b77ea6550 req-b71746e9-b122-4514-9082-0f6d04cb60ed service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received unexpected event network-vif-plugged-95cc8c62-5790-417a-bc3f-ebf4028f99e3 for instance with vm_state building and task_state spawning.
Aug 15 19:07:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126458.7231255, 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:07:38 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] VM Resumed (Lifecycle Event)
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:07:38 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Instance spawned successfully.
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:38 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126458.7308319, 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:07:38 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] VM Started (Lifecycle Event)
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:07:38 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:07:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG nova.compute.manager [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-plugged-76516ed7-f500-4002-9ea5-14cb411ef40e {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG nova.compute.manager [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-plugged-76516ed7-f500-4002-9ea5-14cb411ef40e {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:39 user nova-compute[73188]: WARNING nova.compute.manager [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received unexpected event network-vif-plugged-76516ed7-f500-4002-9ea5-14cb411ef40e for instance with vm_state building and task_state spawning.
Aug 15 19:07:39 user nova-compute[73188]: DEBUG nova.compute.manager [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-plugged-76516ed7-f500-4002-9ea5-14cb411ef40e {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG nova.compute.manager [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-plugged-76516ed7-f500-4002-9ea5-14cb411ef40e {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:39 user nova-compute[73188]: WARNING nova.compute.manager [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received unexpected event network-vif-plugged-76516ed7-f500-4002-9ea5-14cb411ef40e for instance with vm_state building and task_state spawning.
Aug 15 19:07:39 user nova-compute[73188]: DEBUG nova.compute.manager [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-plugged-9a3682d0-74e3-46c7-89cc-bc90a5da8de0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG nova.compute.manager [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-plugged-9a3682d0-74e3-46c7-89cc-bc90a5da8de0 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:39 user nova-compute[73188]: WARNING nova.compute.manager [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received unexpected event network-vif-plugged-9a3682d0-74e3-46c7-89cc-bc90a5da8de0 for instance with vm_state building and task_state spawning.
Aug 15 19:07:39 user nova-compute[73188]: DEBUG nova.compute.manager [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-plugged-9a3682d0-74e3-46c7-89cc-bc90a5da8de0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG nova.compute.manager [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-plugged-9a3682d0-74e3-46c7-89cc-bc90a5da8de0 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:39 user nova-compute[73188]: WARNING nova.compute.manager [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received unexpected event network-vif-plugged-9a3682d0-74e3-46c7-89cc-bc90a5da8de0 for instance with vm_state building and task_state spawning.
Aug 15 19:07:39 user nova-compute[73188]: DEBUG nova.compute.manager [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-plugged-59186294-47fd-4da4-8961-419b39b16970 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG nova.compute.manager [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-plugged-59186294-47fd-4da4-8961-419b39b16970 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:39 user nova-compute[73188]: WARNING nova.compute.manager [req-5a9ab8ac-5f17-4850-a178-10d4e514cd75 req-3d9ab9ce-12d7-4de8-96a2-8b7f6ef48ea5 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received unexpected event network-vif-plugged-59186294-47fd-4da4-8961-419b39b16970 for instance with vm_state building and task_state spawning.
Aug 15 19:07:39 user nova-compute[73188]: INFO nova.compute.manager [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Took 13.80 seconds to spawn the instance on the hypervisor.
Aug 15 19:07:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:39 user nova-compute[73188]: INFO nova.compute.manager [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Took 46.16 seconds to build instance.
Aug 15 19:07:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b3819c2b-e532-41fd-9cf3-dbd165852937 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.252s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-2c3ea724-f803-4017-88e4-3d5d67859390 req-f650125b-b2ba-4c90-9425-c612b9f3ad2e service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-plugged-c169fd9d-21c0-4104-af83-51ee360612b5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2c3ea724-f803-4017-88e4-3d5d67859390 req-f650125b-b2ba-4c90-9425-c612b9f3ad2e service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2c3ea724-f803-4017-88e4-3d5d67859390 req-f650125b-b2ba-4c90-9425-c612b9f3ad2e service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2c3ea724-f803-4017-88e4-3d5d67859390 req-f650125b-b2ba-4c90-9425-c612b9f3ad2e service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-2c3ea724-f803-4017-88e4-3d5d67859390 req-f650125b-b2ba-4c90-9425-c612b9f3ad2e service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-plugged-c169fd9d-21c0-4104-af83-51ee360612b5 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:40 user nova-compute[73188]: WARNING nova.compute.manager [req-2c3ea724-f803-4017-88e4-3d5d67859390 req-f650125b-b2ba-4c90-9425-c612b9f3ad2e service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received unexpected event network-vif-plugged-c169fd9d-21c0-4104-af83-51ee360612b5 for instance with vm_state building and task_state spawning.
Aug 15 19:07:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-2c3ea724-f803-4017-88e4-3d5d67859390 req-f650125b-b2ba-4c90-9425-c612b9f3ad2e service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-plugged-b570288f-2a5e-422e-a42f-20acf7269946 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2c3ea724-f803-4017-88e4-3d5d67859390 req-f650125b-b2ba-4c90-9425-c612b9f3ad2e service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2c3ea724-f803-4017-88e4-3d5d67859390 req-f650125b-b2ba-4c90-9425-c612b9f3ad2e service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2c3ea724-f803-4017-88e4-3d5d67859390 req-f650125b-b2ba-4c90-9425-c612b9f3ad2e service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-2c3ea724-f803-4017-88e4-3d5d67859390 req-f650125b-b2ba-4c90-9425-c612b9f3ad2e service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-plugged-b570288f-2a5e-422e-a42f-20acf7269946 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:40 user nova-compute[73188]: WARNING nova.compute.manager [req-2c3ea724-f803-4017-88e4-3d5d67859390 req-f650125b-b2ba-4c90-9425-c612b9f3ad2e service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received unexpected event network-vif-plugged-b570288f-2a5e-422e-a42f-20acf7269946 for instance with vm_state building and task_state spawning.
Aug 15 19:07:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-2c3ea724-f803-4017-88e4-3d5d67859390 req-f650125b-b2ba-4c90-9425-c612b9f3ad2e service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-plugged-b570288f-2a5e-422e-a42f-20acf7269946 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2c3ea724-f803-4017-88e4-3d5d67859390 req-f650125b-b2ba-4c90-9425-c612b9f3ad2e service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2c3ea724-f803-4017-88e4-3d5d67859390 req-f650125b-b2ba-4c90-9425-c612b9f3ad2e service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2c3ea724-f803-4017-88e4-3d5d67859390 req-f650125b-b2ba-4c90-9425-c612b9f3ad2e service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-2c3ea724-f803-4017-88e4-3d5d67859390 req-f650125b-b2ba-4c90-9425-c612b9f3ad2e service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-plugged-b570288f-2a5e-422e-a42f-20acf7269946 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:40 user nova-compute[73188]: WARNING nova.compute.manager [req-2c3ea724-f803-4017-88e4-3d5d67859390 req-f650125b-b2ba-4c90-9425-c612b9f3ad2e service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received unexpected event network-vif-plugged-b570288f-2a5e-422e-a42f-20acf7269946 for instance with vm_state building and task_state spawning.
Aug 15 19:07:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-cc4d0c99-8c0e-4dfb-bdd7-0a3d0f540053 req-48f3e02d-b9ba-4bc3-ab88-9504b0d2d37c service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Received event network-changed-5d901c10-1493-4a6b-b706-cc3979a6b29e {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-cc4d0c99-8c0e-4dfb-bdd7-0a3d0f540053 req-48f3e02d-b9ba-4bc3-ab88-9504b0d2d37c service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Refreshing instance network info cache due to event network-changed-5d901c10-1493-4a6b-b706-cc3979a6b29e. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cc4d0c99-8c0e-4dfb-bdd7-0a3d0f540053 req-48f3e02d-b9ba-4bc3-ab88-9504b0d2d37c service nova] Acquiring lock "refresh_cache-dad06110-8c8a-432a-91d5-8d1b840b26ca" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cc4d0c99-8c0e-4dfb-bdd7-0a3d0f540053 req-48f3e02d-b9ba-4bc3-ab88-9504b0d2d37c service nova] Acquired lock "refresh_cache-dad06110-8c8a-432a-91d5-8d1b840b26ca" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG nova.network.neutron [req-cc4d0c99-8c0e-4dfb-bdd7-0a3d0f540053 req-48f3e02d-b9ba-4bc3-ab88-9504b0d2d37c service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Refreshing network info cache for port 5d901c10-1493-4a6b-b706-cc3979a6b29e {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "c3ca002b-c535-4b87-8d39-861ce6847f12" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "c3ca002b-c535-4b87-8d39-861ce6847f12" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:40 user nova-compute[73188]: DEBUG nova.objects.instance [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lazy-loading 'flavor' on Instance uuid c3ca002b-c535-4b87-8d39-861ce6847f12 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "c3ca002b-c535-4b87-8d39-861ce6847f12" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.121s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "c3ca002b-c535-4b87-8d39-861ce6847f12" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "c3ca002b-c535-4b87-8d39-861ce6847f12" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:41 user nova-compute[73188]: INFO nova.compute.manager [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Attaching volume 5054e99c-bfaf-4184-b118-c0fec7270194 to /dev/vdb
Aug 15 19:07:41 user nova-compute[73188]: DEBUG os_brick.utils [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcce45e-e805-4068-9e60-6f5aa7e555f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4378470-d242-42e7-8187-0badcf62667c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[18253102-2927-4e95-9ead-d028357e6f9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f281e84-1f9e-4d31-9585-51d6319a5791]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-plugged-59186294-47fd-4da4-8961-419b39b16970 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-plugged-59186294-47fd-4da4-8961-419b39b16970 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:41 user nova-compute[73188]: WARNING nova.compute.manager [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received unexpected event network-vif-plugged-59186294-47fd-4da4-8961-419b39b16970 for instance with vm_state building and task_state spawning.
Aug 15 19:07:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-plugged-b6171fcf-6d3c-4e00-b032-e62467a9ff71 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-plugged-b6171fcf-6d3c-4e00-b032-e62467a9ff71 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:41 user nova-compute[73188]: WARNING nova.compute.manager [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received unexpected event network-vif-plugged-b6171fcf-6d3c-4e00-b032-e62467a9ff71 for instance with vm_state building and task_state spawning.
Aug 15 19:07:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-plugged-b6171fcf-6d3c-4e00-b032-e62467a9ff71 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-plugged-b6171fcf-6d3c-4e00-b032-e62467a9ff71 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:41 user nova-compute[73188]: WARNING nova.compute.manager [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received unexpected event network-vif-plugged-b6171fcf-6d3c-4e00-b032-e62467a9ff71 for instance with vm_state building and task_state spawning.
Aug 15 19:07:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-plugged-4e53f593-c9c9-478d-bc1b-f0315d8eb2a5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-plugged-4e53f593-c9c9-478d-bc1b-f0315d8eb2a5 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:41 user nova-compute[73188]: WARNING nova.compute.manager [req-9ecceb6f-7ccc-44d7-b7c4-227fc126f80b req-ca14fd2f-d538-4bf6-bd77-d6f5ddafda63 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received unexpected event network-vif-plugged-4e53f593-c9c9-478d-bc1b-f0315d8eb2a5 for instance with vm_state building and task_state spawning.
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:07:41 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c7477f-41b8-431c-b700-754b3b830b8a]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG os_brick.utils [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Updating existing volume attachment record: a8e8021b-c80c-4f18-b29b-0aec7c87b2f6 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG nova.network.neutron [req-cc4d0c99-8c0e-4dfb-bdd7-0a3d0f540053 req-48f3e02d-b9ba-4bc3-ab88-9504b0d2d37c service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Updated VIF entry in instance network info cache for port 5d901c10-1493-4a6b-b706-cc3979a6b29e. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG nova.network.neutron [req-cc4d0c99-8c0e-4dfb-bdd7-0a3d0f540053 req-48f3e02d-b9ba-4bc3-ab88-9504b0d2d37c service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Updating instance_info_cache with network_info: [{"id": "5d901c10-1493-4a6b-b706-cc3979a6b29e", "address": "fa:16:3e:7d:af:10", "network": {"id": "a465fffd-f8da-440a-8bdc-3c1da367bbc6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-832639605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31d2d81cf9f0431a9f929d80feee45ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d901c10-14", "ovs_interfaceid": "5d901c10-1493-4a6b-b706-cc3979a6b29e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cc4d0c99-8c0e-4dfb-bdd7-0a3d0f540053 req-48f3e02d-b9ba-4bc3-ab88-9504b0d2d37c service nova] Releasing lock "refresh_cache-dad06110-8c8a-432a-91d5-8d1b840b26ca" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:42 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126462.2556715, deb3ccb4-136f-4873-959d-edecdc436291 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:07:42 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: deb3ccb4-136f-4873-959d-edecdc436291] VM Resumed (Lifecycle Event)
Aug 15 19:07:42 user nova-compute[73188]: DEBUG nova.compute.manager [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:07:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:07:42 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Instance spawned successfully.
Aug 15 19:07:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:07:42 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:07:42 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:07:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:07:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:07:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:07:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:07:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:07:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:07:42 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: deb3ccb4-136f-4873-959d-edecdc436291] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:07:42 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126462.2579045, deb3ccb4-136f-4873-959d-edecdc436291 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:07:42 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: deb3ccb4-136f-4873-959d-edecdc436291] VM Started (Lifecycle Event)
Aug 15 19:07:42 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:07:42 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:07:42 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: deb3ccb4-136f-4873-959d-edecdc436291] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:07:42 user nova-compute[73188]: INFO nova.compute.manager [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Took 14.23 seconds to spawn the instance on the hypervisor.
Aug 15 19:07:42 user nova-compute[73188]: DEBUG nova.compute.manager [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:07:42 user nova-compute[73188]: INFO nova.compute.manager [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Took 47.13 seconds to build instance.
Aug 15 19:07:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cc743ab3-63fd-45eb-86cb-83c33ea8cd06 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "deb3ccb4-136f-4873-959d-edecdc436291" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.240s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:42 user nova-compute[73188]: DEBUG nova.compute.manager [req-5d5e1af7-c298-4452-8f35-5d5d286c3975 req-2c74babd-01e7-4528-bba1-824f2b0f6387 service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Received event network-changed-a9ef2f68-c2c1-464b-8942-572fe28ceba3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:42 user nova-compute[73188]: DEBUG nova.compute.manager [req-5d5e1af7-c298-4452-8f35-5d5d286c3975 req-2c74babd-01e7-4528-bba1-824f2b0f6387 service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Refreshing instance network info cache due to event network-changed-a9ef2f68-c2c1-464b-8942-572fe28ceba3. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:07:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5d5e1af7-c298-4452-8f35-5d5d286c3975 req-2c74babd-01e7-4528-bba1-824f2b0f6387 service nova] Acquiring lock "refresh_cache-e8b88f49-7f48-4170-af8a-aa1de706f218" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5d5e1af7-c298-4452-8f35-5d5d286c3975 req-2c74babd-01e7-4528-bba1-824f2b0f6387 service nova] Acquired lock "refresh_cache-e8b88f49-7f48-4170-af8a-aa1de706f218" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:42 user nova-compute[73188]: DEBUG nova.network.neutron [req-5d5e1af7-c298-4452-8f35-5d5d286c3975 req-2c74babd-01e7-4528-bba1-824f2b0f6387 service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Refreshing network info cache for port a9ef2f68-c2c1-464b-8942-572fe28ceba3 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Acquiring lock "e8b88f49-7f48-4170-af8a-aa1de706f218" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Lock "e8b88f49-7f48-4170-af8a-aa1de706f218" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG nova.objects.instance [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Lazy-loading 'flavor' on Instance uuid e8b88f49-7f48-4170-af8a-aa1de706f218 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Lock "e8b88f49-7f48-4170-af8a-aa1de706f218" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG nova.compute.manager [req-83e8e258-c262-433c-91e4-1c035d96bbfd req-f1063434-d0c9-42ac-a993-3cf3b4bf6582 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-plugged-4e53f593-c9c9-478d-bc1b-f0315d8eb2a5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-83e8e258-c262-433c-91e4-1c035d96bbfd req-f1063434-d0c9-42ac-a993-3cf3b4bf6582 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-83e8e258-c262-433c-91e4-1c035d96bbfd req-f1063434-d0c9-42ac-a993-3cf3b4bf6582 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-83e8e258-c262-433c-91e4-1c035d96bbfd req-f1063434-d0c9-42ac-a993-3cf3b4bf6582 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG nova.compute.manager [req-83e8e258-c262-433c-91e4-1c035d96bbfd req-f1063434-d0c9-42ac-a993-3cf3b4bf6582 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-plugged-4e53f593-c9c9-478d-bc1b-f0315d8eb2a5 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:43 user nova-compute[73188]: WARNING nova.compute.manager [req-83e8e258-c262-433c-91e4-1c035d96bbfd req-f1063434-d0c9-42ac-a993-3cf3b4bf6582 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received unexpected event network-vif-plugged-4e53f593-c9c9-478d-bc1b-f0315d8eb2a5 for instance with vm_state active and task_state None.
Aug 15 19:07:43 user nova-compute[73188]: DEBUG nova.network.neutron [req-5d5e1af7-c298-4452-8f35-5d5d286c3975 req-2c74babd-01e7-4528-bba1-824f2b0f6387 service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Updated VIF entry in instance network info cache for port a9ef2f68-c2c1-464b-8942-572fe28ceba3. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG nova.network.neutron [req-5d5e1af7-c298-4452-8f35-5d5d286c3975 req-2c74babd-01e7-4528-bba1-824f2b0f6387 service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Updating instance_info_cache with network_info: [{"id": "a9ef2f68-c2c1-464b-8942-572fe28ceba3", "address": "fa:16:3e:10:15:fd", "network": {"id": "e6808e77-8eb3-4298-a05b-dd25f9f39bb0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-711659466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b49dcc697ced4397bc0760dc41be30cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ef2f68-c2", "ovs_interfaceid": "a9ef2f68-c2c1-464b-8942-572fe28ceba3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5d5e1af7-c298-4452-8f35-5d5d286c3975 req-2c74babd-01e7-4528-bba1-824f2b0f6387 service nova] Releasing lock "refresh_cache-e8b88f49-7f48-4170-af8a-aa1de706f218" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Acquiring lock "e8b88f49-7f48-4170-af8a-aa1de706f218" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Lock "e8b88f49-7f48-4170-af8a-aa1de706f218" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:43 user nova-compute[73188]: INFO nova.compute.manager [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Attaching volume 518df60a-d369-4df0-8fa0-835d956531bd to /dev/vdb
Aug 15 19:07:43 user nova-compute[73188]: DEBUG os_brick.utils [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bd89fa-6f00-4cbc-90c9-e70da8f04aae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1111419-2828-4275-a12d-67d0d79086bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b601205-16d5-497f-aee9-87a0b1a80cff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca40a69-6027-4f60-be0d-bbcc68e462b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:07:43 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:07:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcb2338-ba54-480e-9b30-77b9873ea0c2]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG os_brick.utils [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:07:43 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Updating existing volume attachment record: 3323c011-b47b-4e2d-ac9a-7c976a85971b {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:07:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Acquiring lock "dad06110-8c8a-432a-91d5-8d1b840b26ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "dad06110-8c8a-432a-91d5-8d1b840b26ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:44 user nova-compute[73188]: DEBUG nova.objects.instance [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lazy-loading 'flavor' on Instance uuid dad06110-8c8a-432a-91d5-8d1b840b26ca {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:07:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "dad06110-8c8a-432a-91d5-8d1b840b26ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.113s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Acquiring lock "dad06110-8c8a-432a-91d5-8d1b840b26ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "dad06110-8c8a-432a-91d5-8d1b840b26ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:45 user nova-compute[73188]: INFO nova.compute.manager [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Attaching volume b0ec2add-3d19-43f0-9dff-80bb53118e88 to /dev/sdc
Aug 15 19:07:45 user nova-compute[73188]: DEBUG nova.compute.manager [req-32878f47-31e3-4230-98c7-fc6df20adf8b req-79e32e3a-cecc-44bd-98d4-5fe6f18d45db service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Received event network-changed-d54026b3-10a6-44bb-9cc1-cb52b47fbfe2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG nova.compute.manager [req-32878f47-31e3-4230-98c7-fc6df20adf8b req-79e32e3a-cecc-44bd-98d4-5fe6f18d45db service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Refreshing instance network info cache due to event network-changed-d54026b3-10a6-44bb-9cc1-cb52b47fbfe2. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-32878f47-31e3-4230-98c7-fc6df20adf8b req-79e32e3a-cecc-44bd-98d4-5fe6f18d45db service nova] Acquiring lock "refresh_cache-069eb3a9-59dc-45aa-a664-712ebbbad7e7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-32878f47-31e3-4230-98c7-fc6df20adf8b req-79e32e3a-cecc-44bd-98d4-5fe6f18d45db service nova] Acquired lock "refresh_cache-069eb3a9-59dc-45aa-a664-712ebbbad7e7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG nova.network.neutron [req-32878f47-31e3-4230-98c7-fc6df20adf8b req-79e32e3a-cecc-44bd-98d4-5fe6f18d45db service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Refreshing network info cache for port d54026b3-10a6-44bb-9cc1-cb52b47fbfe2 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG os_brick.utils [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be275a7-4e71-4807-b1d3-4b6b1745a710]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[63568f82-e0c4-49a8-b2ad-c7be7fc76753]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[feac0d6e-8e29-40ab-bdf1-bb06bb2f62be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[380c76b0-361e-4d9f-83aa-9023735de32e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:07:45 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:07:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dba260d-5cd2-4ed3-a99d-3c0c21041130]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG os_brick.utils [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Updating existing volume attachment record: b7d9ac81-6fcc-494e-bc22-f2366451b5db {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Acquiring lock "interface-069eb3a9-59dc-45aa-a664-712ebbbad7e7-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "interface-069eb3a9-59dc-45aa-a664-712ebbbad7e7-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG nova.objects.instance [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lazy-loading 'flavor' on Instance uuid 069eb3a9-59dc-45aa-a664-712ebbbad7e7 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG nova.network.neutron [req-32878f47-31e3-4230-98c7-fc6df20adf8b req-79e32e3a-cecc-44bd-98d4-5fe6f18d45db service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Updated VIF entry in instance network info cache for port d54026b3-10a6-44bb-9cc1-cb52b47fbfe2. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG nova.network.neutron [req-32878f47-31e3-4230-98c7-fc6df20adf8b req-79e32e3a-cecc-44bd-98d4-5fe6f18d45db service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Updating instance_info_cache with network_info: [{"id": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "address": "fa:16:3e:99:31:c4", "network": {"id": "b0e519b5-4707-426d-b7c1-d5fc433bfbaa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2015894405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54026b3-10", "ovs_interfaceid": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-32878f47-31e3-4230-98c7-fc6df20adf8b req-79e32e3a-cecc-44bd-98d4-5fe6f18d45db service nova] Releasing lock "refresh_cache-069eb3a9-59dc-45aa-a664-712ebbbad7e7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:46 user nova-compute[73188]: DEBUG nova.objects.instance [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lazy-loading 'pci_requests' on Instance uuid 069eb3a9-59dc-45aa-a664-712ebbbad7e7 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:07:46 user nova-compute[73188]: DEBUG nova.network.neutron [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:07:46 user nova-compute[73188]: DEBUG nova.policy [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '42c99d8a73ce4d2c9a6c98ebcec844bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6846c6807243379e6b5de3868c2fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:07:47 user nova-compute[73188]: DEBUG nova.network.neutron [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Successfully created port: 60dc2be0-5598-4839-a009-f131a8d2cbda {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:07:47 user nova-compute[73188]: DEBUG nova.compute.manager [req-d4cee73d-f26b-4cfd-93fc-0660273c894a req-9c2b8c7e-f5d2-4b5c-9eba-10804ea88a8a service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Received event network-changed-21d69054-1e25-44d3-bd72-c036ff3f1498 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:47 user nova-compute[73188]: DEBUG nova.compute.manager [req-d4cee73d-f26b-4cfd-93fc-0660273c894a req-9c2b8c7e-f5d2-4b5c-9eba-10804ea88a8a service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Refreshing instance network info cache due to event network-changed-21d69054-1e25-44d3-bd72-c036ff3f1498. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:07:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d4cee73d-f26b-4cfd-93fc-0660273c894a req-9c2b8c7e-f5d2-4b5c-9eba-10804ea88a8a service nova] Acquiring lock "refresh_cache-0d5df01f-2a14-423a-9872-69132a3874ce" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d4cee73d-f26b-4cfd-93fc-0660273c894a req-9c2b8c7e-f5d2-4b5c-9eba-10804ea88a8a service nova] Acquired lock "refresh_cache-0d5df01f-2a14-423a-9872-69132a3874ce" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:47 user nova-compute[73188]: DEBUG nova.network.neutron [req-d4cee73d-f26b-4cfd-93fc-0660273c894a req-9c2b8c7e-f5d2-4b5c-9eba-10804ea88a8a service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Refreshing network info cache for port 21d69054-1e25-44d3-bd72-c036ff3f1498 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG nova.network.neutron [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Successfully updated port: 60dc2be0-5598-4839-a009-f131a8d2cbda {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Acquiring lock "refresh_cache-069eb3a9-59dc-45aa-a664-712ebbbad7e7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Acquired lock "refresh_cache-069eb3a9-59dc-45aa-a664-712ebbbad7e7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG nova.network.neutron [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG nova.compute.manager [req-9e23ab1e-2782-48d6-af76-04e203e50973 req-447b03bc-8f55-41e6-8126-f6982643be69 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Received event network-changed-60dc2be0-5598-4839-a009-f131a8d2cbda {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG nova.compute.manager [req-9e23ab1e-2782-48d6-af76-04e203e50973 req-447b03bc-8f55-41e6-8126-f6982643be69 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Refreshing instance network info cache due to event network-changed-60dc2be0-5598-4839-a009-f131a8d2cbda. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9e23ab1e-2782-48d6-af76-04e203e50973 req-447b03bc-8f55-41e6-8126-f6982643be69 service nova] Acquiring lock "refresh_cache-069eb3a9-59dc-45aa-a664-712ebbbad7e7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG nova.network.neutron [req-d4cee73d-f26b-4cfd-93fc-0660273c894a req-9c2b8c7e-f5d2-4b5c-9eba-10804ea88a8a service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Updated VIF entry in instance network info cache for port 21d69054-1e25-44d3-bd72-c036ff3f1498. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG nova.network.neutron [req-d4cee73d-f26b-4cfd-93fc-0660273c894a req-9c2b8c7e-f5d2-4b5c-9eba-10804ea88a8a service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Updating instance_info_cache with network_info: [{"id": "21d69054-1e25-44d3-bd72-c036ff3f1498", "address": "fa:16:3e:22:74:a1", "network": {"id": "80270e7b-f136-47b6-8ff6-be6ff6bc6381", "bridge": "br-int", "label": "tempest-TestVolumeSwap-984990596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84ad86ad70c74685904ae5ef488e84f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d69054-1e", "ovs_interfaceid": "21d69054-1e25-44d3-bd72-c036ff3f1498", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d4cee73d-f26b-4cfd-93fc-0660273c894a req-9c2b8c7e-f5d2-4b5c-9eba-10804ea88a8a service nova] Releasing lock "refresh_cache-0d5df01f-2a14-423a-9872-69132a3874ce" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG nova.network.neutron [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Updating instance_info_cache with network_info: [{"id": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "address": "fa:16:3e:99:31:c4", "network": {"id": "b0e519b5-4707-426d-b7c1-d5fc433bfbaa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2015894405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54026b3-10", "ovs_interfaceid": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60dc2be0-5598-4839-a009-f131a8d2cbda", "address": "fa:16:3e:7c:b2:ff", "network": {"id": "2f260535-49bd-4da7-90bb-a9e20001c971", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-606058894", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dc2be0-55", "ovs_interfaceid": "60dc2be0-5598-4839-a009-f131a8d2cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Releasing lock "refresh_cache-069eb3a9-59dc-45aa-a664-712ebbbad7e7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9e23ab1e-2782-48d6-af76-04e203e50973 req-447b03bc-8f55-41e6-8126-f6982643be69 service nova] Acquired lock "refresh_cache-069eb3a9-59dc-45aa-a664-712ebbbad7e7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG nova.network.neutron [req-9e23ab1e-2782-48d6-af76-04e203e50973 req-447b03bc-8f55-41e6-8126-f6982643be69 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Refreshing network info cache for port 60dc2be0-5598-4839-a009-f131a8d2cbda {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:05:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-346712273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-346712273',id=7,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI7jXbeKw9zkf9/iIPvh7NB96wHBiVSd3tkGEgzRo7xcm/prE4XrAY5tS3bsMANa/m2oKIroukS/BgU5oVeuE62dlrCZmBmzDdHgRhV9W1LqC6AQ0bblC4H1qHiGzHZfg==',key_name='tempest-keypair-223053783',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:06:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb6846c6807243379e6b5de3868c2fb2',ramdisk_id='',reservation_id='r-krs477l0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-241567705',owner_user_name='tempest-TaggedAttachmentsTest-241567705-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:06:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42c99d8a73ce4d2c9a6c98ebcec844bf',uuid=069eb3a9-59dc-45aa-a664-712ebbbad7e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60dc2be0-5598-4839-a009-f131a8d2cbda", "address": "fa:16:3e:7c:b2:ff", "network": {"id": "2f260535-49bd-4da7-90bb-a9e20001c971", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-606058894", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dc2be0-55", "ovs_interfaceid": "60dc2be0-5598-4839-a009-f131a8d2cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Converting VIF {"id": "60dc2be0-5598-4839-a009-f131a8d2cbda", "address": "fa:16:3e:7c:b2:ff", "network": {"id": "2f260535-49bd-4da7-90bb-a9e20001c971", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-606058894", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dc2be0-55", "ovs_interfaceid": "60dc2be0-5598-4839-a009-f131a8d2cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b2:ff,bridge_name='br-int',has_traffic_filtering=True,id=60dc2be0-5598-4839-a009-f131a8d2cbda,network=Network(2f260535-49bd-4da7-90bb-a9e20001c971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dc2be0-55') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG os_vif [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b2:ff,bridge_name='br-int',has_traffic_filtering=True,id=60dc2be0-5598-4839-a009-f131a8d2cbda,network=Network(2f260535-49bd-4da7-90bb-a9e20001c971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dc2be0-55') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60dc2be0-55, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap60dc2be0-55, col_values=(('external_ids', {'iface-id': '60dc2be0-5598-4839-a009-f131a8d2cbda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:b2:ff', 'vm-uuid': '069eb3a9-59dc-45aa-a664-712ebbbad7e7'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:07:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:49 user nova-compute[73188]: INFO os_vif [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b2:ff,bridge_name='br-int',has_traffic_filtering=True,id=60dc2be0-5598-4839-a009-f131a8d2cbda,network=Network(2f260535-49bd-4da7-90bb-a9e20001c971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dc2be0-55')
Aug 15 19:07:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:05:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-346712273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-346712273',id=7,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI7jXbeKw9zkf9/iIPvh7NB96wHBiVSd3tkGEgzRo7xcm/prE4XrAY5tS3bsMANa/m2oKIroukS/BgU5oVeuE62dlrCZmBmzDdHgRhV9W1LqC6AQ0bblC4H1qHiGzHZfg==',key_name='tempest-keypair-223053783',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:06:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb6846c6807243379e6b5de3868c2fb2',ramdisk_id='',reservation_id='r-krs477l0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-241567705',owner_user_name='tempest-TaggedAttachmentsTest-241567705-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:06:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42c99d8a73ce4d2c9a6c98ebcec844bf',uuid=069eb3a9-59dc-45aa-a664-712ebbbad7e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60dc2be0-5598-4839-a009-f131a8d2cbda", "address": "fa:16:3e:7c:b2:ff", "network": {"id": "2f260535-49bd-4da7-90bb-a9e20001c971", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-606058894", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dc2be0-55", "ovs_interfaceid": "60dc2be0-5598-4839-a009-f131a8d2cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Converting VIF {"id": "60dc2be0-5598-4839-a009-f131a8d2cbda", "address": "fa:16:3e:7c:b2:ff", "network": {"id": "2f260535-49bd-4da7-90bb-a9e20001c971", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-606058894", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dc2be0-55", "ovs_interfaceid": "60dc2be0-5598-4839-a009-f131a8d2cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b2:ff,bridge_name='br-int',has_traffic_filtering=True,id=60dc2be0-5598-4839-a009-f131a8d2cbda,network=Network(2f260535-49bd-4da7-90bb-a9e20001c971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dc2be0-55') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] attach device xml: <interface type="ethernet">
Aug 15 19:07:49 user nova-compute[73188]:   <mac address="fa:16:3e:7c:b2:ff"/>
Aug 15 19:07:49 user nova-compute[73188]:   <model type="virtio"/>
Aug 15 19:07:49 user nova-compute[73188]:   <mtu size="1442"/>
Aug 15 19:07:49 user nova-compute[73188]:   <target dev="tap60dc2be0-55"/>
Aug 15 19:07:49 user nova-compute[73188]: </interface>
Aug 15 19:07:49 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG nova.network.neutron [req-9e23ab1e-2782-48d6-af76-04e203e50973 req-447b03bc-8f55-41e6-8126-f6982643be69 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Updated VIF entry in instance network info cache for port 60dc2be0-5598-4839-a009-f131a8d2cbda. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG nova.network.neutron [req-9e23ab1e-2782-48d6-af76-04e203e50973 req-447b03bc-8f55-41e6-8126-f6982643be69 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Updating instance_info_cache with network_info: [{"id": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "address": "fa:16:3e:99:31:c4", "network": {"id": "b0e519b5-4707-426d-b7c1-d5fc433bfbaa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2015894405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54026b3-10", "ovs_interfaceid": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "60dc2be0-5598-4839-a009-f131a8d2cbda", "address": "fa:16:3e:7c:b2:ff", "network": {"id": "2f260535-49bd-4da7-90bb-a9e20001c971", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-606058894", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dc2be0-55", "ovs_interfaceid": "60dc2be0-5598-4839-a009-f131a8d2cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9e23ab1e-2782-48d6-af76-04e203e50973 req-447b03bc-8f55-41e6-8126-f6982643be69 service nova] Releasing lock "refresh_cache-069eb3a9-59dc-45aa-a664-712ebbbad7e7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] No BDM found with device name hda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] No VIF found with MAC fa:16:3e:99:31:c4, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:07:49 user nova-compute[73188]:   <nova:package version="0.0.0"/>
Aug 15 19:07:49 user nova-compute[73188]:   <nova:name>tempest-device-tagging-server-346712273</nova:name>
Aug 15 19:07:49 user nova-compute[73188]:   <nova:creationTime>2023-08-15 19:07:49</nova:creationTime>
Aug 15 19:07:49 user nova-compute[73188]:   <nova:flavor name="m1.tiny">
Aug 15 19:07:49 user nova-compute[73188]:     <nova:memory>512</nova:memory>
Aug 15 19:07:49 user nova-compute[73188]:     <nova:disk>1</nova:disk>
Aug 15 19:07:49 user nova-compute[73188]:     <nova:swap>0</nova:swap>
Aug 15 19:07:49 user nova-compute[73188]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:07:49 user nova-compute[73188]:     <nova:vcpus>1</nova:vcpus>
Aug 15 19:07:49 user nova-compute[73188]:   </nova:flavor>
Aug 15 19:07:49 user nova-compute[73188]:   <nova:owner>
Aug 15 19:07:49 user nova-compute[73188]:     <nova:user uuid="42c99d8a73ce4d2c9a6c98ebcec844bf">tempest-TaggedAttachmentsTest-241567705-project-member</nova:user>
Aug 15 19:07:49 user nova-compute[73188]:     <nova:project uuid="eb6846c6807243379e6b5de3868c2fb2">tempest-TaggedAttachmentsTest-241567705</nova:project>
Aug 15 19:07:49 user nova-compute[73188]:   </nova:owner>
Aug 15 19:07:49 user nova-compute[73188]:   <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:07:49 user nova-compute[73188]:   <nova:ports>
Aug 15 19:07:49 user nova-compute[73188]:     <nova:port uuid="d54026b3-10a6-44bb-9cc1-cb52b47fbfe2">
Aug 15 19:07:49 user nova-compute[73188]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 19:07:49 user nova-compute[73188]:     </nova:port>
Aug 15 19:07:49 user nova-compute[73188]:     <nova:port uuid="60dc2be0-5598-4839-a009-f131a8d2cbda">
Aug 15 19:07:49 user nova-compute[73188]:       <nova:ip type="fixed" address="10.10.10.206" ipVersion="4"/>
Aug 15 19:07:49 user nova-compute[73188]:     </nova:port>
Aug 15 19:07:49 user nova-compute[73188]:   </nova:ports>
Aug 15 19:07:49 user nova-compute[73188]: </nova:instance>
Aug 15 19:07:49 user nova-compute[73188]:  {{(pid=73188) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG nova.compute.manager [req-4fd5da7c-a38e-4560-b9d0-6e830f245ed9 req-9227dbbb-7d1a-400c-8745-8e3aa17ab937 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Received event network-vif-plugged-60dc2be0-5598-4839-a009-f131a8d2cbda {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4fd5da7c-a38e-4560-b9d0-6e830f245ed9 req-9227dbbb-7d1a-400c-8745-8e3aa17ab937 service nova] Acquiring lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4fd5da7c-a38e-4560-b9d0-6e830f245ed9 req-9227dbbb-7d1a-400c-8745-8e3aa17ab937 service nova] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4fd5da7c-a38e-4560-b9d0-6e830f245ed9 req-9227dbbb-7d1a-400c-8745-8e3aa17ab937 service nova] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG nova.compute.manager [req-4fd5da7c-a38e-4560-b9d0-6e830f245ed9 req-9227dbbb-7d1a-400c-8745-8e3aa17ab937 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] No waiting events found dispatching network-vif-plugged-60dc2be0-5598-4839-a009-f131a8d2cbda {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:49 user nova-compute[73188]: WARNING nova.compute.manager [req-4fd5da7c-a38e-4560-b9d0-6e830f245ed9 req-9227dbbb-7d1a-400c-8745-8e3aa17ab937 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Received unexpected event network-vif-plugged-60dc2be0-5598-4839-a009-f131a8d2cbda for instance with vm_state active and task_state None.
Aug 15 19:07:49 user nova-compute[73188]: DEBUG nova.compute.manager [req-4fd5da7c-a38e-4560-b9d0-6e830f245ed9 req-9227dbbb-7d1a-400c-8745-8e3aa17ab937 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Received event network-vif-plugged-60dc2be0-5598-4839-a009-f131a8d2cbda {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4fd5da7c-a38e-4560-b9d0-6e830f245ed9 req-9227dbbb-7d1a-400c-8745-8e3aa17ab937 service nova] Acquiring lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4fd5da7c-a38e-4560-b9d0-6e830f245ed9 req-9227dbbb-7d1a-400c-8745-8e3aa17ab937 service nova] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4fd5da7c-a38e-4560-b9d0-6e830f245ed9 req-9227dbbb-7d1a-400c-8745-8e3aa17ab937 service nova] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG nova.compute.manager [req-4fd5da7c-a38e-4560-b9d0-6e830f245ed9 req-9227dbbb-7d1a-400c-8745-8e3aa17ab937 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] No waiting events found dispatching network-vif-plugged-60dc2be0-5598-4839-a009-f131a8d2cbda {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:07:49 user nova-compute[73188]: WARNING nova.compute.manager [req-4fd5da7c-a38e-4560-b9d0-6e830f245ed9 req-9227dbbb-7d1a-400c-8745-8e3aa17ab937 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Received unexpected event network-vif-plugged-60dc2be0-5598-4839-a009-f131a8d2cbda for instance with vm_state active and task_state None.
Aug 15 19:07:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-43adbff8-c5ea-429f-a640-4fdfd31bdfab tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "interface-069eb3a9-59dc-45aa-a664-712ebbbad7e7-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.105s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnjZWztd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:07:54 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:07:54 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:07:54 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c943b32f-db36-4c41-85d0-589824114eb3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:07:54 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0c8d62-33ba-498f-8e87-978d7813518d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194] added
Aug 15 19:07:54 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7748d794-02ed-4440-8dfc-b5fc6b76a6be]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a693804-a2e1-42b5-9621-d4a24dc2a368]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xnjZWztd {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xnjZWztd" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4491c6-5e2c-44ad-a66f-94f47e64f2b1]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xnjZWztd'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[85786d59-dda7-4265-bd04-2908ab45c49a]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87844a2-d0fd-4bae-928f-4674bf5d08b7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:07:54 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:07:54 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Acquiring lock "0d5df01f-2a14-423a-9872-69132a3874ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "0d5df01f-2a14-423a-9872-69132a3874ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG nova.objects.instance [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lazy-loading 'flavor' on Instance uuid 0d5df01f-2a14-423a-9872-69132a3874ce {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Acquiring lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8c386c-6fc9-4be7-9cd4-5eb80619f70c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194, portal: 172.16.0.220,3260]
Aug 15 19:07:54 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194, portal: 172.16.0.220,3260] successful.
Aug 15 19:07:54 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "0d5df01f-2a14-423a-9872-69132a3874ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG nova.objects.instance [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lazy-loading 'flavor' on Instance uuid 069eb3a9-59dc-45aa-a664-712ebbbad7e7 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[827881e8-bec8-4f01-a2c2-9cc5f9f6dc35]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5234768-d925-4c02-b500-c9597d451187]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 (non-flash)
Aug 15 19:07:54 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:07:54 user nova-compute[73188]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 (non-flash)
Aug 15 19:07:54 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ba6bb9-5605-416b-bdbe-151d9beda349]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnjZWztd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Acquiring lock "0d5df01f-2a14-423a-9872-69132a3874ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "0d5df01f-2a14-423a-9872-69132a3874ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:54 user nova-compute[73188]: INFO nova.compute.manager [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Attaching volume 0ebdb52c-10ca-4922-aeb0-2cd724546178 to /dev/vdb
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Acquiring lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:54 user nova-compute[73188]: INFO nova.compute.manager [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Attaching volume 25e7ff05-a1e4-417c-9aec-b5754d8341fb to /dev/vdb
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.utils [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8a05e9-7f5f-485e-8e69-4fe1ec73aec3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8b55dc-5765-4d38-a61f-4c1c32c95ea1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.utils [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d31f5c-7021-461a-bc42-7dc969f9204c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ce1c71-53ae-49c5-b203-e8974c4023eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af39606-f930-42fd-810e-aecc48fb6b8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:07:54 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e9e56e-083a-4509-b6b7-e7455c2101e1]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG os_brick.utils [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Updating existing volume attachment record: 419f07ab-a671-4abb-8946-54d0c3624c77 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82ce188-8beb-490e-8d89-7ac234ef6909]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafd8c6a-4b9b-4291-92e2-6e3b6c379f1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4196914c-d218-4bd9-b0bd-77e0c315c233]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:55 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:07:55 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:07:55 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:55 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:07:55 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:07:55 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[135d43b9-3522-4d92-ab5b-3fdd98b0bb9a]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:55 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:07:55 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:07:55 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:07:55 user nova-compute[73188]: DEBUG os_brick.utils [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:07:55 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Updating existing volume attachment record: a6bd5079-284c-473f-bd86-de2316ff2bdf {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:07:55 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:07:55 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '26561306335343030', 'path': '/dev/sdi'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:07:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561306335343030', 'path': '/dev/sdi'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:07:55 user nova-compute[73188]: DEBUG nova.objects.instance [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lazy-loading 'flavor' on Instance uuid c3ca002b-c535-4b87-8d39-861ce6847f12 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:07:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:07:55 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:07:55 user nova-compute[73188]:   <source dev="/dev/sdi"/>
Aug 15 19:07:55 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:07:55 user nova-compute[73188]:   <serial>5054e99c-bfaf-4184-b118-c0fec7270194</serial>
Aug 15 19:07:55 user nova-compute[73188]: </disk>
Aug 15 19:07:55 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:07:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:07:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:07:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] No VIF found with MAC fa:16:3e:ce:f4:29, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IsjNDMBT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:07:56 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:07:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:07:56 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:07:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:07:56 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3bae8e-030a-4ad1-9f72-119dc5f4eef8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:07:56 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[866922ff-da7e-464f-8ceb-46f65bcf8738]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd] added
Aug 15 19:07:56 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0c996b-7ad0-4896-9420-4668e6c7a9b8]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[875b846c-776a-497b-a0c2-b98918f546c1]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IsjNDMBT {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IsjNDMBT" returned: 0 in 0.032s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6457a2d4-7de0-4749-b8e1-ab0861ce716c]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IsjNDMBT'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41e7c22-c1e1-4e9f-a3af-60ca7e2d7578]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc486ba-8ca6-4561-9f25-9838dbc178e6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 (non-flash)
Aug 15 19:07:56 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 (non-flash)
Aug 15 19:07:56 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb234af0-a158-4f48-bcf1-14556c492424]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd, portal: 172.16.0.220,3260]
Aug 15 19:07:56 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd, portal: 172.16.0.220,3260] successful.
Aug 15 19:07:56 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[46929431-9e3c-440d-a3af-651225adaae3]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[596dbce3-e826-4b17-9352-60bbb6ce9b4b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 (non-flash)
Aug 15 19:07:56 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:07:56 user nova-compute[73188]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 (non-flash)
Aug 15 19:07:56 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.426s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.043s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b209af31-f7e4-4462-a4a5-1420affb4dcf]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:56 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: None {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:07:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:07:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aAtpVkDe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:07:57 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:07:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:07:57 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:07:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IsjNDMBT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:07:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.494s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:07:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] <== connect_volume: return (1496ms) {'type': 'block', 'scsi_wwn': '23666666239353763', 'path': '/dev/sdj'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:07:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666666239353763', 'path': '/dev/sdj'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:07:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.046s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:07:57 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:07:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:07:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:07:57 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:07:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:57 user nova-compute[73188]: DEBUG nova.objects.instance [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Lazy-loading 'flavor' on Instance uuid e8b88f49-7f48-4170-af8a-aa1de706f218 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:07:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[991db7bd-d682-427d-82f8-4c3a1e5663fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:07:57 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b9e164-711f-4555-82cb-f5833e35c4b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88] added
Aug 15 19:07:57 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[96edffa3-5440-4e58-b9b0-700943cbdaa2]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0505ed12-4eae-4641-b4bf-572bff39f03f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] attach device xml: <disk type="block" device="disk">
Aug 15 19:07:58 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:07:58 user nova-compute[73188]:   <source dev="/dev/sdj"/>
Aug 15 19:07:58 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:07:58 user nova-compute[73188]:   <serial>518df60a-d369-4df0-8fa0-835d956531bd</serial>
Aug 15 19:07:58 user nova-compute[73188]: </disk>
Aug 15 19:07:58 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aAtpVkDe {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aAtpVkDe" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3960b983-e9a1-4e0e-a8cf-d99a2ffb5d28]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aAtpVkDe'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[553fd473-39a2-475d-a00f-6f3fb5762696]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2976c09a-df42-4a90-ac38-a96b1d451dfe]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 (non-flash)
Aug 15 19:07:58 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 (non-flash)
Aug 15 19:07:58 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5d683734-295e-4b61-82e6-aaba9c0dc8b4 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "c3ca002b-c535-4b87-8d39-861ce6847f12" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.933s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f16ef6-7b93-40ba-ad43-1a51a37f5d01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88, portal: 172.16.0.220,3260]
Aug 15 19:07:58 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88, portal: 172.16.0.220,3260] successful.
Aug 15 19:07:58 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bf1e54-3f69-4fd7-8e1e-916b75e119f4]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da23c1b-c5ad-4036-99f1-477801adbd85]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 (non-flash)
Aug 15 19:07:58 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:07:58 user nova-compute[73188]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 (non-flash)
Aug 15 19:07:58 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] HCTL ('42', '-', '-', 0) found on session 11 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afa4fa2-73fc-41cc-a8ea-e6c7be7f413e]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aAtpVkDe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] No VIF found with MAC fa:16:3e:10:15:fd, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-47b87a9f-ba36-4847-a201-64b4487b8dde tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Lock "e8b88f49-7f48-4170-af8a-aa1de706f218" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.018s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:07:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "c3ca002b-c535-4b87-8d39-861ce6847f12" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "c3ca002b-c535-4b87-8d39-861ce6847f12" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:59 user nova-compute[73188]: INFO nova.compute.manager [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Detaching volume 5054e99c-bfaf-4184-b118-c0fec7270194
Aug 15 19:07:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-052336c6-a197-4e5a-9f42-fa0a3ae197ba tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] volume_snapshot_create: create_info: {'snapshot_id': '9bf6da9c-5d36-40e8-9cc7-ed4a8dd8f3b1', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73188) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-052336c6-a197-4e5a-9f42-fa0a3ae197ba tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] snap xml: <domainsnapshot>
Aug 15 19:07:59 user nova-compute[73188]:   <disks>
Aug 15 19:07:59 user nova-compute[73188]:     <disk name="/dev/sdj" snapshot="external" type="file">
Aug 15 19:07:59 user nova-compute[73188]:       <source file="/dev/new_file"/>
Aug 15 19:07:59 user nova-compute[73188]:     </disk>
Aug 15 19:07:59 user nova-compute[73188]:     <disk name="vda" snapshot="no"/>
Aug 15 19:07:59 user nova-compute[73188]:   </disks>
Aug 15 19:07:59 user nova-compute[73188]: </domainsnapshot>
Aug 15 19:07:59 user nova-compute[73188]:  {{(pid=73188) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG nova.objects.instance [None req-052336c6-a197-4e5a-9f42-fa0a3ae197ba tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Lazy-loading 'system_metadata' on Instance uuid e8b88f49-7f48-4170-af8a-aa1de706f218 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:07:59 user nova-compute[73188]: INFO nova.virt.block_device [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Attempting to driver detach volume 5054e99c-bfaf-4184-b118-c0fec7270194 from mountpoint /dev/vdb
Aug 15 19:07:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Attempting to detach device vdb from instance c3ca002b-c535-4b87-8d39-861ce6847f12 from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:07:59 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:07:59 user nova-compute[73188]:   <source dev="/dev/sdi"/>
Aug 15 19:07:59 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:07:59 user nova-compute[73188]:   <serial>5054e99c-bfaf-4184-b118-c0fec7270194</serial>
Aug 15 19:07:59 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:07:59 user nova-compute[73188]: </disk>
Aug 15 19:07:59 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:07:59 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-052336c6-a197-4e5a-9f42-fa0a3ae197ba tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 19:07:59 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Successfully detached device vdb from instance c3ca002b-c535-4b87-8d39-861ce6847f12 from the persistent domain config.
Aug 15 19:07:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c3ca002b-c535-4b87-8d39-861ce6847f12 from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:07:59 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:07:59 user nova-compute[73188]:   <source dev="/dev/sdi"/>
Aug 15 19:07:59 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:07:59 user nova-compute[73188]:   <serial>5054e99c-bfaf-4184-b118-c0fec7270194</serial>
Aug 15 19:07:59 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:07:59 user nova-compute[73188]: </disk>
Aug 15 19:07:59 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [None req-052336c6-a197-4e5a-9f42-fa0a3ae197ba tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Traceback (most recent call last):
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]     rv = execute(f, *args, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]     six.reraise(c, e, tb)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]     raise value
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]     rv = meth(*args, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] 
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [None req-052336c6-a197-4e5a-9f42-fa0a3ae197ba tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Traceback (most recent call last):
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]     self._volume_snapshot_create(context, instance, guest,
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]     rv = execute(f, *args, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]     six.reraise(c, e, tb)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]     raise value
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]     rv = meth(*args, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] 
Aug 15 19:07:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.582s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] <== connect_volume: return (1627ms) {'type': 'block', 'scsi_wwn': '23665383733363838', 'path': '/dev/sdk'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665383733363838', 'path': '/dev/sdk'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-54ee3954-807b-4b36-936a-c50855b8bc91 tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] volume_snapshot_delete: delete_info: {'volume_id': '518df60a-d369-4df0-8fa0-835d956531bd'} {{(pid=73188) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [None req-54ee3954-807b-4b36-936a-c50855b8bc91 tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Traceback (most recent call last):
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218]     if delete_info['type'] != 'qcow2':
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] KeyError: 'type'
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] 
Aug 15 19:07:59 user nova-compute[73188]: DEBUG nova.objects.instance [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lazy-loading 'flavor' on Instance uuid dad06110-8c8a-432a-91d5-8d1b840b26ca {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [None req-052336c6-a197-4e5a-9f42-fa0a3ae197ba tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 9bf6da9c-5d36-40e8-9cc7-ed4a8dd8f3b1 could not be found.
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     raise value
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver 
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver 
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 9bf6da9c-5d36-40e8-9cc7-ed4a8dd8f3b1 could not be found. (HTTP 404) (Request-ID: req-48f8c5d8-2dd7-4b76-bf90-23d24c5ce59a)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver 
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver 
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 9bf6da9c-5d36-40e8-9cc7-ed4a8dd8f3b1 could not be found.
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver 
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server [None req-052336c6-a197-4e5a-9f42-fa0a3ae197ba tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     raise value
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server 
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver [None req-54ee3954-807b-4b36-936a-c50855b8bc91 tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver 
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver 
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-bfe315a8-87fb-47c1-8a64-ecfd518b817b)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver 
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver 
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 15 19:07:59 user nova-compute[73188]: ERROR nova.virt.libvirt.driver 
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server [None req-54ee3954-807b-4b36-936a-c50855b8bc91 tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Exception during message handling: KeyError: 'type'
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 15 19:07:59 user nova-compute[73188]: ERROR oslo_messaging.rpc.server 
Aug 15 19:07:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:07:59 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:07:59 user nova-compute[73188]:   <source dev="/dev/sdk"/>
Aug 15 19:07:59 user nova-compute[73188]:   <target dev="sdc" bus="scsi"/>
Aug 15 19:07:59 user nova-compute[73188]:   <serial>b0ec2add-3d19-43f0-9dff-80bb53118e88</serial>
Aug 15 19:07:59 user nova-compute[73188]:   <address type="drive" controller="0" unit="2"/>
Aug 15 19:07:59 user nova-compute[73188]: </disk>
Aug 15 19:07:59 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Acquiring lock "e8b88f49-7f48-4170-af8a-aa1de706f218" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Lock "e8b88f49-7f48-4170-af8a-aa1de706f218" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692126479.8246467, c3ca002b-c535-4b87-8d39-861ce6847f12 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:07:59 user nova-compute[73188]: INFO nova.compute.manager [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Detaching volume 518df60a-d369-4df0-8fa0-835d956531bd
Aug 15 19:07:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c3ca002b-c535-4b87-8d39-861ce6847f12 {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:07:59 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Successfully detached device vdb from instance c3ca002b-c535-4b87-8d39-861ce6847f12 from the live domain config.
Aug 15 19:07:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnjZWztd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:07:59 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:07:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc77043-cd83-4f56-b7f4-498cf6c9b368]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:59 user nova-compute[73188]: INFO nova.virt.block_device [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Attempting to driver detach volume 518df60a-d369-4df0-8fa0-835d956531bd from mountpoint /dev/vdb
Aug 15 19:07:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Attempting to detach device vdb from instance e8b88f49-7f48-4170-af8a-aa1de706f218 from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] detach device xml: <disk type="block" device="disk">
Aug 15 19:07:59 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:07:59 user nova-compute[73188]:   <source dev="/dev/sdj"/>
Aug 15 19:07:59 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:07:59 user nova-compute[73188]:   <serial>518df60a-d369-4df0-8fa0-835d956531bd</serial>
Aug 15 19:07:59 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:07:59 user nova-compute[73188]: </disk>
Aug 15 19:07:59 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7cc1af-5b99-481e-8399-b3ca565dba2f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd (non-flash)
Aug 15 19:07:59 user nova-compute[73188]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 (non-flash)
Aug 15 19:07:59 user nova-compute[73188]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:59 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:59 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:59 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:59 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:59 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:07:59 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:07:59 user nova-compute[73188]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 (non-flash)
Aug 15 19:07:59 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd (non-flash)
Aug 15 19:07:59 user nova-compute[73188]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 (non-flash)
Aug 15 19:07:59 user nova-compute[73188]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:07:59 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:07:59 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:07:59 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:07:59 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:07:59 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:07:59 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:07:59 user nova-compute[73188]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 (non-flash)
Aug 15 19:07:59 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2810082d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194'): ({'sdi'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Removing single pathed devices sdi {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:07:59 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Successfully detached device vdb from instance e8b88f49-7f48-4170-af8a-aa1de706f218 from the persistent domain config.
Aug 15 19:07:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e8b88f49-7f48-4170-af8a-aa1de706f218 from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] detach device xml: <disk type="block" device="disk">
Aug 15 19:07:59 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:07:59 user nova-compute[73188]:   <source dev="/dev/sdj"/>
Aug 15 19:07:59 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:07:59 user nova-compute[73188]:   <serial>518df60a-d369-4df0-8fa0-835d956531bd</serial>
Aug 15 19:07:59 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:07:59 user nova-compute[73188]: </disk>
Aug 15 19:07:59 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3e00b3-f894-4422-b090-b73f6c6d4395]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:07:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f03259f-4952-43d9-8503-101bbaabfdfb]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Flushing IO for device /dev/sdi {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d885888-83dc-4a36-ac5d-59d9bf4d9f5c]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.055s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e77e061-7a70-446a-8a4d-6f911af59ac6]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] SCSI volumes sdi have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[63424407-5d26-457d-9b7a-1c324aa0089e]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f4be24-da2e-42cb-a081-6e1b2b495207]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194, portal: 172.16.0.220,3260]
Aug 15 19:08:00 user nova-compute[73188]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194, portal: 172.16.0.220,3260] successful.
Aug 15 19:08:00 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5054e99c-bfaf-4184-b118-c0fec7270194 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.094s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f622f64-e501-437d-a3e5-99739afdcbfb]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.478s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] <== disconnect_volume: return (479ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692126480.5720181, e8b88f49-7f48-4170-af8a-aa1de706f218 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e8b88f49-7f48-4170-af8a-aa1de706f218 {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:08:00 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Successfully detached device vdb from instance e8b88f49-7f48-4170-af8a-aa1de706f218 from the live domain config.
Aug 15 19:08:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IsjNDMBT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:08:00 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb14236-a44f-4bfe-8dc2-11957e662627]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[686a6915-4837-4c5f-bef7-73da43dd3ad7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd (non-flash)
Aug 15 19:08:00 user nova-compute[73188]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 (non-flash)
Aug 15 19:08:00 user nova-compute[73188]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:00 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:00 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:00 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:00 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:00 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:00 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:00 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd (non-flash)
Aug 15 19:08:00 user nova-compute[73188]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 (non-flash)
Aug 15 19:08:00 user nova-compute[73188]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:00 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:00 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:00 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:00 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:00 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:00 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:00 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28101e81f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd'): ({'sdj'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Removing single pathed devices sdj {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffd4e6d-1b4a-45f4-a627-7b05cdaa119e]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f978e221-1008-4386-b92c-79ce0b4f950a]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Flushing IO for device /dev/sdj {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] No BDM found with device name sda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] No VIF found with MAC fa:16:3e:7d:af:10, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85e129f-4c83-4a95-9bbc-865a83214e3a]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.045s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1264bab-b999-4c18-bbb4-7a4e478b4181]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] SCSI volumes sdj have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[658e9098-01d7-4182-97bf-9bb27c1b4b2a]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4a50bd-340d-406d-a26c-a37155e29db6]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd, portal: 172.16.0.220,3260]
Aug 15 19:08:00 user nova-compute[73188]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd, portal: 172.16.0.220,3260] successful.
Aug 15 19:08:00 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:518df60a-d369-4df0-8fa0-835d956531bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a800bb57-56f2-4c0b-bf23-d5ada3162dec]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] <== disconnect_volume: return (387ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:08:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:08:01 user nova-compute[73188]: DEBUG nova.objects.instance [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lazy-loading 'flavor' on Instance uuid c3ca002b-c535-4b87-8d39-861ce6847f12 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9b26917b-03eb-4cdc-8bad-7fce15cf752d tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "c3ca002b-c535-4b87-8d39-861ce6847f12" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.590s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ce437d16-951f-4f36-bc0e-732862999908 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "dad06110-8c8a-432a-91d5-8d1b840b26ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.605s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:02 user nova-compute[73188]: DEBUG nova.objects.instance [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Lazy-loading 'flavor' on Instance uuid e8b88f49-7f48-4170-af8a-aa1de706f218 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-aa48011e-6720-40b3-96b9-4d843a6ade2a tempest-VolumesAssistedSnapshotsTest-35219815 tempest-VolumesAssistedSnapshotsTest-35219815-project-admin] Lock "e8b88f49-7f48-4170-af8a-aa1de706f218" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.140s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Acquiring lock "dad06110-8c8a-432a-91d5-8d1b840b26ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "dad06110-8c8a-432a-91d5-8d1b840b26ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:03 user nova-compute[73188]: INFO nova.compute.manager [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Detaching volume b0ec2add-3d19-43f0-9dff-80bb53118e88
Aug 15 19:08:03 user nova-compute[73188]: INFO nova.virt.block_device [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Attempting to driver detach volume b0ec2add-3d19-43f0-9dff-80bb53118e88 from mountpoint /dev/sdc
Aug 15 19:08:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Attempting to detach device sdc from instance dad06110-8c8a-432a-91d5-8d1b840b26ca from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:08:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:08:03 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:08:03 user nova-compute[73188]:   <source dev="/dev/sdk"/>
Aug 15 19:08:03 user nova-compute[73188]:   <target dev="sdc" bus="scsi"/>
Aug 15 19:08:03 user nova-compute[73188]:   <serial>b0ec2add-3d19-43f0-9dff-80bb53118e88</serial>
Aug 15 19:08:03 user nova-compute[73188]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 15 19:08:03 user nova-compute[73188]: </disk>
Aug 15 19:08:03 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:08:03 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Successfully detached device sdc from instance dad06110-8c8a-432a-91d5-8d1b840b26ca from the persistent domain config.
Aug 15 19:08:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance dad06110-8c8a-432a-91d5-8d1b840b26ca from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:08:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:08:03 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:08:03 user nova-compute[73188]:   <source dev="/dev/sdk"/>
Aug 15 19:08:03 user nova-compute[73188]:   <target dev="sdc" bus="scsi"/>
Aug 15 19:08:03 user nova-compute[73188]:   <serial>b0ec2add-3d19-43f0-9dff-80bb53118e88</serial>
Aug 15 19:08:03 user nova-compute[73188]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 15 19:08:03 user nova-compute[73188]: </disk>
Aug 15 19:08:03 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:08:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692126484.246458, dad06110-8c8a-432a-91d5-8d1b840b26ca => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance dad06110-8c8a-432a-91d5-8d1b840b26ca {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:08:04 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Successfully detached device sdc from instance dad06110-8c8a-432a-91d5-8d1b840b26ca from the live domain config.
Aug 15 19:08:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aAtpVkDe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:08:04 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:08:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[df35af18-6d1f-40a2-afaa-63a06d319315]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9768dc-0e45-438b-bb1a-5d3a9c078660]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 (non-flash)
Aug 15 19:08:04 user nova-compute[73188]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:04 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:04 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:04 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:04 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:04 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:04 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:04 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 (non-flash)
Aug 15 19:08:04 user nova-compute[73188]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:04 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:04 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:04 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:04 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:04 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:04 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:04 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281a34b370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88'): ({'sdk'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Removing single pathed devices sdk {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8eaf291-115b-43c7-9abc-2aa07989527b]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7e5fe5-d705-45d3-8e0f-2f3ef0e1ce8b]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Flushing IO for device /dev/sdk {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e68040-8a36-4590-8c21-f4bb15d4cd3b]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.042s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0c516e-6805-4c05-b049-ed3f185c7d31]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] SCSI volumes sdk have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a48ab85-a14b-4f8d-8f95-66a28a94f030]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e401249-22b1-4550-8838-ccfdd31ce621]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88, portal: 172.16.0.220,3260]
Aug 15 19:08:04 user nova-compute[73188]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88, portal: 172.16.0.220,3260] successful.
Aug 15 19:08:04 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ec2add-3d19-43f0-9dff-80bb53118e88 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6bc5f8-f566-4878-8403-a36e160de277]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] <== disconnect_volume: return (369ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:08:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:08:05 user nova-compute[73188]: DEBUG nova.objects.instance [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lazy-loading 'flavor' on Instance uuid dad06110-8c8a-432a-91d5-8d1b840b26ca {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4f37e09f-01ba-461b-8394-14da70266855 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "dad06110-8c8a-432a-91d5-8d1b840b26ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.829s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Acquiring lock "dad06110-8c8a-432a-91d5-8d1b840b26ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "dad06110-8c8a-432a-91d5-8d1b840b26ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Acquiring lock "dad06110-8c8a-432a-91d5-8d1b840b26ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "dad06110-8c8a-432a-91d5-8d1b840b26ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "dad06110-8c8a-432a-91d5-8d1b840b26ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:05 user nova-compute[73188]: INFO nova.compute.manager [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Terminating instance
Aug 15 19:08:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:08:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:06 user nova-compute[73188]: DEBUG nova.compute.manager [req-0ceab286-6256-4636-9022-7945bab39b5c req-97800cd7-edf5-4e7d-8a35-9605643b9b82 service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Received event network-vif-unplugged-5d901c10-1493-4a6b-b706-cc3979a6b29e {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0ceab286-6256-4636-9022-7945bab39b5c req-97800cd7-edf5-4e7d-8a35-9605643b9b82 service nova] Acquiring lock "dad06110-8c8a-432a-91d5-8d1b840b26ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0ceab286-6256-4636-9022-7945bab39b5c req-97800cd7-edf5-4e7d-8a35-9605643b9b82 service nova] Lock "dad06110-8c8a-432a-91d5-8d1b840b26ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0ceab286-6256-4636-9022-7945bab39b5c req-97800cd7-edf5-4e7d-8a35-9605643b9b82 service nova] Lock "dad06110-8c8a-432a-91d5-8d1b840b26ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:06 user nova-compute[73188]: DEBUG nova.compute.manager [req-0ceab286-6256-4636-9022-7945bab39b5c req-97800cd7-edf5-4e7d-8a35-9605643b9b82 service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] No waiting events found dispatching network-vif-unplugged-5d901c10-1493-4a6b-b706-cc3979a6b29e {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:06 user nova-compute[73188]: DEBUG nova.compute.manager [req-0ceab286-6256-4636-9022-7945bab39b5c req-97800cd7-edf5-4e7d-8a35-9605643b9b82 service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Received event network-vif-unplugged-5d901c10-1493-4a6b-b706-cc3979a6b29e for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:08:06 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Instance destroyed successfully.
Aug 15 19:08:06 user nova-compute[73188]: DEBUG nova.objects.instance [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lazy-loading 'resources' on Instance uuid dad06110-8c8a-432a-91d5-8d1b840b26ca {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:05:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-978768863',display_name='tempest-AttachSCSIVolumeTestJSON-server-978768863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-978768863',id=5,image_ref='ddb81697-ef4c-4757-b9f2-8c7a21ff9064',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMY95N3HgkKsO4svG6TxJbMXhyqp0JG8gXxU1cP0SD4yRgf7XjInyOsB+orVzpaJKTZruwrWLk6FiWYq91pqrG6tArKVYnhxVXEwYPkS4xZzercIKvZFexjeiMv2n82vQ==',key_name='tempest-keypair-830489440',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:05:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31d2d81cf9f0431a9f929d80feee45ec',ramdisk_id='',reservation_id='r-oomwxo41',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb81697-ef4c-4757-b9f2-8c7a21ff9064',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1469956616',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1469956616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:05:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4362375f83984fd3a4c7ae8cc9838e59',uuid=dad06110-8c8a-432a-91d5-8d1b840b26ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d901c10-1493-4a6b-b706-cc3979a6b29e", "address": "fa:16:3e:7d:af:10", "network": {"id": "a465fffd-f8da-440a-8bdc-3c1da367bbc6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-832639605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31d2d81cf9f0431a9f929d80feee45ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d901c10-14", "ovs_interfaceid": "5d901c10-1493-4a6b-b706-cc3979a6b29e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:08:06 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Converting VIF {"id": "5d901c10-1493-4a6b-b706-cc3979a6b29e", "address": "fa:16:3e:7d:af:10", "network": {"id": "a465fffd-f8da-440a-8bdc-3c1da367bbc6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-832639605-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31d2d81cf9f0431a9f929d80feee45ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d901c10-14", "ovs_interfaceid": "5d901c10-1493-4a6b-b706-cc3979a6b29e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:06 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:af:10,bridge_name='br-int',has_traffic_filtering=True,id=5d901c10-1493-4a6b-b706-cc3979a6b29e,network=Network(a465fffd-f8da-440a-8bdc-3c1da367bbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d901c10-14') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:06 user nova-compute[73188]: DEBUG os_vif [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:af:10,bridge_name='br-int',has_traffic_filtering=True,id=5d901c10-1493-4a6b-b706-cc3979a6b29e,network=Network(a465fffd-f8da-440a-8bdc-3c1da367bbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d901c10-14') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:08:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d901c10-14, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:06 user nova-compute[73188]: INFO os_vif [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:af:10,bridge_name='br-int',has_traffic_filtering=True,id=5d901c10-1493-4a6b-b706-cc3979a6b29e,network=Network(a465fffd-f8da-440a-8bdc-3c1da367bbc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d901c10-14')
Aug 15 19:08:06 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Deleting instance files /opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca_del
Aug 15 19:08:06 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Deletion of /opt/stack/data/nova/instances/dad06110-8c8a-432a-91d5-8d1b840b26ca_del complete
Aug 15 19:08:06 user nova-compute[73188]: INFO nova.compute.manager [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 15 19:08:06 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:08:06 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:08:06 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ayEVGZPN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:08:07 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:08:07 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:08:07 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a218e2-42a5-4771-b52e-362b7fe13e37]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:08:07 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[368675c0-6683-4954-bdd8-650ef71b77e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178] added
Aug 15 19:08:07 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[411b638f-a51b-4f0a-8b08-6d45021fafe4]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f673c200-24a7-4ea9-8f90-ba307e9d7e99]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ayEVGZPN {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ayEVGZPN" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c64ad6-2a87-4817-ad41-7faa621d4a0a]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ayEVGZPN'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[dece8f58-10e3-4b5c-a7f8-aa2d1fc47270]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa9ef04-2a9a-49c5-a94a-5f41b900cb9f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:07 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:07 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6525be2d-2af8-4b3d-a937-67b178702e75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178, portal: 172.16.0.220,3260]
Aug 15 19:08:07 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178, portal: 172.16.0.220,3260] successful.
Aug 15 19:08:07 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[049cdf6e-b586-41f5-a98d-4c17b6bb188b]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbdd021-0c5e-4feb-a035-b62d87f75536]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:07 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:07 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:07 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[306476a8-7445-4d6d-b418-ba692f7122e1]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ayEVGZPN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:08:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-1913bb7d-b0c3-4381-a5f6-337ecee35516 req-58abaac3-0c30-41c4-94ab-5137b8f10c4a service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Received event network-vif-plugged-5d901c10-1493-4a6b-b706-cc3979a6b29e {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1913bb7d-b0c3-4381-a5f6-337ecee35516 req-58abaac3-0c30-41c4-94ab-5137b8f10c4a service nova] Acquiring lock "dad06110-8c8a-432a-91d5-8d1b840b26ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1913bb7d-b0c3-4381-a5f6-337ecee35516 req-58abaac3-0c30-41c4-94ab-5137b8f10c4a service nova] Lock "dad06110-8c8a-432a-91d5-8d1b840b26ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1913bb7d-b0c3-4381-a5f6-337ecee35516 req-58abaac3-0c30-41c4-94ab-5137b8f10c4a service nova] Lock "dad06110-8c8a-432a-91d5-8d1b840b26ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-1913bb7d-b0c3-4381-a5f6-337ecee35516 req-58abaac3-0c30-41c4-94ab-5137b8f10c4a service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] No waiting events found dispatching network-vif-plugged-5d901c10-1493-4a6b-b706-cc3979a6b29e {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:08 user nova-compute[73188]: WARNING nova.compute.manager [req-1913bb7d-b0c3-4381-a5f6-337ecee35516 req-58abaac3-0c30-41c4-94ab-5137b8f10c4a service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Received unexpected event network-vif-plugged-5d901c10-1493-4a6b-b706-cc3979a6b29e for instance with vm_state active and task_state deleting.
Aug 15 19:08:08 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:08:08 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Took 1.49 seconds to deallocate network for instance.
Aug 15 19:08:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:08:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23433646664323235', 'path': '/dev/sdi'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:08:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433646664323235', 'path': '/dev/sdi'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:08:08 user nova-compute[73188]: DEBUG nova.objects.instance [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lazy-loading 'flavor' on Instance uuid 0d5df01f-2a14-423a-9872-69132a3874ce {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:08:08 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:08:08 user nova-compute[73188]:   <source dev="/dev/sdi"/>
Aug 15 19:08:08 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:08:08 user nova-compute[73188]:   <serial>0ebdb52c-10ca-4922-aeb0-2cd724546178</serial>
Aug 15 19:08:08 user nova-compute[73188]: </disk>
Aug 15 19:08:08 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:08:08 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:08:08 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:08:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:08 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Deleted allocations for instance dad06110-8c8a-432a-91d5-8d1b840b26ca
Aug 15 19:08:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-99096891-7ced-4cfd-bbcf-f561bf5493b4 tempest-AttachSCSIVolumeTestJSON-1469956616 tempest-AttachSCSIVolumeTestJSON-1469956616-project-member] Lock "dad06110-8c8a-432a-91d5-8d1b840b26ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.073s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] No VIF found with MAC fa:16:3e:22:74:a1, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srhzRyDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:08:09 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:08:09 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:08:09 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb559262-e7c8-4fa9-acf6-07e642856472]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:08:09 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ccc3a6-c4c7-43d6-8426-05f496b74850]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb] added
Aug 15 19:08:09 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8976916a-527c-438b-8d65-d957e872e2da]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cae081a-c750-4f15-9f9e-dafe91e8e1ca]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v srhzRyDF {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v srhzRyDF" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[314993a4-6d29-46fd-ba3b-7e2a8e99c700]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'srhzRyDF'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda9fc7c-6230-4b3c-99bb-418c52d16b43]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13f9157-4927-4804-ba44-66f5d121c762]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:09 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:09 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ba183add-c71e-46f6-9ce1-4602196a52a9 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "0d5df01f-2a14-423a-9872-69132a3874ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.793s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb -p 172.16.0.220:3260 --login" returned: 0 in 0.116s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cbaa3e-5898-47af-a612-9414bdc85451]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb, portal: 172.16.0.220,3260]
Aug 15 19:08:09 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb, portal: 172.16.0.220,3260] successful.
Aug 15 19:08:09 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4dd801-36c6-4c13-b414-0de158794a14]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6dba0c-4746-41a1-ba57-c0330aef9a30]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:09 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:09 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:09 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] HCTL ('41', '-', '-', 0) found on session 13 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b8c352-03a9-472b-94c6-2e7492c26f8b]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srhzRyDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-7caf434b-1484-4832-afee-0e2454bb5089" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-7caf434b-1484-4832-afee-0e2454bb5089" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:08:09 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG nova.compute.manager [req-274e0cb0-babd-484d-a406-9bf2cd5f6100 req-a0990803-866e-45be-b261-7e83719c98d8 service nova] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Received event network-vif-deleted-5d901c10-1493-4a6b-b706-cc3979a6b29e {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '26332323436323139', 'path': '/dev/sdj'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332323436323139', 'path': '/dev/sdj'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG nova.objects.instance [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lazy-loading 'flavor' on Instance uuid 069eb3a9-59dc-45aa-a664-712ebbbad7e7 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:08:10 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:08:10 user nova-compute[73188]:   <source dev="/dev/sdj"/>
Aug 15 19:08:10 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:08:10 user nova-compute[73188]:   <serial>25e7ff05-a1e4-417c-9aec-b5754d8341fb</serial>
Aug 15 19:08:10 user nova-compute[73188]: </disk>
Aug 15 19:08:10 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a39c1af8-8178-4e87-a9d9-013ee8c8000c tempest-TestVolumeSwap-475155762 tempest-TestVolumeSwap-475155762-project-admin] Acquiring lock "0d5df01f-2a14-423a-9872-69132a3874ce" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a39c1af8-8178-4e87-a9d9-013ee8c8000c tempest-TestVolumeSwap-475155762 tempest-TestVolumeSwap-475155762-project-admin] Lock "0d5df01f-2a14-423a-9872-69132a3874ce" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG os_brick.utils [None req-a39c1af8-8178-4e87-a9d9-013ee8c8000c tempest-TestVolumeSwap-475155762 tempest-TestVolumeSwap-475155762-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e96d58-ad7e-45fb-96da-1857fc025d58]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e21da82-11e6-4230-8eee-c7a6574d09e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b0e2d9-aed2-49d5-bfc6-1e373938ddf0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec37202-a12e-4f1b-ae50-94ca25cf8717]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a39c1af8-8178-4e87-a9d9-013ee8c8000c tempest-TestVolumeSwap-475155762 tempest-TestVolumeSwap-475155762-project-admin] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a39c1af8-8178-4e87-a9d9-013ee8c8000c tempest-TestVolumeSwap-475155762 tempest-TestVolumeSwap-475155762-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Updating instance_info_cache with network_info: [{"id": "8b93115d-3416-4846-9c43-a36a66f99e41", "address": "fa:16:3e:da:94:b4", "network": {"id": "8c59b78f-940b-409a-a485-2ee269ef8a5f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2048234860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f959aaaf0fe4406a723804e59eb47ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b93115d-34", "ovs_interfaceid": "8b93115d-3416-4846-9c43-a36a66f99e41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a39c1af8-8178-4e87-a9d9-013ee8c8000c tempest-TestVolumeSwap-475155762 tempest-TestVolumeSwap-475155762-project-admin] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-7caf434b-1484-4832-afee-0e2454bb5089" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:08:10 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:08:10 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee21ba08-819e-4c63-bf4d-eec09d0036f8]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-a39c1af8-8178-4e87-a9d9-013ee8c8000c tempest-TestVolumeSwap-475155762 tempest-TestVolumeSwap-475155762-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-a39c1af8-8178-4e87-a9d9-013ee8c8000c tempest-TestVolumeSwap-475155762 tempest-TestVolumeSwap-475155762-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-a39c1af8-8178-4e87-a9d9-013ee8c8000c tempest-TestVolumeSwap-475155762 tempest-TestVolumeSwap-475155762-project-admin] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG os_brick.utils [None req-a39c1af8-8178-4e87-a9d9-013ee8c8000c tempest-TestVolumeSwap-475155762 tempest-TestVolumeSwap-475155762-project-admin] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:08:10 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:08:10 user nova-compute[73188]: INFO nova.compute.manager [None req-a39c1af8-8178-4e87-a9d9-013ee8c8000c tempest-TestVolumeSwap-475155762 tempest-TestVolumeSwap-475155762-project-admin] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Swapping volume 0ebdb52c-10ca-4922-aeb0-2cd724546178 for 1c5f41f7-5a4d-4d84-8ae9-5d6c026e3ece
Aug 15 19:08:11 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:08:11 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] No BDM found with device name hda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:08:11 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] No VIF found with MAC fa:16:3e:99:31:c4, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:08:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ec0fac5a-87c3-408e-9f90-3613feb48512 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.690s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:11 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:08:11 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:08:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:11 user nova-compute[73188]: INFO nova.compute.manager [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Rebuilding instance
Aug 15 19:08:11 user nova-compute[73188]: DEBUG nova.objects.instance [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lazy-loading 'trusted_certs' on Instance uuid fd74b385-fcfa-4a38-b869-0f5a8328188c {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:11 user nova-compute[73188]: DEBUG nova.compute.manager [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:08:11 user nova-compute[73188]: DEBUG nova.objects.instance [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lazy-loading 'pci_requests' on Instance uuid fd74b385-fcfa-4a38-b869-0f5a8328188c {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:11 user nova-compute[73188]: DEBUG nova.objects.instance [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lazy-loading 'pci_devices' on Instance uuid fd74b385-fcfa-4a38-b869-0f5a8328188c {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:11 user nova-compute[73188]: DEBUG nova.objects.instance [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lazy-loading 'resources' on Instance uuid fd74b385-fcfa-4a38-b869-0f5a8328188c {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:11 user nova-compute[73188]: DEBUG nova.objects.instance [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lazy-loading 'migration_context' on Instance uuid fd74b385-fcfa-4a38-b869-0f5a8328188c {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG nova.objects.instance [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73188) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG nova.compute.manager [req-416a7dd7-3db4-42b8-a0b6-5b5720556f97 req-4f22b668-004e-4fee-b2f1-acb1105adef8 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Received event network-changed-e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG nova.compute.manager [req-416a7dd7-3db4-42b8-a0b6-5b5720556f97 req-4f22b668-004e-4fee-b2f1-acb1105adef8 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Refreshing instance network info cache due to event network-changed-e4790711-6bf9-4e86-bacd-c9e822edc6a9. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-416a7dd7-3db4-42b8-a0b6-5b5720556f97 req-4f22b668-004e-4fee-b2f1-acb1105adef8 service nova] Acquiring lock "refresh_cache-fd74b385-fcfa-4a38-b869-0f5a8328188c" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-416a7dd7-3db4-42b8-a0b6-5b5720556f97 req-4f22b668-004e-4fee-b2f1-acb1105adef8 service nova] Acquired lock "refresh_cache-fd74b385-fcfa-4a38-b869-0f5a8328188c" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG nova.network.neutron [req-416a7dd7-3db4-42b8-a0b6-5b5720556f97 req-4f22b668-004e-4fee-b2f1-acb1105adef8 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Refreshing network info cache for port e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:08:12 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Instance destroyed successfully.
Aug 15 19:08:12 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Instance destroyed successfully.
Aug 15 19:08:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-177848102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-465202991',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaBGa9KkwqWE1Q78AJMY7JlCjjnEVbtGOA19dY6uOf/g7Nc83Gf5QTFxXyhKxitOoCVD+9s7ju99GRuHp8fE8zuC/kBIVt9HsyWnGOgpWJZiCHV3u4bydMPINjm7GJs7w==',key_name='tempest-keypair-1090329827',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:06:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f1509fdfe31e4f26baac3a8be4b8d894',ramdisk_id='',reservation_id='r-fj96x5lg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-893119363',owner_user_name='tempest-ServerActionsV293TestJSON-893119363-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:08:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f94daba64eb347959248376b01bce161',uuid=fd74b385-fcfa-4a38-b869-0f5a8328188c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "address": "fa:16:3e:f2:d4:61", "network": {"id": "b9a20327-d2f1-4377-943b-0d2cc3a7dbd9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1246109159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1509fdfe31e4f26baac3a8be4b8d894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4790711-6b", "ovs_interfaceid": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Converting VIF {"id": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "address": "fa:16:3e:f2:d4:61", "network": {"id": "b9a20327-d2f1-4377-943b-0d2cc3a7dbd9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1246109159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1509fdfe31e4f26baac3a8be4b8d894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4790711-6b", "ovs_interfaceid": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:d4:61,bridge_name='br-int',has_traffic_filtering=True,id=e4790711-6bf9-4e86-bacd-c9e822edc6a9,network=Network(b9a20327-d2f1-4377-943b-0d2cc3a7dbd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4790711-6b') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG os_vif [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:d4:61,bridge_name='br-int',has_traffic_filtering=True,id=e4790711-6bf9-4e86-bacd-c9e822edc6a9,network=Network(b9a20327-d2f1-4377-943b-0d2cc3a7dbd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4790711-6b') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4790711-6b, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:12 user nova-compute[73188]: INFO os_vif [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:d4:61,bridge_name='br-int',has_traffic_filtering=True,id=e4790711-6bf9-4e86-bacd-c9e822edc6a9,network=Network(b9a20327-d2f1-4377-943b-0d2cc3a7dbd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4790711-6b')
Aug 15 19:08:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwoJimEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:08:12 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 19:08:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.016s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dacb7a-08a6-4eb5-99a6-cf63325c9e2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[df39b762-87fa-4bb3-85d1-7d826d876fdf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:12 user nova-compute[73188]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb (non-flash)
Aug 15 19:08:12 user nova-compute[73188]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:12 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:12 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:12 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:12 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:12 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:12 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:12 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:12 user nova-compute[73188]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb (non-flash)
Aug 15 19:08:12 user nova-compute[73188]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:12 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:12 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:12 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:12 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:12 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:12 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:12 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28082bed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b'): ({'sdb'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Removing single pathed devices sdb {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7355aac0-5216-42d3-b1c3-961cbb04e38b]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6842af-9e17-4376-9947-74bbecafd98d]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Flushing IO for device /dev/sdb {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abe0b84-48b9-45fb-938c-df7a525b4260]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf52f9a-f0f1-4c13-8b2e-0d9de76cbef4]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Acquiring lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:13 user nova-compute[73188]: INFO nova.compute.manager [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Detaching volume 25e7ff05-a1e4-417c-9aec-b5754d8341fb
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.058s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0f0e1f-c4bb-4e23-a4c0-f3e64a104b1b]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:13 user nova-compute[73188]: INFO nova.virt.block_device [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Attempting to driver detach volume 25e7ff05-a1e4-417c-9aec-b5754d8341fb from mountpoint /dev/vdb
Aug 15 19:08:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Attempting to detach device vdb from instance 069eb3a9-59dc-45aa-a664-712ebbbad7e7 from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:08:13 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:08:13 user nova-compute[73188]:   <source dev="/dev/sdj"/>
Aug 15 19:08:13 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:08:13 user nova-compute[73188]:   <serial>25e7ff05-a1e4-417c-9aec-b5754d8341fb</serial>
Aug 15 19:08:13 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 19:08:13 user nova-compute[73188]: </disk>
Aug 15 19:08:13 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e09712f-c685-4c6b-8867-8e122389f7a5]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b, portal: 172.16.0.220,3260]
Aug 15 19:08:13 user nova-compute[73188]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b, portal: 172.16.0.220,3260] successful.
Aug 15 19:08:13 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:13 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Successfully detached device vdb from instance 069eb3a9-59dc-45aa-a664-712ebbbad7e7 from the persistent domain config.
Aug 15 19:08:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 069eb3a9-59dc-45aa-a664-712ebbbad7e7 from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:08:13 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:08:13 user nova-compute[73188]:   <source dev="/dev/sdj"/>
Aug 15 19:08:13 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:08:13 user nova-compute[73188]:   <serial>25e7ff05-a1e4-417c-9aec-b5754d8341fb</serial>
Aug 15 19:08:13 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 19:08:13 user nova-compute[73188]: </disk>
Aug 15 19:08:13 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG nova.network.neutron [req-416a7dd7-3db4-42b8-a0b6-5b5720556f97 req-4f22b668-004e-4fee-b2f1-acb1105adef8 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Updated VIF entry in instance network info cache for port e4790711-6bf9-4e86-bacd-c9e822edc6a9. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG nova.network.neutron [req-416a7dd7-3db4-42b8-a0b6-5b5720556f97 req-4f22b668-004e-4fee-b2f1-acb1105adef8 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Updating instance_info_cache with network_info: [{"id": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "address": "fa:16:3e:f2:d4:61", "network": {"id": "b9a20327-d2f1-4377-943b-0d2cc3a7dbd9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1246109159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1509fdfe31e4f26baac3a8be4b8d894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4790711-6b", "ovs_interfaceid": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd48e6f-2776-47a1-be82-88f2cee19d3d]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.500s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] <== disconnect_volume: return (516ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:08:13 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Deleting instance files /opt/stack/data/nova/instances/fd74b385-fcfa-4a38-b869-0f5a8328188c_del
Aug 15 19:08:13 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Deletion of /opt/stack/data/nova/instances/fd74b385-fcfa-4a38-b869-0f5a8328188c_del complete
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-416a7dd7-3db4-42b8-a0b6-5b5720556f97 req-4f22b668-004e-4fee-b2f1-acb1105adef8 service nova] Releasing lock "refresh_cache-fd74b385-fcfa-4a38-b869-0f5a8328188c" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG nova.compute.manager [req-416a7dd7-3db4-42b8-a0b6-5b5720556f97 req-4f22b668-004e-4fee-b2f1-acb1105adef8 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Received event network-vif-unplugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-416a7dd7-3db4-42b8-a0b6-5b5720556f97 req-4f22b668-004e-4fee-b2f1-acb1105adef8 service nova] Acquiring lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-416a7dd7-3db4-42b8-a0b6-5b5720556f97 req-4f22b668-004e-4fee-b2f1-acb1105adef8 service nova] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-416a7dd7-3db4-42b8-a0b6-5b5720556f97 req-4f22b668-004e-4fee-b2f1-acb1105adef8 service nova] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG nova.compute.manager [req-416a7dd7-3db4-42b8-a0b6-5b5720556f97 req-4f22b668-004e-4fee-b2f1-acb1105adef8 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] No waiting events found dispatching network-vif-unplugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:13 user nova-compute[73188]: WARNING nova.compute.manager [req-416a7dd7-3db4-42b8-a0b6-5b5720556f97 req-4f22b668-004e-4fee-b2f1-acb1105adef8 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Received unexpected event network-vif-unplugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 for instance with vm_state active and task_state rebuilding.
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:13 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance fd74b385-fcfa-4a38-b869-0f5a8328188c could not be found.
Aug 15 19:08:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwoJimEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:08:13 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbfa749-b228-4182-aa7d-a98012f95554]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[43839f20-3f53-4a42-a019-8a13dcc5cda8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:13 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:13 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28082be8c0>, {}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Disconnecting from: [] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] <== disconnect_volume: return (73ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692126493.7898278, 069eb3a9-59dc-45aa-a664-712ebbbad7e7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 069eb3a9-59dc-45aa-a664-712ebbbad7e7 {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:08:13 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Successfully detached device vdb from instance 069eb3a9-59dc-45aa-a664-712ebbbad7e7 from the live domain config.
Aug 15 19:08:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srhzRyDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:08:13 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7f1f71-61f9-4959-abba-16c70c380f69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[81088736-84b4-4489-952b-f78db23be73c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:13 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:13 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:13 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28082ba5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb'): ({'sdj'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Removing single pathed devices sdj {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ec964f-2a60-4e44-a791-20ed5f39dc35]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed07877-e521-4a58-975c-0d0026ee7f2c]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Flushing IO for device /dev/sdj {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[685c9ea5-9d26-46b2-8a63-f3033ea3fcef]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:08:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.042s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed70fa4-4ceb-4184-b8bd-6b78df2a1254]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] SCSI volumes sdj have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f86b54-de64-4302-bef3-8cbeaca95e31]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0cc486-50c0-471e-a6d8-ac750fadc83c]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb, portal: 172.16.0.220,3260]
Aug 15 19:08:14 user nova-compute[73188]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb, portal: 172.16.0.220,3260] successful.
Aug 15 19:08:14 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e7ff05-a1e4-417c-9aec-b5754d8341fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[287f6a8f-7111-4ebd-9677-6a0db19e50f4]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] <== disconnect_volume: return (370ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG nova.compute.manager [req-cf997c4b-7f0f-434f-b095-7cba565cc357 req-c97a27cf-2a23-4f42-a946-597a1bc910ff service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Received event network-vif-plugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cf997c4b-7f0f-434f-b095-7cba565cc357 req-c97a27cf-2a23-4f42-a946-597a1bc910ff service nova] Acquiring lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cf997c4b-7f0f-434f-b095-7cba565cc357 req-c97a27cf-2a23-4f42-a946-597a1bc910ff service nova] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cf997c4b-7f0f-434f-b095-7cba565cc357 req-c97a27cf-2a23-4f42-a946-597a1bc910ff service nova] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG nova.compute.manager [req-cf997c4b-7f0f-434f-b095-7cba565cc357 req-c97a27cf-2a23-4f42-a946-597a1bc910ff service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] No waiting events found dispatching network-vif-plugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:14 user nova-compute[73188]: WARNING nova.compute.manager [req-cf997c4b-7f0f-434f-b095-7cba565cc357 req-c97a27cf-2a23-4f42-a946-597a1bc910ff service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Received unexpected event network-vif-plugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 for instance with vm_state active and task_state rebuilding.
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Preparing to wait for external event volume-reimaged-5f013040-56d6-4ad2-aa09-4346f46f544b {{(pid=73188) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Acquiring lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.volume.cinder [None req-a39c1af8-8178-4e87-a9d9-013ee8c8000c tempest-TestVolumeSwap-475155762 tempest-TestVolumeSwap-475155762-project-admin] Update attachment failed for attachment f2450ff3-934e-405a-a271-e9286ff2d025. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:1c5f41f7-5a4d-4d84-8ae9-5d6c026e3ece because of JDSS internal system error 1:Scstadmin Error:
Aug 15 19:08:14 user nova-compute[73188]: Collecting current configuration:
Aug 15 19:08:14 user nova-compute[73188]: FATAL: Received the following error:
Aug 15 19:08:14 user nova-compute[73188]:         groups(): Target 'iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b' is not available
Aug 15 19:08:14 user nova-compute[73188]: :/var/nasexe/SCST/scstadmin -open_dev 42025041e29d5cf5 -handler vdisk_blockio -attributes filename=/dev/Pool-0/v_1c5f41f7-5a4d-4d84-8ae9-5d6c026e3ece,blocksize=512,read_only=0,write_through=1,thin_provisioned=1..).). (HTTP 500) (Request-ID: req-3cea4996-493a-49bf-940b-9cdaf3dfe137) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:1c5f41f7-5a4d-4d84-8ae9-5d6c026e3ece because of JDSS internal system error 1:Scstadmin Error: 
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [None req-a39c1af8-8178-4e87-a9d9-013ee8c8000c tempest-TestVolumeSwap-475155762 tempest-TestVolumeSwap-475155762-project-admin] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Failed to connect to volume 1c5f41f7-5a4d-4d84-8ae9-5d6c026e3ece with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:1c5f41f7-5a4d-4d84-8ae9-5d6c026e3ece because of JDSS internal system error 1:Scstadmin Error:
Aug 15 19:08:14 user nova-compute[73188]: Collecting current configuration:
Aug 15 19:08:14 user nova-compute[73188]: FATAL: Received the following error:
Aug 15 19:08:14 user nova-compute[73188]:         groups(): Target 'iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b' is not available
Aug 15 19:08:14 user nova-compute[73188]: :/var/nasexe/SCST/scstadmin -open_dev 42025041e29d5cf5 -handler vdisk_blockio -attributes filename=/dev/Pool-0/v_1c5f41f7-5a4d-4d84-8ae9-5d6c026e3ece,blocksize=512,read_only=0,write_through=1,thin_provisioned=1..).). (HTTP 500) (Request-ID: req-3cea4996-493a-49bf-940b-9cdaf3dfe137)
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Traceback (most recent call last):
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]   File "/opt/stack/nova/nova/compute/manager.py", line 7690, in _swap_volume
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]     old_cinfo, new_cinfo = self._init_volume_connection(
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]   File "/opt/stack/nova/nova/compute/manager.py", line 7663, in _init_volume_connection
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]     new_cinfo = self.volume_api.attachment_update(
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]     res = method(self, ctx, *args, **kwargs)
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]     with excutils.save_and_reraise_exception():
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]     self.force_reraise()
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]     raise self.value
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]     context, '3.44', skip_version_check=True).attachments.update(
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]     return method.func(obj, *args, **kwargs)
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]     resp = self._update('/attachments/%s' % id, body)
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]     return self._cs_request(url, 'PUT', **kwargs)
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]     return self.request(url, method, **kwargs)
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]     raise exceptions.from_response(resp, body)
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:1c5f41f7-5a4d-4d84-8ae9-5d6c026e3ece because of JDSS internal system error 1:Scstadmin Error:
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Collecting current configuration:
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] 
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] FATAL: Received the following error:
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] 
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce]         groups(): Target 'iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b' is not available
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] 
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] :/var/nasexe/SCST/scstadmin -open_dev 42025041e29d5cf5 -handler vdisk_blockio -attributes filename=/dev/Pool-0/v_1c5f41f7-5a4d-4d84-8ae9-5d6c026e3ece,blocksize=512,read_only=0,write_through=1,thin_provisioned=1..).). (HTTP 500) (Request-ID: req-3cea4996-493a-49bf-940b-9cdaf3dfe137)
Aug 15 19:08:14 user nova-compute[73188]: ERROR nova.compute.manager [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] 
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a39c1af8-8178-4e87-a9d9-013ee8c8000c tempest-TestVolumeSwap-475155762 tempest-TestVolumeSwap-475155762-project-admin] Lock "0d5df01f-2a14-423a-9872-69132a3874ce" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 4.447s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.objects.instance [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lazy-loading 'flavor' on Instance uuid 069eb3a9-59dc-45aa-a664-712ebbbad7e7 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/588767b7-fc11-4c92-9404-cf1333b53748/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server [None req-a39c1af8-8178-4e87-a9d9-013ee8c8000c tempest-TestVolumeSwap-475155762 tempest-TestVolumeSwap-475155762-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:1c5f41f7-5a4d-4d84-8ae9-5d6c026e3ece because of JDSS internal system error 1:Scstadmin Error:
Aug 15 19:08:15 user nova-compute[73188]: Collecting current configuration:
Aug 15 19:08:15 user nova-compute[73188]: FATAL: Received the following error:
Aug 15 19:08:15 user nova-compute[73188]:         groups(): Target 'iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b' is not available
Aug 15 19:08:15 user nova-compute[73188]: :/var/nasexe/SCST/scstadmin -open_dev 42025041e29d5cf5 -handler vdisk_blockio -attributes filename=/dev/Pool-0/v_1c5f41f7-5a4d-4d84-8ae9-5d6c026e3ece,blocksize=512,read_only=0,write_through=1,thin_provisioned=1..).). (HTTP 500) (Request-ID: req-3cea4996-493a-49bf-940b-9cdaf3dfe137)
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7823, in swap_volume
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7821, in _do_locked_swap_volume
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7865, in _do_swap_volume
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7714, in _swap_volume
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7690, in _swap_volume
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7663, in _init_volume_connection
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:1c5f41f7-5a4d-4d84-8ae9-5d6c026e3ece because of JDSS internal system error 1:Scstadmin Error:
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server Collecting current configuration:
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server 
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server FATAL: Received the following error:
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server 
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server         groups(): Target 'iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b' is not available
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server 
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server :/var/nasexe/SCST/scstadmin -open_dev 42025041e29d5cf5 -handler vdisk_blockio -attributes filename=/dev/Pool-0/v_1c5f41f7-5a4d-4d84-8ae9-5d6c026e3ece,blocksize=512,read_only=0,write_through=1,thin_provisioned=1..).). (HTTP 500) (Request-ID: req-3cea4996-493a-49bf-940b-9cdaf3dfe137)
Aug 15 19:08:15 user nova-compute[73188]: ERROR oslo_messaging.rpc.server 
Aug 15 19:08:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "3d713d03-3e60-4dec-a295-a4652ac21842" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "3d713d03-3e60-4dec-a295-a4652ac21842" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f3a98346-fa96-4477-bc9b-7e3b30836345 tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.103s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.compute.manager [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/588767b7-fc11-4c92-9404-cf1333b53748/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/588767b7-fc11-4c92-9404-cf1333b53748/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Acquiring lock "interface-069eb3a9-59dc-45aa-a664-712ebbbad7e7-60dc2be0-5598-4839-a009-f131a8d2cbda" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "interface-069eb3a9-59dc-45aa-a664-712ebbbad7e7-60dc2be0-5598-4839-a009-f131a8d2cbda" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Acquiring lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:08:15 user nova-compute[73188]: INFO nova.compute.claims [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Claim successful on node user
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.compute.manager [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.objects.instance [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lazy-loading 'flavor' on Instance uuid 069eb3a9-59dc-45aa-a664-712ebbbad7e7 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:05:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-346712273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-346712273',id=7,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI7jXbeKw9zkf9/iIPvh7NB96wHBiVSd3tkGEgzRo7xcm/prE4XrAY5tS3bsMANa/m2oKIroukS/BgU5oVeuE62dlrCZmBmzDdHgRhV9W1LqC6AQ0bblC4H1qHiGzHZfg==',key_name='tempest-keypair-223053783',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:06:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb6846c6807243379e6b5de3868c2fb2',ramdisk_id='',reservation_id='r-krs477l0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-241567705',owner_user_name='tempest-TaggedAttachmentsTest-241567705-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:06:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42c99d8a73ce4d2c9a6c98ebcec844bf',uuid=069eb3a9-59dc-45aa-a664-712ebbbad7e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60dc2be0-5598-4839-a009-f131a8d2cbda", "address": "fa:16:3e:7c:b2:ff", "network": {"id": "2f260535-49bd-4da7-90bb-a9e20001c971", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-606058894", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dc2be0-55", "ovs_interfaceid": "60dc2be0-5598-4839-a009-f131a8d2cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Converting VIF {"id": "60dc2be0-5598-4839-a009-f131a8d2cbda", "address": "fa:16:3e:7c:b2:ff", "network": {"id": "2f260535-49bd-4da7-90bb-a9e20001c971", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-606058894", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dc2be0-55", "ovs_interfaceid": "60dc2be0-5598-4839-a009-f131a8d2cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b2:ff,bridge_name='br-int',has_traffic_filtering=True,id=60dc2be0-5598-4839-a009-f131a8d2cbda,network=Network(2f260535-49bd-4da7-90bb-a9e20001c971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dc2be0-55') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7c:b2:ff"/><model type="virtio"/><mtu size="1442"/><target dev="tap60dc2be0-55"/></interface> {{(pid=73188) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7c:b2:ff"/><model type="virtio"/><mtu size="1442"/><target dev="tap60dc2be0-55"/></interface> {{(pid=73188) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Attempting to detach device tap60dc2be0-55 from instance 069eb3a9-59dc-45aa-a664-712ebbbad7e7 from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] detach device xml: <interface type="ethernet">
Aug 15 19:08:15 user nova-compute[73188]:   <mac address="fa:16:3e:7c:b2:ff"/>
Aug 15 19:08:15 user nova-compute[73188]:   <model type="virtio"/>
Aug 15 19:08:15 user nova-compute[73188]:   <mtu size="1442"/>
Aug 15 19:08:15 user nova-compute[73188]:   <target dev="tap60dc2be0-55"/>
Aug 15 19:08:15 user nova-compute[73188]: </interface>
Aug 15 19:08:15 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7c:b2:ff"/><model type="virtio"/><mtu size="1442"/><target dev="tap60dc2be0-55"/></interface> {{(pid=73188) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7c:b2:ff"/><model type="virtio"/><mtu size="1442"/><target dev="tap60dc2be0-55"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 15 19:08:15 user nova-compute[73188]:   <name>instance-00000007</name>
Aug 15 19:08:15 user nova-compute[73188]:   <uuid>069eb3a9-59dc-45aa-a664-712ebbbad7e7</uuid>
Aug 15 19:08:15 user nova-compute[73188]:   <metadata>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:08:15 user nova-compute[73188]:   <nova:package version="0.0.0"/>
Aug 15 19:08:15 user nova-compute[73188]:   <nova:name>tempest-device-tagging-server-346712273</nova:name>
Aug 15 19:08:15 user nova-compute[73188]:   <nova:creationTime>2023-08-15 19:07:49</nova:creationTime>
Aug 15 19:08:15 user nova-compute[73188]:   <nova:flavor name="m1.tiny">
Aug 15 19:08:15 user nova-compute[73188]:     <nova:memory>512</nova:memory>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:disk>1</nova:disk>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:swap>0</nova:swap>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:vcpus>1</nova:vcpus>
Aug 15 19:08:15 user nova-compute[73188]:   </nova:flavor>
Aug 15 19:08:15 user nova-compute[73188]:   <nova:owner>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:user uuid="42c99d8a73ce4d2c9a6c98ebcec844bf">tempest-TaggedAttachmentsTest-241567705-project-member</nova:user>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:project uuid="eb6846c6807243379e6b5de3868c2fb2">tempest-TaggedAttachmentsTest-241567705</nova:project>
Aug 15 19:08:15 user nova-compute[73188]:   </nova:owner>
Aug 15 19:08:15 user nova-compute[73188]:   <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:08:15 user nova-compute[73188]:   <nova:ports>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:port uuid="d54026b3-10a6-44bb-9cc1-cb52b47fbfe2">
Aug 15 19:08:15 user nova-compute[73188]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 19:08:15 user nova-compute[73188]:     </nova:port>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:port uuid="60dc2be0-5598-4839-a009-f131a8d2cbda">
Aug 15 19:08:15 user nova-compute[73188]:       <nova:ip type="fixed" address="10.10.10.206" ipVersion="4"/>
Aug 15 19:08:15 user nova-compute[73188]:     </nova:port>
Aug 15 19:08:15 user nova-compute[73188]:   </nova:ports>
Aug 15 19:08:15 user nova-compute[73188]: </nova:instance>
Aug 15 19:08:15 user nova-compute[73188]:   </metadata>
Aug 15 19:08:15 user nova-compute[73188]:   <memory unit='KiB'>524288</memory>
Aug 15 19:08:15 user nova-compute[73188]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 19:08:15 user nova-compute[73188]:   <vcpu placement='static'>1</vcpu>
Aug 15 19:08:15 user nova-compute[73188]:   <resource>
Aug 15 19:08:15 user nova-compute[73188]:     <partition>/machine</partition>
Aug 15 19:08:15 user nova-compute[73188]:   </resource>
Aug 15 19:08:15 user nova-compute[73188]:   <sysinfo type='smbios'>
Aug 15 19:08:15 user nova-compute[73188]:     <system>
Aug 15 19:08:15 user nova-compute[73188]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 19:08:15 user nova-compute[73188]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 19:08:15 user nova-compute[73188]:       <entry name='version'>0.0.0</entry>
Aug 15 19:08:15 user nova-compute[73188]:       <entry name='serial'>069eb3a9-59dc-45aa-a664-712ebbbad7e7</entry>
Aug 15 19:08:15 user nova-compute[73188]:       <entry name='uuid'>069eb3a9-59dc-45aa-a664-712ebbbad7e7</entry>
Aug 15 19:08:15 user nova-compute[73188]:       <entry name='family'>Virtual Machine</entry>
Aug 15 19:08:15 user nova-compute[73188]:     </system>
Aug 15 19:08:15 user nova-compute[73188]:   </sysinfo>
Aug 15 19:08:15 user nova-compute[73188]:   <os>
Aug 15 19:08:15 user nova-compute[73188]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 19:08:15 user nova-compute[73188]:     <boot dev='hd'/>
Aug 15 19:08:15 user nova-compute[73188]:     <smbios mode='sysinfo'/>
Aug 15 19:08:15 user nova-compute[73188]:   </os>
Aug 15 19:08:15 user nova-compute[73188]:   <features>
Aug 15 19:08:15 user nova-compute[73188]:     <acpi/>
Aug 15 19:08:15 user nova-compute[73188]:     <apic/>
Aug 15 19:08:15 user nova-compute[73188]:     <vmcoreinfo state='on'/>
Aug 15 19:08:15 user nova-compute[73188]:   </features>
Aug 15 19:08:15 user nova-compute[73188]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 19:08:15 user nova-compute[73188]:     <model fallback='forbid'>Nehalem</model>
Aug 15 19:08:15 user nova-compute[73188]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 19:08:15 user nova-compute[73188]:     <feature policy='require' name='vme'/>
Aug 15 19:08:15 user nova-compute[73188]:     <feature policy='require' name='x2apic'/>
Aug 15 19:08:15 user nova-compute[73188]:     <feature policy='require' name='hypervisor'/>
Aug 15 19:08:15 user nova-compute[73188]:   </cpu>
Aug 15 19:08:15 user nova-compute[73188]:   <clock offset='utc'>
Aug 15 19:08:15 user nova-compute[73188]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 19:08:15 user nova-compute[73188]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 19:08:15 user nova-compute[73188]:     <timer name='hpet' present='no'/>
Aug 15 19:08:15 user nova-compute[73188]:   </clock>
Aug 15 19:08:15 user nova-compute[73188]:   <on_poweroff>destroy</on_poweroff>
Aug 15 19:08:15 user nova-compute[73188]:   <on_reboot>restart</on_reboot>
Aug 15 19:08:15 user nova-compute[73188]:   <on_crash>destroy</on_crash>
Aug 15 19:08:15 user nova-compute[73188]:   <devices>
Aug 15 19:08:15 user nova-compute[73188]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 19:08:15 user nova-compute[73188]:     <disk type='file' device='disk'>
Aug 15 19:08:15 user nova-compute[73188]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 19:08:15 user nova-compute[73188]:       <source file='/opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk' index='2'/>
Aug 15 19:08:15 user nova-compute[73188]:       <backingStore type='file' index='3'>
Aug 15 19:08:15 user nova-compute[73188]:         <format type='raw'/>
Aug 15 19:08:15 user nova-compute[73188]:         <source file='/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f'/>
Aug 15 19:08:15 user nova-compute[73188]:         <backingStore/>
Aug 15 19:08:15 user nova-compute[73188]:       </backingStore>
Aug 15 19:08:15 user nova-compute[73188]:       <target dev='vda' bus='virtio'/>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='virtio-disk0'/>
Aug 15 19:08:15 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </disk>
Aug 15 19:08:15 user nova-compute[73188]:     <disk type='file' device='cdrom'>
Aug 15 19:08:15 user nova-compute[73188]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 19:08:15 user nova-compute[73188]:       <source file='/opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk.config' index='1'/>
Aug 15 19:08:15 user nova-compute[73188]:       <backingStore/>
Aug 15 19:08:15 user nova-compute[73188]:       <target dev='hda' bus='ide'/>
Aug 15 19:08:15 user nova-compute[73188]:       <readonly/>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='ide0-0-0'/>
Aug 15 19:08:15 user nova-compute[73188]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </disk>
Aug 15 19:08:15 user nova-compute[73188]:     <controller type='usb' index='0' model='none'>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='usb'/>
Aug 15 19:08:15 user nova-compute[73188]:     </controller>
Aug 15 19:08:15 user nova-compute[73188]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='pci.0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </controller>
Aug 15 19:08:15 user nova-compute[73188]:     <controller type='ide' index='0'>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='ide'/>
Aug 15 19:08:15 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 19:08:15 user nova-compute[73188]:     </controller>
Aug 15 19:08:15 user nova-compute[73188]:     <interface type='ethernet'>
Aug 15 19:08:15 user nova-compute[73188]:       <mac address='fa:16:3e:99:31:c4'/>
Aug 15 19:08:15 user nova-compute[73188]:       <target dev='tapd54026b3-10'/>
Aug 15 19:08:15 user nova-compute[73188]:       <model type='virtio'/>
Aug 15 19:08:15 user nova-compute[73188]:       <mtu size='1442'/>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='net0'/>
Aug 15 19:08:15 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </interface>
Aug 15 19:08:15 user nova-compute[73188]:     <interface type='ethernet'>
Aug 15 19:08:15 user nova-compute[73188]:       <mac address='fa:16:3e:7c:b2:ff'/>
Aug 15 19:08:15 user nova-compute[73188]:       <target dev='tap60dc2be0-55'/>
Aug 15 19:08:15 user nova-compute[73188]:       <model type='virtio'/>
Aug 15 19:08:15 user nova-compute[73188]:       <mtu size='1442'/>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='net1'/>
Aug 15 19:08:15 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </interface>
Aug 15 19:08:15 user nova-compute[73188]:     <serial type='pty'>
Aug 15 19:08:15 user nova-compute[73188]:       <source path='/dev/pts/6'/>
Aug 15 19:08:15 user nova-compute[73188]:       <log file='/opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/console.log' append='off'/>
Aug 15 19:08:15 user nova-compute[73188]:       <target type='isa-serial' port='0'>
Aug 15 19:08:15 user nova-compute[73188]:         <model name='isa-serial'/>
Aug 15 19:08:15 user nova-compute[73188]:       </target>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='serial0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </serial>
Aug 15 19:08:15 user nova-compute[73188]:     <console type='pty' tty='/dev/pts/6'>
Aug 15 19:08:15 user nova-compute[73188]:       <source path='/dev/pts/6'/>
Aug 15 19:08:15 user nova-compute[73188]:       <log file='/opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/console.log' append='off'/>
Aug 15 19:08:15 user nova-compute[73188]:       <target type='serial' port='0'/>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='serial0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </console>
Aug 15 19:08:15 user nova-compute[73188]:     <input type='mouse' bus='ps2'>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='input0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </input>
Aug 15 19:08:15 user nova-compute[73188]:     <input type='keyboard' bus='ps2'>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='input1'/>
Aug 15 19:08:15 user nova-compute[73188]:     </input>
Aug 15 19:08:15 user nova-compute[73188]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 15 19:08:15 user nova-compute[73188]:       <listen type='address' address='0.0.0.0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </graphics>
Aug 15 19:08:15 user nova-compute[73188]:     <audio id='1' type='none'/>
Aug 15 19:08:15 user nova-compute[73188]:     <video>
Aug 15 19:08:15 user nova-compute[73188]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='video0'/>
Aug 15 19:08:15 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </video>
Aug 15 19:08:15 user nova-compute[73188]:     <memballoon model='virtio'>
Aug 15 19:08:15 user nova-compute[73188]:       <stats period='10'/>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='balloon0'/>
Aug 15 19:08:15 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </memballoon>
Aug 15 19:08:15 user nova-compute[73188]:     <rng model='virtio'>
Aug 15 19:08:15 user nova-compute[73188]:       <backend model='random'>/dev/urandom</backend>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='rng0'/>
Aug 15 19:08:15 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </rng>
Aug 15 19:08:15 user nova-compute[73188]:   </devices>
Aug 15 19:08:15 user nova-compute[73188]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 19:08:15 user nova-compute[73188]:     <label>libvirt-069eb3a9-59dc-45aa-a664-712ebbbad7e7</label>
Aug 15 19:08:15 user nova-compute[73188]:     <imagelabel>libvirt-069eb3a9-59dc-45aa-a664-712ebbbad7e7</imagelabel>
Aug 15 19:08:15 user nova-compute[73188]:   </seclabel>
Aug 15 19:08:15 user nova-compute[73188]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 19:08:15 user nova-compute[73188]:     <label>+64055:+108</label>
Aug 15 19:08:15 user nova-compute[73188]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 19:08:15 user nova-compute[73188]:   </seclabel>
Aug 15 19:08:15 user nova-compute[73188]: </domain>
Aug 15 19:08:15 user nova-compute[73188]:  {{(pid=73188) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 19:08:15 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Successfully detached device tap60dc2be0-55 from instance 069eb3a9-59dc-45aa-a664-712ebbbad7e7 from the persistent domain config.
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] (1/8): Attempting to detach device tap60dc2be0-55 with device alias net1 from instance 069eb3a9-59dc-45aa-a664-712ebbbad7e7 from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] detach device xml: <interface type="ethernet">
Aug 15 19:08:15 user nova-compute[73188]:   <mac address="fa:16:3e:7c:b2:ff"/>
Aug 15 19:08:15 user nova-compute[73188]:   <model type="virtio"/>
Aug 15 19:08:15 user nova-compute[73188]:   <mtu size="1442"/>
Aug 15 19:08:15 user nova-compute[73188]:   <target dev="tap60dc2be0-55"/>
Aug 15 19:08:15 user nova-compute[73188]: </interface>
Aug 15 19:08:15 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/588767b7-fc11-4c92-9404-cf1333b53748/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692126495.8740396, 069eb3a9-59dc-45aa-a664-712ebbbad7e7 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Start waiting for the detach event from libvirt for device tap60dc2be0-55 with device alias net1 for instance 069eb3a9-59dc-45aa-a664-712ebbbad7e7 {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7c:b2:ff"/><model type="virtio"/><mtu size="1442"/><target dev="tap60dc2be0-55"/></interface> {{(pid=73188) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7c:b2:ff"/><model type="virtio"/><mtu size="1442"/><target dev="tap60dc2be0-55"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 15 19:08:15 user nova-compute[73188]:   <name>instance-00000007</name>
Aug 15 19:08:15 user nova-compute[73188]:   <uuid>069eb3a9-59dc-45aa-a664-712ebbbad7e7</uuid>
Aug 15 19:08:15 user nova-compute[73188]:   <metadata>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:08:15 user nova-compute[73188]:   <nova:package version="0.0.0"/>
Aug 15 19:08:15 user nova-compute[73188]:   <nova:name>tempest-device-tagging-server-346712273</nova:name>
Aug 15 19:08:15 user nova-compute[73188]:   <nova:creationTime>2023-08-15 19:07:49</nova:creationTime>
Aug 15 19:08:15 user nova-compute[73188]:   <nova:flavor name="m1.tiny">
Aug 15 19:08:15 user nova-compute[73188]:     <nova:memory>512</nova:memory>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:disk>1</nova:disk>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:swap>0</nova:swap>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:vcpus>1</nova:vcpus>
Aug 15 19:08:15 user nova-compute[73188]:   </nova:flavor>
Aug 15 19:08:15 user nova-compute[73188]:   <nova:owner>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:user uuid="42c99d8a73ce4d2c9a6c98ebcec844bf">tempest-TaggedAttachmentsTest-241567705-project-member</nova:user>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:project uuid="eb6846c6807243379e6b5de3868c2fb2">tempest-TaggedAttachmentsTest-241567705</nova:project>
Aug 15 19:08:15 user nova-compute[73188]:   </nova:owner>
Aug 15 19:08:15 user nova-compute[73188]:   <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:08:15 user nova-compute[73188]:   <nova:ports>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:port uuid="d54026b3-10a6-44bb-9cc1-cb52b47fbfe2">
Aug 15 19:08:15 user nova-compute[73188]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 19:08:15 user nova-compute[73188]:     </nova:port>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:port uuid="60dc2be0-5598-4839-a009-f131a8d2cbda">
Aug 15 19:08:15 user nova-compute[73188]:       <nova:ip type="fixed" address="10.10.10.206" ipVersion="4"/>
Aug 15 19:08:15 user nova-compute[73188]:     </nova:port>
Aug 15 19:08:15 user nova-compute[73188]:   </nova:ports>
Aug 15 19:08:15 user nova-compute[73188]: </nova:instance>
Aug 15 19:08:15 user nova-compute[73188]:   </metadata>
Aug 15 19:08:15 user nova-compute[73188]:   <memory unit='KiB'>524288</memory>
Aug 15 19:08:15 user nova-compute[73188]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 19:08:15 user nova-compute[73188]:   <vcpu placement='static'>1</vcpu>
Aug 15 19:08:15 user nova-compute[73188]:   <resource>
Aug 15 19:08:15 user nova-compute[73188]:     <partition>/machine</partition>
Aug 15 19:08:15 user nova-compute[73188]:   </resource>
Aug 15 19:08:15 user nova-compute[73188]:   <sysinfo type='smbios'>
Aug 15 19:08:15 user nova-compute[73188]:     <system>
Aug 15 19:08:15 user nova-compute[73188]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 19:08:15 user nova-compute[73188]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 19:08:15 user nova-compute[73188]:       <entry name='version'>0.0.0</entry>
Aug 15 19:08:15 user nova-compute[73188]:       <entry name='serial'>069eb3a9-59dc-45aa-a664-712ebbbad7e7</entry>
Aug 15 19:08:15 user nova-compute[73188]:       <entry name='uuid'>069eb3a9-59dc-45aa-a664-712ebbbad7e7</entry>
Aug 15 19:08:15 user nova-compute[73188]:       <entry name='family'>Virtual Machine</entry>
Aug 15 19:08:15 user nova-compute[73188]:     </system>
Aug 15 19:08:15 user nova-compute[73188]:   </sysinfo>
Aug 15 19:08:15 user nova-compute[73188]:   <os>
Aug 15 19:08:15 user nova-compute[73188]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 19:08:15 user nova-compute[73188]:     <boot dev='hd'/>
Aug 15 19:08:15 user nova-compute[73188]:     <smbios mode='sysinfo'/>
Aug 15 19:08:15 user nova-compute[73188]:   </os>
Aug 15 19:08:15 user nova-compute[73188]:   <features>
Aug 15 19:08:15 user nova-compute[73188]:     <acpi/>
Aug 15 19:08:15 user nova-compute[73188]:     <apic/>
Aug 15 19:08:15 user nova-compute[73188]:     <vmcoreinfo state='on'/>
Aug 15 19:08:15 user nova-compute[73188]:   </features>
Aug 15 19:08:15 user nova-compute[73188]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 19:08:15 user nova-compute[73188]:     <model fallback='forbid'>Nehalem</model>
Aug 15 19:08:15 user nova-compute[73188]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 19:08:15 user nova-compute[73188]:     <feature policy='require' name='vme'/>
Aug 15 19:08:15 user nova-compute[73188]:     <feature policy='require' name='x2apic'/>
Aug 15 19:08:15 user nova-compute[73188]:     <feature policy='require' name='hypervisor'/>
Aug 15 19:08:15 user nova-compute[73188]:   </cpu>
Aug 15 19:08:15 user nova-compute[73188]:   <clock offset='utc'>
Aug 15 19:08:15 user nova-compute[73188]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 19:08:15 user nova-compute[73188]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 19:08:15 user nova-compute[73188]:     <timer name='hpet' present='no'/>
Aug 15 19:08:15 user nova-compute[73188]:   </clock>
Aug 15 19:08:15 user nova-compute[73188]:   <on_poweroff>destroy</on_poweroff>
Aug 15 19:08:15 user nova-compute[73188]:   <on_reboot>restart</on_reboot>
Aug 15 19:08:15 user nova-compute[73188]:   <on_crash>destroy</on_crash>
Aug 15 19:08:15 user nova-compute[73188]:   <devices>
Aug 15 19:08:15 user nova-compute[73188]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 19:08:15 user nova-compute[73188]:     <disk type='file' device='disk'>
Aug 15 19:08:15 user nova-compute[73188]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 19:08:15 user nova-compute[73188]:       <source file='/opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk' index='2'/>
Aug 15 19:08:15 user nova-compute[73188]:       <backingStore type='file' index='3'>
Aug 15 19:08:15 user nova-compute[73188]:         <format type='raw'/>
Aug 15 19:08:15 user nova-compute[73188]:         <source file='/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f'/>
Aug 15 19:08:15 user nova-compute[73188]:         <backingStore/>
Aug 15 19:08:15 user nova-compute[73188]:       </backingStore>
Aug 15 19:08:15 user nova-compute[73188]:       <target dev='vda' bus='virtio'/>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='virtio-disk0'/>
Aug 15 19:08:15 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </disk>
Aug 15 19:08:15 user nova-compute[73188]:     <disk type='file' device='cdrom'>
Aug 15 19:08:15 user nova-compute[73188]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 19:08:15 user nova-compute[73188]:       <source file='/opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk.config' index='1'/>
Aug 15 19:08:15 user nova-compute[73188]:       <backingStore/>
Aug 15 19:08:15 user nova-compute[73188]:       <target dev='hda' bus='ide'/>
Aug 15 19:08:15 user nova-compute[73188]:       <readonly/>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='ide0-0-0'/>
Aug 15 19:08:15 user nova-compute[73188]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </disk>
Aug 15 19:08:15 user nova-compute[73188]:     <controller type='usb' index='0' model='none'>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='usb'/>
Aug 15 19:08:15 user nova-compute[73188]:     </controller>
Aug 15 19:08:15 user nova-compute[73188]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='pci.0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </controller>
Aug 15 19:08:15 user nova-compute[73188]:     <controller type='ide' index='0'>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='ide'/>
Aug 15 19:08:15 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 19:08:15 user nova-compute[73188]:     </controller>
Aug 15 19:08:15 user nova-compute[73188]:     <interface type='ethernet'>
Aug 15 19:08:15 user nova-compute[73188]:       <mac address='fa:16:3e:99:31:c4'/>
Aug 15 19:08:15 user nova-compute[73188]:       <target dev='tapd54026b3-10'/>
Aug 15 19:08:15 user nova-compute[73188]:       <model type='virtio'/>
Aug 15 19:08:15 user nova-compute[73188]:       <mtu size='1442'/>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='net0'/>
Aug 15 19:08:15 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </interface>
Aug 15 19:08:15 user nova-compute[73188]:     <serial type='pty'>
Aug 15 19:08:15 user nova-compute[73188]:       <source path='/dev/pts/6'/>
Aug 15 19:08:15 user nova-compute[73188]:       <log file='/opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/console.log' append='off'/>
Aug 15 19:08:15 user nova-compute[73188]:       <target type='isa-serial' port='0'>
Aug 15 19:08:15 user nova-compute[73188]:         <model name='isa-serial'/>
Aug 15 19:08:15 user nova-compute[73188]:       </target>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='serial0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </serial>
Aug 15 19:08:15 user nova-compute[73188]:     <console type='pty' tty='/dev/pts/6'>
Aug 15 19:08:15 user nova-compute[73188]:       <source path='/dev/pts/6'/>
Aug 15 19:08:15 user nova-compute[73188]:       <log file='/opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/console.log' append='off'/>
Aug 15 19:08:15 user nova-compute[73188]:       <target type='serial' port='0'/>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='serial0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </console>
Aug 15 19:08:15 user nova-compute[73188]:     <input type='mouse' bus='ps2'>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='input0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </input>
Aug 15 19:08:15 user nova-compute[73188]:     <input type='keyboard' bus='ps2'>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='input1'/>
Aug 15 19:08:15 user nova-compute[73188]:     </input>
Aug 15 19:08:15 user nova-compute[73188]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 15 19:08:15 user nova-compute[73188]:       <listen type='address' address='0.0.0.0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </graphics>
Aug 15 19:08:15 user nova-compute[73188]:     <audio id='1' type='none'/>
Aug 15 19:08:15 user nova-compute[73188]:     <video>
Aug 15 19:08:15 user nova-compute[73188]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='video0'/>
Aug 15 19:08:15 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </video>
Aug 15 19:08:15 user nova-compute[73188]:     <memballoon model='virtio'>
Aug 15 19:08:15 user nova-compute[73188]:       <stats period='10'/>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='balloon0'/>
Aug 15 19:08:15 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </memballoon>
Aug 15 19:08:15 user nova-compute[73188]:     <rng model='virtio'>
Aug 15 19:08:15 user nova-compute[73188]:       <backend model='random'>/dev/urandom</backend>
Aug 15 19:08:15 user nova-compute[73188]:       <alias name='rng0'/>
Aug 15 19:08:15 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 19:08:15 user nova-compute[73188]:     </rng>
Aug 15 19:08:15 user nova-compute[73188]:   </devices>
Aug 15 19:08:15 user nova-compute[73188]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 19:08:15 user nova-compute[73188]:     <label>libvirt-069eb3a9-59dc-45aa-a664-712ebbbad7e7</label>
Aug 15 19:08:15 user nova-compute[73188]:     <imagelabel>libvirt-069eb3a9-59dc-45aa-a664-712ebbbad7e7</imagelabel>
Aug 15 19:08:15 user nova-compute[73188]:   </seclabel>
Aug 15 19:08:15 user nova-compute[73188]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 19:08:15 user nova-compute[73188]:     <label>+64055:+108</label>
Aug 15 19:08:15 user nova-compute[73188]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 19:08:15 user nova-compute[73188]:   </seclabel>
Aug 15 19:08:15 user nova-compute[73188]: </domain>
Aug 15 19:08:15 user nova-compute[73188]:  {{(pid=73188) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 19:08:15 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Successfully detached device tap60dc2be0-55 from instance 069eb3a9-59dc-45aa-a664-712ebbbad7e7 from the live domain config.
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:05:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-346712273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-346712273',id=7,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI7jXbeKw9zkf9/iIPvh7NB96wHBiVSd3tkGEgzRo7xcm/prE4XrAY5tS3bsMANa/m2oKIroukS/BgU5oVeuE62dlrCZmBmzDdHgRhV9W1LqC6AQ0bblC4H1qHiGzHZfg==',key_name='tempest-keypair-223053783',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:06:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb6846c6807243379e6b5de3868c2fb2',ramdisk_id='',reservation_id='r-krs477l0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-241567705',owner_user_name='tempest-TaggedAttachmentsTest-241567705-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:06:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42c99d8a73ce4d2c9a6c98ebcec844bf',uuid=069eb3a9-59dc-45aa-a664-712ebbbad7e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60dc2be0-5598-4839-a009-f131a8d2cbda", "address": "fa:16:3e:7c:b2:ff", "network": {"id": "2f260535-49bd-4da7-90bb-a9e20001c971", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-606058894", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dc2be0-55", "ovs_interfaceid": "60dc2be0-5598-4839-a009-f131a8d2cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Converting VIF {"id": "60dc2be0-5598-4839-a009-f131a8d2cbda", "address": "fa:16:3e:7c:b2:ff", "network": {"id": "2f260535-49bd-4da7-90bb-a9e20001c971", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-606058894", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dc2be0-55", "ovs_interfaceid": "60dc2be0-5598-4839-a009-f131a8d2cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b2:ff,bridge_name='br-int',has_traffic_filtering=True,id=60dc2be0-5598-4839-a009-f131a8d2cbda,network=Network(2f260535-49bd-4da7-90bb-a9e20001c971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dc2be0-55') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG os_vif [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b2:ff,bridge_name='br-int',has_traffic_filtering=True,id=60dc2be0-5598-4839-a009-f131a8d2cbda,network=Network(2f260535-49bd-4da7-90bb-a9e20001c971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dc2be0-55') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60dc2be0-55, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:15 user nova-compute[73188]: INFO os_vif [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b2:ff,bridge_name='br-int',has_traffic_filtering=True,id=60dc2be0-5598-4839-a009-f131a8d2cbda,network=Network(2f260535-49bd-4da7-90bb-a9e20001c971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dc2be0-55')
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:08:15 user nova-compute[73188]:   <nova:package version="0.0.0"/>
Aug 15 19:08:15 user nova-compute[73188]:   <nova:name>tempest-device-tagging-server-346712273</nova:name>
Aug 15 19:08:15 user nova-compute[73188]:   <nova:creationTime>2023-08-15 19:08:15</nova:creationTime>
Aug 15 19:08:15 user nova-compute[73188]:   <nova:flavor name="m1.tiny">
Aug 15 19:08:15 user nova-compute[73188]:     <nova:memory>512</nova:memory>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:disk>1</nova:disk>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:swap>0</nova:swap>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:vcpus>1</nova:vcpus>
Aug 15 19:08:15 user nova-compute[73188]:   </nova:flavor>
Aug 15 19:08:15 user nova-compute[73188]:   <nova:owner>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:user uuid="42c99d8a73ce4d2c9a6c98ebcec844bf">tempest-TaggedAttachmentsTest-241567705-project-member</nova:user>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:project uuid="eb6846c6807243379e6b5de3868c2fb2">tempest-TaggedAttachmentsTest-241567705</nova:project>
Aug 15 19:08:15 user nova-compute[73188]:   </nova:owner>
Aug 15 19:08:15 user nova-compute[73188]:   <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:08:15 user nova-compute[73188]:   <nova:ports>
Aug 15 19:08:15 user nova-compute[73188]:     <nova:port uuid="d54026b3-10a6-44bb-9cc1-cb52b47fbfe2">
Aug 15 19:08:15 user nova-compute[73188]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 19:08:15 user nova-compute[73188]:     </nova:port>
Aug 15 19:08:15 user nova-compute[73188]:   </nova:ports>
Aug 15 19:08:15 user nova-compute[73188]: </nova:instance>
Aug 15 19:08:15 user nova-compute[73188]:  {{(pid=73188) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:08:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:16 user nova-compute[73188]: DEBUG nova.compute.manager [req-04c3876d-2755-4096-b804-bf8b158a247e req-5d6c646c-565b-4bb6-95dc-7eb993ed2d52 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Received event network-vif-unplugged-60dc2be0-5598-4839-a009-f131a8d2cbda {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-04c3876d-2755-4096-b804-bf8b158a247e req-5d6c646c-565b-4bb6-95dc-7eb993ed2d52 service nova] Acquiring lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-04c3876d-2755-4096-b804-bf8b158a247e req-5d6c646c-565b-4bb6-95dc-7eb993ed2d52 service nova] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-04c3876d-2755-4096-b804-bf8b158a247e req-5d6c646c-565b-4bb6-95dc-7eb993ed2d52 service nova] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:16 user nova-compute[73188]: DEBUG nova.compute.manager [req-04c3876d-2755-4096-b804-bf8b158a247e req-5d6c646c-565b-4bb6-95dc-7eb993ed2d52 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] No waiting events found dispatching network-vif-unplugged-60dc2be0-5598-4839-a009-f131a8d2cbda {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:16 user nova-compute[73188]: WARNING nova.compute.manager [req-04c3876d-2755-4096-b804-bf8b158a247e req-5d6c646c-565b-4bb6-95dc-7eb993ed2d52 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Received unexpected event network-vif-unplugged-60dc2be0-5598-4839-a009-f131a8d2cbda for instance with vm_state active and task_state None.
Aug 15 19:08:16 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:08:16 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:08:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.715s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:16 user nova-compute[73188]: DEBUG nova.compute.manager [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:08:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.581s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:08:16 user nova-compute[73188]: INFO nova.compute.claims [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Claim successful on node user
Aug 15 19:08:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:16 user nova-compute[73188]: DEBUG nova.compute.manager [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:08:16 user nova-compute[73188]: DEBUG nova.network.neutron [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:08:16 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:08:16 user nova-compute[73188]: DEBUG nova.compute.manager [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:08:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:16 user nova-compute[73188]: INFO nova.virt.block_device [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Booting with blank volume at /dev/vda
Aug 15 19:08:16 user nova-compute[73188]: DEBUG nova.policy [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bad952eceaec400396fd0a28c438c761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab4e1cccd434f6c83f2f9e4687d274e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.network.neutron [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Successfully created port: 3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-401734ab-18c8-4b92-95c1-eff9f4d5c861 req-ff077937-35b3-4901-880e-0e0b55b856c1 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Received event network-vif-deleted-60dc2be0-5598-4839-a009-f131a8d2cbda {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:17 user nova-compute[73188]: INFO nova.compute.manager [req-401734ab-18c8-4b92-95c1-eff9f4d5c861 req-ff077937-35b3-4901-880e-0e0b55b856c1 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Neutron deleted interface 60dc2be0-5598-4839-a009-f131a8d2cbda; detaching it from the instance and deleting it from the info cache
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.network.neutron [req-401734ab-18c8-4b92-95c1-eff9f4d5c861 req-ff077937-35b3-4901-880e-0e0b55b856c1 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Updating instance_info_cache with network_info: [{"id": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "address": "fa:16:3e:99:31:c4", "network": {"id": "b0e519b5-4707-426d-b7c1-d5fc433bfbaa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2015894405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54026b3-10", "ovs_interfaceid": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:08:17 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:08:17 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=7114MB free_disk=25.576786041259766GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.objects.instance [req-401734ab-18c8-4b92-95c1-eff9f4d5c861 req-ff077937-35b3-4901-880e-0e0b55b856c1 service nova] Lazy-loading 'system_metadata' on Instance uuid 069eb3a9-59dc-45aa-a664-712ebbbad7e7 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Acquiring lock "refresh_cache-069eb3a9-59dc-45aa-a664-712ebbbad7e7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Acquired lock "refresh_cache-069eb3a9-59dc-45aa-a664-712ebbbad7e7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.objects.instance [req-401734ab-18c8-4b92-95c1-eff9f4d5c861 req-ff077937-35b3-4901-880e-0e0b55b856c1 service nova] Lazy-loading 'flavor' on Instance uuid 069eb3a9-59dc-45aa-a664-712ebbbad7e7 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [req-401734ab-18c8-4b92-95c1-eff9f4d5c861 req-ff077937-35b3-4901-880e-0e0b55b856c1 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:05:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-346712273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-346712273',id=7,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI7jXbeKw9zkf9/iIPvh7NB96wHBiVSd3tkGEgzRo7xcm/prE4XrAY5tS3bsMANa/m2oKIroukS/BgU5oVeuE62dlrCZmBmzDdHgRhV9W1LqC6AQ0bblC4H1qHiGzHZfg==',key_name='tempest-keypair-223053783',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:06:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb6846c6807243379e6b5de3868c2fb2',ramdisk_id='',reservation_id='r-krs477l0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-241567705',owner_user_name='tempest-TaggedAttachmentsTest-241567705-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:06:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42c99d8a73ce4d2c9a6c98ebcec844bf',uuid=069eb3a9-59dc-45aa-a664-712ebbbad7e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60dc2be0-5598-4839-a009-f131a8d2cbda", "address": "fa:16:3e:7c:b2:ff", "network": {"id": "2f260535-49bd-4da7-90bb-a9e20001c971", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-606058894", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dc2be0-55", "ovs_interfaceid": "60dc2be0-5598-4839-a009-f131a8d2cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.network.os_vif_util [req-401734ab-18c8-4b92-95c1-eff9f4d5c861 req-ff077937-35b3-4901-880e-0e0b55b856c1 service nova] Converting VIF {"id": "60dc2be0-5598-4839-a009-f131a8d2cbda", "address": "fa:16:3e:7c:b2:ff", "network": {"id": "2f260535-49bd-4da7-90bb-a9e20001c971", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-606058894", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dc2be0-55", "ovs_interfaceid": "60dc2be0-5598-4839-a009-f131a8d2cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.network.os_vif_util [req-401734ab-18c8-4b92-95c1-eff9f4d5c861 req-ff077937-35b3-4901-880e-0e0b55b856c1 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b2:ff,bridge_name='br-int',has_traffic_filtering=True,id=60dc2be0-5598-4839-a009-f131a8d2cbda,network=Network(2f260535-49bd-4da7-90bb-a9e20001c971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dc2be0-55') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [req-401734ab-18c8-4b92-95c1-eff9f4d5c861 req-ff077937-35b3-4901-880e-0e0b55b856c1 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7c:b2:ff"/><model type="virtio"/><mtu size="1442"/><target dev="tap60dc2be0-55"/></interface> {{(pid=73188) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [req-401734ab-18c8-4b92-95c1-eff9f4d5c861 req-ff077937-35b3-4901-880e-0e0b55b856c1 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7c:b2:ff"/><model type="virtio"/><mtu size="1442"/><target dev="tap60dc2be0-55"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 15 19:08:17 user nova-compute[73188]:   <name>instance-00000007</name>
Aug 15 19:08:17 user nova-compute[73188]:   <uuid>069eb3a9-59dc-45aa-a664-712ebbbad7e7</uuid>
Aug 15 19:08:17 user nova-compute[73188]:   <metadata>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:08:17 user nova-compute[73188]:   <nova:package version="0.0.0"/>
Aug 15 19:08:17 user nova-compute[73188]:   <nova:name>tempest-device-tagging-server-346712273</nova:name>
Aug 15 19:08:17 user nova-compute[73188]:   <nova:creationTime>2023-08-15 19:08:15</nova:creationTime>
Aug 15 19:08:17 user nova-compute[73188]:   <nova:flavor name="m1.tiny">
Aug 15 19:08:17 user nova-compute[73188]:     <nova:memory>512</nova:memory>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:disk>1</nova:disk>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:swap>0</nova:swap>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:vcpus>1</nova:vcpus>
Aug 15 19:08:17 user nova-compute[73188]:   </nova:flavor>
Aug 15 19:08:17 user nova-compute[73188]:   <nova:owner>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:user uuid="42c99d8a73ce4d2c9a6c98ebcec844bf">tempest-TaggedAttachmentsTest-241567705-project-member</nova:user>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:project uuid="eb6846c6807243379e6b5de3868c2fb2">tempest-TaggedAttachmentsTest-241567705</nova:project>
Aug 15 19:08:17 user nova-compute[73188]:   </nova:owner>
Aug 15 19:08:17 user nova-compute[73188]:   <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:08:17 user nova-compute[73188]:   <nova:ports>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:port uuid="d54026b3-10a6-44bb-9cc1-cb52b47fbfe2">
Aug 15 19:08:17 user nova-compute[73188]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 19:08:17 user nova-compute[73188]:     </nova:port>
Aug 15 19:08:17 user nova-compute[73188]:   </nova:ports>
Aug 15 19:08:17 user nova-compute[73188]: </nova:instance>
Aug 15 19:08:17 user nova-compute[73188]:   </metadata>
Aug 15 19:08:17 user nova-compute[73188]:   <memory unit='KiB'>524288</memory>
Aug 15 19:08:17 user nova-compute[73188]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 19:08:17 user nova-compute[73188]:   <vcpu placement='static'>1</vcpu>
Aug 15 19:08:17 user nova-compute[73188]:   <resource>
Aug 15 19:08:17 user nova-compute[73188]:     <partition>/machine</partition>
Aug 15 19:08:17 user nova-compute[73188]:   </resource>
Aug 15 19:08:17 user nova-compute[73188]:   <sysinfo type='smbios'>
Aug 15 19:08:17 user nova-compute[73188]:     <system>
Aug 15 19:08:17 user nova-compute[73188]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 19:08:17 user nova-compute[73188]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 19:08:17 user nova-compute[73188]:       <entry name='version'>0.0.0</entry>
Aug 15 19:08:17 user nova-compute[73188]:       <entry name='serial'>069eb3a9-59dc-45aa-a664-712ebbbad7e7</entry>
Aug 15 19:08:17 user nova-compute[73188]:       <entry name='uuid'>069eb3a9-59dc-45aa-a664-712ebbbad7e7</entry>
Aug 15 19:08:17 user nova-compute[73188]:       <entry name='family'>Virtual Machine</entry>
Aug 15 19:08:17 user nova-compute[73188]:     </system>
Aug 15 19:08:17 user nova-compute[73188]:   </sysinfo>
Aug 15 19:08:17 user nova-compute[73188]:   <os>
Aug 15 19:08:17 user nova-compute[73188]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 19:08:17 user nova-compute[73188]:     <boot dev='hd'/>
Aug 15 19:08:17 user nova-compute[73188]:     <smbios mode='sysinfo'/>
Aug 15 19:08:17 user nova-compute[73188]:   </os>
Aug 15 19:08:17 user nova-compute[73188]:   <features>
Aug 15 19:08:17 user nova-compute[73188]:     <acpi/>
Aug 15 19:08:17 user nova-compute[73188]:     <apic/>
Aug 15 19:08:17 user nova-compute[73188]:     <vmcoreinfo state='on'/>
Aug 15 19:08:17 user nova-compute[73188]:   </features>
Aug 15 19:08:17 user nova-compute[73188]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 19:08:17 user nova-compute[73188]:     <model fallback='forbid'>Nehalem</model>
Aug 15 19:08:17 user nova-compute[73188]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 19:08:17 user nova-compute[73188]:     <feature policy='require' name='vme'/>
Aug 15 19:08:17 user nova-compute[73188]:     <feature policy='require' name='x2apic'/>
Aug 15 19:08:17 user nova-compute[73188]:     <feature policy='require' name='hypervisor'/>
Aug 15 19:08:17 user nova-compute[73188]:   </cpu>
Aug 15 19:08:17 user nova-compute[73188]:   <clock offset='utc'>
Aug 15 19:08:17 user nova-compute[73188]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 19:08:17 user nova-compute[73188]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 19:08:17 user nova-compute[73188]:     <timer name='hpet' present='no'/>
Aug 15 19:08:17 user nova-compute[73188]:   </clock>
Aug 15 19:08:17 user nova-compute[73188]:   <on_poweroff>destroy</on_poweroff>
Aug 15 19:08:17 user nova-compute[73188]:   <on_reboot>restart</on_reboot>
Aug 15 19:08:17 user nova-compute[73188]:   <on_crash>destroy</on_crash>
Aug 15 19:08:17 user nova-compute[73188]:   <devices>
Aug 15 19:08:17 user nova-compute[73188]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 19:08:17 user nova-compute[73188]:     <disk type='file' device='disk'>
Aug 15 19:08:17 user nova-compute[73188]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 19:08:17 user nova-compute[73188]:       <source file='/opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk' index='2'/>
Aug 15 19:08:17 user nova-compute[73188]:       <backingStore type='file' index='3'>
Aug 15 19:08:17 user nova-compute[73188]:         <format type='raw'/>
Aug 15 19:08:17 user nova-compute[73188]:         <source file='/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f'/>
Aug 15 19:08:17 user nova-compute[73188]:         <backingStore/>
Aug 15 19:08:17 user nova-compute[73188]:       </backingStore>
Aug 15 19:08:17 user nova-compute[73188]:       <target dev='vda' bus='virtio'/>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='virtio-disk0'/>
Aug 15 19:08:17 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 19:08:17 user nova-compute[73188]:     </disk>
Aug 15 19:08:17 user nova-compute[73188]:     <disk type='file' device='cdrom'>
Aug 15 19:08:17 user nova-compute[73188]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 19:08:17 user nova-compute[73188]:       <source file='/opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk.config' index='1'/>
Aug 15 19:08:17 user nova-compute[73188]:       <backingStore/>
Aug 15 19:08:17 user nova-compute[73188]:       <target dev='hda' bus='ide'/>
Aug 15 19:08:17 user nova-compute[73188]:       <readonly/>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='ide0-0-0'/>
Aug 15 19:08:17 user nova-compute[73188]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 19:08:17 user nova-compute[73188]:     </disk>
Aug 15 19:08:17 user nova-compute[73188]:     <controller type='usb' index='0' model='none'>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='usb'/>
Aug 15 19:08:17 user nova-compute[73188]:     </controller>
Aug 15 19:08:17 user nova-compute[73188]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='pci.0'/>
Aug 15 19:08:17 user nova-compute[73188]:     </controller>
Aug 15 19:08:17 user nova-compute[73188]:     <controller type='ide' index='0'>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='ide'/>
Aug 15 19:08:17 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 19:08:17 user nova-compute[73188]:     </controller>
Aug 15 19:08:17 user nova-compute[73188]:     <interface type='ethernet'>
Aug 15 19:08:17 user nova-compute[73188]:       <mac address='fa:16:3e:99:31:c4'/>
Aug 15 19:08:17 user nova-compute[73188]:       <target dev='tapd54026b3-10'/>
Aug 15 19:08:17 user nova-compute[73188]:       <model type='virtio'/>
Aug 15 19:08:17 user nova-compute[73188]:       <mtu size='1442'/>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='net0'/>
Aug 15 19:08:17 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 19:08:17 user nova-compute[73188]:     </interface>
Aug 15 19:08:17 user nova-compute[73188]:     <serial type='pty'>
Aug 15 19:08:17 user nova-compute[73188]:       <source path='/dev/pts/6'/>
Aug 15 19:08:17 user nova-compute[73188]:       <log file='/opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/console.log' append='off'/>
Aug 15 19:08:17 user nova-compute[73188]:       <target type='isa-serial' port='0'>
Aug 15 19:08:17 user nova-compute[73188]:         <model name='isa-serial'/>
Aug 15 19:08:17 user nova-compute[73188]:       </target>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='serial0'/>
Aug 15 19:08:17 user nova-compute[73188]:     </serial>
Aug 15 19:08:17 user nova-compute[73188]:     <console type='pty' tty='/dev/pts/6'>
Aug 15 19:08:17 user nova-compute[73188]:       <source path='/dev/pts/6'/>
Aug 15 19:08:17 user nova-compute[73188]:       <log file='/opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/console.log' append='off'/>
Aug 15 19:08:17 user nova-compute[73188]:       <target type='serial' port='0'/>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='serial0'/>
Aug 15 19:08:17 user nova-compute[73188]:     </console>
Aug 15 19:08:17 user nova-compute[73188]:     <input type='mouse' bus='ps2'>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='input0'/>
Aug 15 19:08:17 user nova-compute[73188]:     </input>
Aug 15 19:08:17 user nova-compute[73188]:     <input type='keyboard' bus='ps2'>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='input1'/>
Aug 15 19:08:17 user nova-compute[73188]:     </input>
Aug 15 19:08:17 user nova-compute[73188]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 15 19:08:17 user nova-compute[73188]:       <listen type='address' address='0.0.0.0'/>
Aug 15 19:08:17 user nova-compute[73188]:     </graphics>
Aug 15 19:08:17 user nova-compute[73188]:     <audio id='1' type='none'/>
Aug 15 19:08:17 user nova-compute[73188]:     <video>
Aug 15 19:08:17 user nova-compute[73188]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='video0'/>
Aug 15 19:08:17 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 19:08:17 user nova-compute[73188]:     </video>
Aug 15 19:08:17 user nova-compute[73188]:     <memballoon model='virtio'>
Aug 15 19:08:17 user nova-compute[73188]:       <stats period='10'/>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='balloon0'/>
Aug 15 19:08:17 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 19:08:17 user nova-compute[73188]:     </memballoon>
Aug 15 19:08:17 user nova-compute[73188]:     <rng model='virtio'>
Aug 15 19:08:17 user nova-compute[73188]:       <backend model='random'>/dev/urandom</backend>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='rng0'/>
Aug 15 19:08:17 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 19:08:17 user nova-compute[73188]:     </rng>
Aug 15 19:08:17 user nova-compute[73188]:   </devices>
Aug 15 19:08:17 user nova-compute[73188]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 19:08:17 user nova-compute[73188]:     <label>libvirt-069eb3a9-59dc-45aa-a664-712ebbbad7e7</label>
Aug 15 19:08:17 user nova-compute[73188]:     <imagelabel>libvirt-069eb3a9-59dc-45aa-a664-712ebbbad7e7</imagelabel>
Aug 15 19:08:17 user nova-compute[73188]:   </seclabel>
Aug 15 19:08:17 user nova-compute[73188]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 19:08:17 user nova-compute[73188]:     <label>+64055:+108</label>
Aug 15 19:08:17 user nova-compute[73188]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 19:08:17 user nova-compute[73188]:   </seclabel>
Aug 15 19:08:17 user nova-compute[73188]: </domain>
Aug 15 19:08:17 user nova-compute[73188]:  {{(pid=73188) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [req-401734ab-18c8-4b92-95c1-eff9f4d5c861 req-ff077937-35b3-4901-880e-0e0b55b856c1 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7c:b2:ff"/><model type="virtio"/><mtu size="1442"/><target dev="tap60dc2be0-55"/></interface> {{(pid=73188) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [req-401734ab-18c8-4b92-95c1-eff9f4d5c861 req-ff077937-35b3-4901-880e-0e0b55b856c1 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7c:b2:ff"/><model type="virtio"/><mtu size="1442"/><target dev="tap60dc2be0-55"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 15 19:08:17 user nova-compute[73188]:   <name>instance-00000007</name>
Aug 15 19:08:17 user nova-compute[73188]:   <uuid>069eb3a9-59dc-45aa-a664-712ebbbad7e7</uuid>
Aug 15 19:08:17 user nova-compute[73188]:   <metadata>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:08:17 user nova-compute[73188]:   <nova:package version="0.0.0"/>
Aug 15 19:08:17 user nova-compute[73188]:   <nova:name>tempest-device-tagging-server-346712273</nova:name>
Aug 15 19:08:17 user nova-compute[73188]:   <nova:creationTime>2023-08-15 19:08:15</nova:creationTime>
Aug 15 19:08:17 user nova-compute[73188]:   <nova:flavor name="m1.tiny">
Aug 15 19:08:17 user nova-compute[73188]:     <nova:memory>512</nova:memory>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:disk>1</nova:disk>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:swap>0</nova:swap>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:vcpus>1</nova:vcpus>
Aug 15 19:08:17 user nova-compute[73188]:   </nova:flavor>
Aug 15 19:08:17 user nova-compute[73188]:   <nova:owner>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:user uuid="42c99d8a73ce4d2c9a6c98ebcec844bf">tempest-TaggedAttachmentsTest-241567705-project-member</nova:user>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:project uuid="eb6846c6807243379e6b5de3868c2fb2">tempest-TaggedAttachmentsTest-241567705</nova:project>
Aug 15 19:08:17 user nova-compute[73188]:   </nova:owner>
Aug 15 19:08:17 user nova-compute[73188]:   <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:08:17 user nova-compute[73188]:   <nova:ports>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:port uuid="d54026b3-10a6-44bb-9cc1-cb52b47fbfe2">
Aug 15 19:08:17 user nova-compute[73188]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 19:08:17 user nova-compute[73188]:     </nova:port>
Aug 15 19:08:17 user nova-compute[73188]:   </nova:ports>
Aug 15 19:08:17 user nova-compute[73188]: </nova:instance>
Aug 15 19:08:17 user nova-compute[73188]:   </metadata>
Aug 15 19:08:17 user nova-compute[73188]:   <memory unit='KiB'>524288</memory>
Aug 15 19:08:17 user nova-compute[73188]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 19:08:17 user nova-compute[73188]:   <vcpu placement='static'>1</vcpu>
Aug 15 19:08:17 user nova-compute[73188]:   <resource>
Aug 15 19:08:17 user nova-compute[73188]:     <partition>/machine</partition>
Aug 15 19:08:17 user nova-compute[73188]:   </resource>
Aug 15 19:08:17 user nova-compute[73188]:   <sysinfo type='smbios'>
Aug 15 19:08:17 user nova-compute[73188]:     <system>
Aug 15 19:08:17 user nova-compute[73188]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 19:08:17 user nova-compute[73188]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 19:08:17 user nova-compute[73188]:       <entry name='version'>0.0.0</entry>
Aug 15 19:08:17 user nova-compute[73188]:       <entry name='serial'>069eb3a9-59dc-45aa-a664-712ebbbad7e7</entry>
Aug 15 19:08:17 user nova-compute[73188]:       <entry name='uuid'>069eb3a9-59dc-45aa-a664-712ebbbad7e7</entry>
Aug 15 19:08:17 user nova-compute[73188]:       <entry name='family'>Virtual Machine</entry>
Aug 15 19:08:17 user nova-compute[73188]:     </system>
Aug 15 19:08:17 user nova-compute[73188]:   </sysinfo>
Aug 15 19:08:17 user nova-compute[73188]:   <os>
Aug 15 19:08:17 user nova-compute[73188]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 19:08:17 user nova-compute[73188]:     <boot dev='hd'/>
Aug 15 19:08:17 user nova-compute[73188]:     <smbios mode='sysinfo'/>
Aug 15 19:08:17 user nova-compute[73188]:   </os>
Aug 15 19:08:17 user nova-compute[73188]:   <features>
Aug 15 19:08:17 user nova-compute[73188]:     <acpi/>
Aug 15 19:08:17 user nova-compute[73188]:     <apic/>
Aug 15 19:08:17 user nova-compute[73188]:     <vmcoreinfo state='on'/>
Aug 15 19:08:17 user nova-compute[73188]:   </features>
Aug 15 19:08:17 user nova-compute[73188]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 19:08:17 user nova-compute[73188]:     <model fallback='forbid'>Nehalem</model>
Aug 15 19:08:17 user nova-compute[73188]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 19:08:17 user nova-compute[73188]:     <feature policy='require' name='vme'/>
Aug 15 19:08:17 user nova-compute[73188]:     <feature policy='require' name='x2apic'/>
Aug 15 19:08:17 user nova-compute[73188]:     <feature policy='require' name='hypervisor'/>
Aug 15 19:08:17 user nova-compute[73188]:   </cpu>
Aug 15 19:08:17 user nova-compute[73188]:   <clock offset='utc'>
Aug 15 19:08:17 user nova-compute[73188]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 19:08:17 user nova-compute[73188]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 19:08:17 user nova-compute[73188]:     <timer name='hpet' present='no'/>
Aug 15 19:08:17 user nova-compute[73188]:   </clock>
Aug 15 19:08:17 user nova-compute[73188]:   <on_poweroff>destroy</on_poweroff>
Aug 15 19:08:17 user nova-compute[73188]:   <on_reboot>restart</on_reboot>
Aug 15 19:08:17 user nova-compute[73188]:   <on_crash>destroy</on_crash>
Aug 15 19:08:17 user nova-compute[73188]:   <devices>
Aug 15 19:08:17 user nova-compute[73188]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 19:08:17 user nova-compute[73188]:     <disk type='file' device='disk'>
Aug 15 19:08:17 user nova-compute[73188]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 19:08:17 user nova-compute[73188]:       <source file='/opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk' index='2'/>
Aug 15 19:08:17 user nova-compute[73188]:       <backingStore type='file' index='3'>
Aug 15 19:08:17 user nova-compute[73188]:         <format type='raw'/>
Aug 15 19:08:17 user nova-compute[73188]:         <source file='/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f'/>
Aug 15 19:08:17 user nova-compute[73188]:         <backingStore/>
Aug 15 19:08:17 user nova-compute[73188]:       </backingStore>
Aug 15 19:08:17 user nova-compute[73188]:       <target dev='vda' bus='virtio'/>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='virtio-disk0'/>
Aug 15 19:08:17 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 19:08:17 user nova-compute[73188]:     </disk>
Aug 15 19:08:17 user nova-compute[73188]:     <disk type='file' device='cdrom'>
Aug 15 19:08:17 user nova-compute[73188]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 19:08:17 user nova-compute[73188]:       <source file='/opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/disk.config' index='1'/>
Aug 15 19:08:17 user nova-compute[73188]:       <backingStore/>
Aug 15 19:08:17 user nova-compute[73188]:       <target dev='hda' bus='ide'/>
Aug 15 19:08:17 user nova-compute[73188]:       <readonly/>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='ide0-0-0'/>
Aug 15 19:08:17 user nova-compute[73188]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 19:08:17 user nova-compute[73188]:     </disk>
Aug 15 19:08:17 user nova-compute[73188]:     <controller type='usb' index='0' model='none'>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='usb'/>
Aug 15 19:08:17 user nova-compute[73188]:     </controller>
Aug 15 19:08:17 user nova-compute[73188]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='pci.0'/>
Aug 15 19:08:17 user nova-compute[73188]:     </controller>
Aug 15 19:08:17 user nova-compute[73188]:     <controller type='ide' index='0'>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='ide'/>
Aug 15 19:08:17 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 19:08:17 user nova-compute[73188]:     </controller>
Aug 15 19:08:17 user nova-compute[73188]:     <interface type='ethernet'>
Aug 15 19:08:17 user nova-compute[73188]:       <mac address='fa:16:3e:99:31:c4'/>
Aug 15 19:08:17 user nova-compute[73188]:       <target dev='tapd54026b3-10'/>
Aug 15 19:08:17 user nova-compute[73188]:       <model type='virtio'/>
Aug 15 19:08:17 user nova-compute[73188]:       <mtu size='1442'/>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='net0'/>
Aug 15 19:08:17 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 19:08:17 user nova-compute[73188]:     </interface>
Aug 15 19:08:17 user nova-compute[73188]:     <serial type='pty'>
Aug 15 19:08:17 user nova-compute[73188]:       <source path='/dev/pts/6'/>
Aug 15 19:08:17 user nova-compute[73188]:       <log file='/opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/console.log' append='off'/>
Aug 15 19:08:17 user nova-compute[73188]:       <target type='isa-serial' port='0'>
Aug 15 19:08:17 user nova-compute[73188]:         <model name='isa-serial'/>
Aug 15 19:08:17 user nova-compute[73188]:       </target>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='serial0'/>
Aug 15 19:08:17 user nova-compute[73188]:     </serial>
Aug 15 19:08:17 user nova-compute[73188]:     <console type='pty' tty='/dev/pts/6'>
Aug 15 19:08:17 user nova-compute[73188]:       <source path='/dev/pts/6'/>
Aug 15 19:08:17 user nova-compute[73188]:       <log file='/opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7/console.log' append='off'/>
Aug 15 19:08:17 user nova-compute[73188]:       <target type='serial' port='0'/>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='serial0'/>
Aug 15 19:08:17 user nova-compute[73188]:     </console>
Aug 15 19:08:17 user nova-compute[73188]:     <input type='mouse' bus='ps2'>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='input0'/>
Aug 15 19:08:17 user nova-compute[73188]:     </input>
Aug 15 19:08:17 user nova-compute[73188]:     <input type='keyboard' bus='ps2'>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='input1'/>
Aug 15 19:08:17 user nova-compute[73188]:     </input>
Aug 15 19:08:17 user nova-compute[73188]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 15 19:08:17 user nova-compute[73188]:       <listen type='address' address='0.0.0.0'/>
Aug 15 19:08:17 user nova-compute[73188]:     </graphics>
Aug 15 19:08:17 user nova-compute[73188]:     <audio id='1' type='none'/>
Aug 15 19:08:17 user nova-compute[73188]:     <video>
Aug 15 19:08:17 user nova-compute[73188]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='video0'/>
Aug 15 19:08:17 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 19:08:17 user nova-compute[73188]:     </video>
Aug 15 19:08:17 user nova-compute[73188]:     <memballoon model='virtio'>
Aug 15 19:08:17 user nova-compute[73188]:       <stats period='10'/>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='balloon0'/>
Aug 15 19:08:17 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 19:08:17 user nova-compute[73188]:     </memballoon>
Aug 15 19:08:17 user nova-compute[73188]:     <rng model='virtio'>
Aug 15 19:08:17 user nova-compute[73188]:       <backend model='random'>/dev/urandom</backend>
Aug 15 19:08:17 user nova-compute[73188]:       <alias name='rng0'/>
Aug 15 19:08:17 user nova-compute[73188]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 19:08:17 user nova-compute[73188]:     </rng>
Aug 15 19:08:17 user nova-compute[73188]:   </devices>
Aug 15 19:08:17 user nova-compute[73188]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 19:08:17 user nova-compute[73188]:     <label>libvirt-069eb3a9-59dc-45aa-a664-712ebbbad7e7</label>
Aug 15 19:08:17 user nova-compute[73188]:     <imagelabel>libvirt-069eb3a9-59dc-45aa-a664-712ebbbad7e7</imagelabel>
Aug 15 19:08:17 user nova-compute[73188]:   </seclabel>
Aug 15 19:08:17 user nova-compute[73188]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 19:08:17 user nova-compute[73188]:     <label>+64055:+108</label>
Aug 15 19:08:17 user nova-compute[73188]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 19:08:17 user nova-compute[73188]:   </seclabel>
Aug 15 19:08:17 user nova-compute[73188]: </domain>
Aug 15 19:08:17 user nova-compute[73188]:  {{(pid=73188) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 19:08:17 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [req-401734ab-18c8-4b92-95c1-eff9f4d5c861 req-ff077937-35b3-4901-880e-0e0b55b856c1 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Detaching interface fa:16:3e:7c:b2:ff failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap60dc2be0-55' not found.
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [req-401734ab-18c8-4b92-95c1-eff9f4d5c861 req-ff077937-35b3-4901-880e-0e0b55b856c1 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:05:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-346712273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-346712273',id=7,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI7jXbeKw9zkf9/iIPvh7NB96wHBiVSd3tkGEgzRo7xcm/prE4XrAY5tS3bsMANa/m2oKIroukS/BgU5oVeuE62dlrCZmBmzDdHgRhV9W1LqC6AQ0bblC4H1qHiGzHZfg==',key_name='tempest-keypair-223053783',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:06:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb6846c6807243379e6b5de3868c2fb2',ramdisk_id='',reservation_id='r-krs477l0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-241567705',owner_user_name='tempest-TaggedAttachmentsTest-241567705-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:06:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42c99d8a73ce4d2c9a6c98ebcec844bf',uuid=069eb3a9-59dc-45aa-a664-712ebbbad7e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60dc2be0-5598-4839-a009-f131a8d2cbda", "address": "fa:16:3e:7c:b2:ff", "network": {"id": "2f260535-49bd-4da7-90bb-a9e20001c971", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-606058894", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dc2be0-55", "ovs_interfaceid": "60dc2be0-5598-4839-a009-f131a8d2cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.network.os_vif_util [req-401734ab-18c8-4b92-95c1-eff9f4d5c861 req-ff077937-35b3-4901-880e-0e0b55b856c1 service nova] Converting VIF {"id": "60dc2be0-5598-4839-a009-f131a8d2cbda", "address": "fa:16:3e:7c:b2:ff", "network": {"id": "2f260535-49bd-4da7-90bb-a9e20001c971", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-606058894", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60dc2be0-55", "ovs_interfaceid": "60dc2be0-5598-4839-a009-f131a8d2cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.network.os_vif_util [req-401734ab-18c8-4b92-95c1-eff9f4d5c861 req-ff077937-35b3-4901-880e-0e0b55b856c1 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b2:ff,bridge_name='br-int',has_traffic_filtering=True,id=60dc2be0-5598-4839-a009-f131a8d2cbda,network=Network(2f260535-49bd-4da7-90bb-a9e20001c971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dc2be0-55') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG os_vif [req-401734ab-18c8-4b92-95c1-eff9f4d5c861 req-ff077937-35b3-4901-880e-0e0b55b856c1 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b2:ff,bridge_name='br-int',has_traffic_filtering=True,id=60dc2be0-5598-4839-a009-f131a8d2cbda,network=Network(2f260535-49bd-4da7-90bb-a9e20001c971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dc2be0-55') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60dc2be0-55, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:08:17 user nova-compute[73188]: INFO os_vif [req-401734ab-18c8-4b92-95c1-eff9f4d5c861 req-ff077937-35b3-4901-880e-0e0b55b856c1 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b2:ff,bridge_name='br-int',has_traffic_filtering=True,id=60dc2be0-5598-4839-a009-f131a8d2cbda,network=Network(2f260535-49bd-4da7-90bb-a9e20001c971),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60dc2be0-55')
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [req-401734ab-18c8-4b92-95c1-eff9f4d5c861 req-ff077937-35b3-4901-880e-0e0b55b856c1 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:08:17 user nova-compute[73188]:   <nova:package version="0.0.0"/>
Aug 15 19:08:17 user nova-compute[73188]:   <nova:name>tempest-device-tagging-server-346712273</nova:name>
Aug 15 19:08:17 user nova-compute[73188]:   <nova:creationTime>2023-08-15 19:08:17</nova:creationTime>
Aug 15 19:08:17 user nova-compute[73188]:   <nova:flavor name="m1.tiny">
Aug 15 19:08:17 user nova-compute[73188]:     <nova:memory>512</nova:memory>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:disk>1</nova:disk>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:swap>0</nova:swap>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:vcpus>1</nova:vcpus>
Aug 15 19:08:17 user nova-compute[73188]:   </nova:flavor>
Aug 15 19:08:17 user nova-compute[73188]:   <nova:owner>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:user uuid="42c99d8a73ce4d2c9a6c98ebcec844bf">tempest-TaggedAttachmentsTest-241567705-project-member</nova:user>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:project uuid="eb6846c6807243379e6b5de3868c2fb2">tempest-TaggedAttachmentsTest-241567705</nova:project>
Aug 15 19:08:17 user nova-compute[73188]:   </nova:owner>
Aug 15 19:08:17 user nova-compute[73188]:   <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:08:17 user nova-compute[73188]:   <nova:ports>
Aug 15 19:08:17 user nova-compute[73188]:     <nova:port uuid="d54026b3-10a6-44bb-9cc1-cb52b47fbfe2">
Aug 15 19:08:17 user nova-compute[73188]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 19:08:17 user nova-compute[73188]:     </nova:port>
Aug 15 19:08:17 user nova-compute[73188]:   </nova:ports>
Aug 15 19:08:17 user nova-compute[73188]: </nova:instance>
Aug 15 19:08:17 user nova-compute[73188]:  {{(pid=73188) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.689s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.296s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.network.neutron [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:08:17 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:08:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3d713d03-3e60-4dec-a295-a4652ac21842 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 588767b7-fc11-4c92-9404-cf1333b53748 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 7caf434b-1484-4832-afee-0e2454bb5089 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance deb3ccb4-136f-4873-959d-edecdc436291 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance d1b5f5bf-9672-40a8-83da-3a8f25007e91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance c3ca002b-c535-4b87-8d39-861ce6847f12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 082c19a9-6a4f-4f27-8c77-d37db7d2306a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 0d5df01f-2a14-423a-9872-69132a3874ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e8b88f49-7f48-4170-af8a-aa1de706f218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 069eb3a9-59dc-45aa-a664-712ebbbad7e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance fd74b385-fcfa-4a38-b869-0f5a8328188c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.policy [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8f043ccdccd47cbac54339585154dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aeee537b84a4e42b0ef67c309d14c1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.manager [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:08:18 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Creating image(s)
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Acquiring lock "/opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "/opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "/opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Updating instance_info_cache with network_info: [{"id": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "address": "fa:16:3e:99:31:c4", "network": {"id": "b0e519b5-4707-426d-b7c1-d5fc433bfbaa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2015894405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54026b3-10", "ovs_interfaceid": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.manager [req-a8d01d10-af16-46ea-87c3-1fc926836288 req-bc1d7f6a-865d-4ed6-9021-76c62d2393f6 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Received event network-vif-plugged-60dc2be0-5598-4839-a009-f131a8d2cbda {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a8d01d10-af16-46ea-87c3-1fc926836288 req-bc1d7f6a-865d-4ed6-9021-76c62d2393f6 service nova] Acquiring lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a8d01d10-af16-46ea-87c3-1fc926836288 req-bc1d7f6a-865d-4ed6-9021-76c62d2393f6 service nova] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a8d01d10-af16-46ea-87c3-1fc926836288 req-bc1d7f6a-865d-4ed6-9021-76c62d2393f6 service nova] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.manager [req-a8d01d10-af16-46ea-87c3-1fc926836288 req-bc1d7f6a-865d-4ed6-9021-76c62d2393f6 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] No waiting events found dispatching network-vif-plugged-60dc2be0-5598-4839-a009-f131a8d2cbda {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:18 user nova-compute[73188]: WARNING nova.compute.manager [req-a8d01d10-af16-46ea-87c3-1fc926836288 req-bc1d7f6a-865d-4ed6-9021-76c62d2393f6 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Received unexpected event network-vif-plugged-60dc2be0-5598-4839-a009-f131a8d2cbda for instance with vm_state active and task_state None.
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Releasing lock "refresh_cache-069eb3a9-59dc-45aa-a664-712ebbbad7e7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8ff1ab13-98f7-4dd6-9a61-8ea600319e2c tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "interface-069eb3a9-59dc-45aa-a664-712ebbbad7e7-60dc2be0-5598-4839-a009-f131a8d2cbda" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.759s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.network.neutron [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Successfully updated port: 3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "refresh_cache-3d713d03-3e60-4dec-a295-a4652ac21842" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquired lock "refresh_cache-3d713d03-3e60-4dec-a295-a4652ac21842" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.network.neutron [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.manager [req-7a2c4cfd-c904-4d71-8f1c-0241e567e355 req-8c682666-9e0f-4373-be3f-78b54057c915 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received event network-changed-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.manager [req-7a2c4cfd-c904-4d71-8f1c-0241e567e355 req-8c682666-9e0f-4373-be3f-78b54057c915 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Refreshing instance network info cache due to event network-changed-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7a2c4cfd-c904-4d71-8f1c-0241e567e355 req-8c682666-9e0f-4373-be3f-78b54057c915 service nova] Acquiring lock "refresh_cache-3d713d03-3e60-4dec-a295-a4652ac21842" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.network.neutron [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.223s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/disk 1073741824" returned: 0 in 0.142s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.369s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.895s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.181s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Checking if we can resize image /opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.network.neutron [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Updating instance_info_cache with network_info: [{"id": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "address": "fa:16:3e:b4:8c:fd", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8c4e95-fc", "ovs_interfaceid": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Releasing lock "refresh_cache-3d713d03-3e60-4dec-a295-a4652ac21842" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.compute.manager [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Instance network_info: |[{"id": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "address": "fa:16:3e:b4:8c:fd", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8c4e95-fc", "ovs_interfaceid": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7a2c4cfd-c904-4d71-8f1c-0241e567e355 req-8c682666-9e0f-4373-be3f-78b54057c915 service nova] Acquired lock "refresh_cache-3d713d03-3e60-4dec-a295-a4652ac21842" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.network.neutron [req-7a2c4cfd-c904-4d71-8f1c-0241e567e355 req-8c682666-9e0f-4373-be3f-78b54057c915 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Refreshing network info cache for port 3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:08:18 user nova-compute[73188]: DEBUG nova.network.neutron [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Successfully created port: 2d3fdbfd-6453-4c6f-ad40-09561b8a4908 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:08:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:19 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Cannot resize image /opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:08:19 user nova-compute[73188]: DEBUG nova.objects.instance [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lazy-loading 'migration_context' on Instance uuid 082c19a9-6a4f-4f27-8c77-d37db7d2306a {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:19 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:08:19 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Ensure instance console log exists: /opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:08:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:19 user nova-compute[73188]: DEBUG nova.network.neutron [req-7a2c4cfd-c904-4d71-8f1c-0241e567e355 req-8c682666-9e0f-4373-be3f-78b54057c915 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Updated VIF entry in instance network info cache for port 3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:08:19 user nova-compute[73188]: DEBUG nova.network.neutron [req-7a2c4cfd-c904-4d71-8f1c-0241e567e355 req-8c682666-9e0f-4373-be3f-78b54057c915 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Updating instance_info_cache with network_info: [{"id": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "address": "fa:16:3e:b4:8c:fd", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8c4e95-fc", "ovs_interfaceid": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:08:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7a2c4cfd-c904-4d71-8f1c-0241e567e355 req-8c682666-9e0f-4373-be3f-78b54057c915 service nova] Releasing lock "refresh_cache-3d713d03-3e60-4dec-a295-a4652ac21842" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:08:19 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:08:19 user nova-compute[73188]: DEBUG nova.network.neutron [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Successfully updated port: 2d3fdbfd-6453-4c6f-ad40-09561b8a4908 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:08:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Acquiring lock "refresh_cache-082c19a9-6a4f-4f27-8c77-d37db7d2306a" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:08:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Acquired lock "refresh_cache-082c19a9-6a4f-4f27-8c77-d37db7d2306a" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:08:19 user nova-compute[73188]: DEBUG nova.network.neutron [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:08:19 user nova-compute[73188]: DEBUG nova.network.neutron [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.network.neutron [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Updating instance_info_cache with network_info: [{"id": "2d3fdbfd-6453-4c6f-ad40-09561b8a4908", "address": "fa:16:3e:1f:48:37", "network": {"id": "ebc6093a-4273-43c5-9d01-0abe8a3a37b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1075513938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aeee537b84a4e42b0ef67c309d14c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3fdbfd-64", "ovs_interfaceid": "2d3fdbfd-6453-4c6f-ad40-09561b8a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Releasing lock "refresh_cache-082c19a9-6a4f-4f27-8c77-d37db7d2306a" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Instance network_info: |[{"id": "2d3fdbfd-6453-4c6f-ad40-09561b8a4908", "address": "fa:16:3e:1f:48:37", "network": {"id": "ebc6093a-4273-43c5-9d01-0abe8a3a37b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1075513938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aeee537b84a4e42b0ef67c309d14c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3fdbfd-64", "ovs_interfaceid": "2d3fdbfd-6453-4c6f-ad40-09561b8a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Start _get_guest_xml network_info=[{"id": "2d3fdbfd-6453-4c6f-ad40-09561b8a4908", "address": "fa:16:3e:1f:48:37", "network": {"id": "ebc6093a-4273-43c5-9d01-0abe8a3a37b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1075513938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aeee537b84a4e42b0ef67c309d14c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3fdbfd-64", "ovs_interfaceid": "2d3fdbfd-6453-4c6f-ad40-09561b8a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.compute.manager [req-6448ac28-1c71-4434-aa09-99137c463f33 req-a97d6ae7-938d-49af-afdd-db0aa47683f3 service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Received event network-changed-2d3fdbfd-6453-4c6f-ad40-09561b8a4908 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.compute.manager [req-6448ac28-1c71-4434-aa09-99137c463f33 req-a97d6ae7-938d-49af-afdd-db0aa47683f3 service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Refreshing instance network info cache due to event network-changed-2d3fdbfd-6453-4c6f-ad40-09561b8a4908. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6448ac28-1c71-4434-aa09-99137c463f33 req-a97d6ae7-938d-49af-afdd-db0aa47683f3 service nova] Acquiring lock "refresh_cache-082c19a9-6a4f-4f27-8c77-d37db7d2306a" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6448ac28-1c71-4434-aa09-99137c463f33 req-a97d6ae7-938d-49af-afdd-db0aa47683f3 service nova] Acquired lock "refresh_cache-082c19a9-6a4f-4f27-8c77-d37db7d2306a" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.network.neutron [req-6448ac28-1c71-4434-aa09-99137c463f33 req-a97d6ae7-938d-49af-afdd-db0aa47683f3 service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Refreshing network info cache for port 2d3fdbfd-6453-4c6f-ad40-09561b8a4908 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:08:20 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:08:20 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-866054589',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-866054589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8660545',id=14,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKwC0o4tZJseST53mAbAZ+7raLurbyWxbskPrRQOXyUtQ9/DTpcZAJgCfh2OzxRkzxPl+m9Rr47U+9+4qmQVJ1CX7WsNekWpwVABeXfHRnFWaxq9VQe2LrAq62Oa/+Kyw==',key_name='tempest-keypair-1211840095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7aeee537b84a4e42b0ef67c309d14c1c',ramdisk_id='',reservation_id='r-u5n7aif3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1844885147',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:08:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8f043ccdccd47cbac54339585154dc4',uuid=082c19a9-6a4f-4f27-8c77-d37db7d2306a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d3fdbfd-6453-4c6f-ad40-09561b8a4908", "address": "fa:16:3e:1f:48:37", "network": {"id": "ebc6093a-4273-43c5-9d01-0abe8a3a37b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1075513938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aeee537b84a4e42b0ef67c309d14c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3fdbfd-64", "ovs_interfaceid": "2d3fdbfd-6453-4c6f-ad40-09561b8a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Converting VIF {"id": "2d3fdbfd-6453-4c6f-ad40-09561b8a4908", "address": "fa:16:3e:1f:48:37", "network": {"id": "ebc6093a-4273-43c5-9d01-0abe8a3a37b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1075513938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aeee537b84a4e42b0ef67c309d14c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3fdbfd-64", "ovs_interfaceid": "2d3fdbfd-6453-4c6f-ad40-09561b8a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:48:37,bridge_name='br-int',has_traffic_filtering=True,id=2d3fdbfd-6453-4c6f-ad40-09561b8a4908,network=Network(ebc6093a-4273-43c5-9d01-0abe8a3a37b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3fdbfd-64') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.objects.instance [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lazy-loading 'pci_devices' on Instance uuid 082c19a9-6a4f-4f27-8c77-d37db7d2306a {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:08:20 user nova-compute[73188]:   <uuid>082c19a9-6a4f-4f27-8c77-d37db7d2306a</uuid>
Aug 15 19:08:20 user nova-compute[73188]:   <name>instance-0000000e</name>
Aug 15 19:08:20 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:08:20 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:08:20 user nova-compute[73188]:   <metadata>
Aug 15 19:08:20 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:08:20 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:08:20 user nova-compute[73188]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-866054589</nova:name>
Aug 15 19:08:20 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:08:20</nova:creationTime>
Aug 15 19:08:20 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:08:20 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:08:20 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:08:20 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:08:20 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:08:20 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:08:20 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:08:20 user nova-compute[73188]:       <nova:owner>
Aug 15 19:08:20 user nova-compute[73188]:         <nova:user uuid="e8f043ccdccd47cbac54339585154dc4">tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member</nova:user>
Aug 15 19:08:20 user nova-compute[73188]:         <nova:project uuid="7aeee537b84a4e42b0ef67c309d14c1c">tempest-TestServerVolumeAttachScenarioOldVersion-1844885147</nova:project>
Aug 15 19:08:20 user nova-compute[73188]:       </nova:owner>
Aug 15 19:08:20 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:08:20 user nova-compute[73188]:       <nova:ports>
Aug 15 19:08:20 user nova-compute[73188]:         <nova:port uuid="2d3fdbfd-6453-4c6f-ad40-09561b8a4908">
Aug 15 19:08:20 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 19:08:20 user nova-compute[73188]:         </nova:port>
Aug 15 19:08:20 user nova-compute[73188]:       </nova:ports>
Aug 15 19:08:20 user nova-compute[73188]:     </nova:instance>
Aug 15 19:08:20 user nova-compute[73188]:   </metadata>
Aug 15 19:08:20 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:08:20 user nova-compute[73188]:     <system>
Aug 15 19:08:20 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:08:20 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:08:20 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:08:20 user nova-compute[73188]:       <entry name="serial">082c19a9-6a4f-4f27-8c77-d37db7d2306a</entry>
Aug 15 19:08:20 user nova-compute[73188]:       <entry name="uuid">082c19a9-6a4f-4f27-8c77-d37db7d2306a</entry>
Aug 15 19:08:20 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:08:20 user nova-compute[73188]:     </system>
Aug 15 19:08:20 user nova-compute[73188]:   </sysinfo>
Aug 15 19:08:20 user nova-compute[73188]:   <os>
Aug 15 19:08:20 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:08:20 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:08:20 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:08:20 user nova-compute[73188]:   </os>
Aug 15 19:08:20 user nova-compute[73188]:   <features>
Aug 15 19:08:20 user nova-compute[73188]:     <acpi/>
Aug 15 19:08:20 user nova-compute[73188]:     <apic/>
Aug 15 19:08:20 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:08:20 user nova-compute[73188]:   </features>
Aug 15 19:08:20 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:08:20 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:08:20 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:08:20 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:08:20 user nova-compute[73188]:   </clock>
Aug 15 19:08:20 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:08:20 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:08:20 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:08:20 user nova-compute[73188]:   </cpu>
Aug 15 19:08:20 user nova-compute[73188]:   <devices>
Aug 15 19:08:20 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:08:20 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:08:20 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/disk"/>
Aug 15 19:08:20 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:08:20 user nova-compute[73188]:     </disk>
Aug 15 19:08:20 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:08:20 user nova-compute[73188]:       <mac address="fa:16:3e:1f:48:37"/>
Aug 15 19:08:20 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:08:20 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:08:20 user nova-compute[73188]:       <target dev="tap2d3fdbfd-64"/>
Aug 15 19:08:20 user nova-compute[73188]:     </interface>
Aug 15 19:08:20 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:08:20 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/console.log" append="off"/>
Aug 15 19:08:20 user nova-compute[73188]:     </serial>
Aug 15 19:08:20 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:08:20 user nova-compute[73188]:     <video>
Aug 15 19:08:20 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:08:20 user nova-compute[73188]:     </video>
Aug 15 19:08:20 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:08:20 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:08:20 user nova-compute[73188]:     </rng>
Aug 15 19:08:20 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:08:20 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:08:20 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:08:20 user nova-compute[73188]:     </memballoon>
Aug 15 19:08:20 user nova-compute[73188]:   </devices>
Aug 15 19:08:20 user nova-compute[73188]: </domain>
Aug 15 19:08:20 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-866054589',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-866054589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8660545',id=14,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKwC0o4tZJseST53mAbAZ+7raLurbyWxbskPrRQOXyUtQ9/DTpcZAJgCfh2OzxRkzxPl+m9Rr47U+9+4qmQVJ1CX7WsNekWpwVABeXfHRnFWaxq9VQe2LrAq62Oa/+Kyw==',key_name='tempest-keypair-1211840095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7aeee537b84a4e42b0ef67c309d14c1c',ramdisk_id='',reservation_id='r-u5n7aif3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1844885147',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:08:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8f043ccdccd47cbac54339585154dc4',uuid=082c19a9-6a4f-4f27-8c77-d37db7d2306a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d3fdbfd-6453-4c6f-ad40-09561b8a4908", "address": "fa:16:3e:1f:48:37", "network": {"id": "ebc6093a-4273-43c5-9d01-0abe8a3a37b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1075513938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aeee537b84a4e42b0ef67c309d14c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3fdbfd-64", "ovs_interfaceid": "2d3fdbfd-6453-4c6f-ad40-09561b8a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Converting VIF {"id": "2d3fdbfd-6453-4c6f-ad40-09561b8a4908", "address": "fa:16:3e:1f:48:37", "network": {"id": "ebc6093a-4273-43c5-9d01-0abe8a3a37b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1075513938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aeee537b84a4e42b0ef67c309d14c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3fdbfd-64", "ovs_interfaceid": "2d3fdbfd-6453-4c6f-ad40-09561b8a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:48:37,bridge_name='br-int',has_traffic_filtering=True,id=2d3fdbfd-6453-4c6f-ad40-09561b8a4908,network=Network(ebc6093a-4273-43c5-9d01-0abe8a3a37b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3fdbfd-64') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG os_vif [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:48:37,bridge_name='br-int',has_traffic_filtering=True,id=2d3fdbfd-6453-4c6f-ad40-09561b8a4908,network=Network(ebc6093a-4273-43c5-9d01-0abe8a3a37b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3fdbfd-64') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d3fdbfd-64, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2d3fdbfd-64, col_values=(('external_ids', {'iface-id': '2d3fdbfd-6453-4c6f-ad40-09561b8a4908', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:48:37', 'vm-uuid': '082c19a9-6a4f-4f27-8c77-d37db7d2306a'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:20 user nova-compute[73188]: INFO os_vif [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:48:37,bridge_name='br-int',has_traffic_filtering=True,id=2d3fdbfd-6453-4c6f-ad40-09561b8a4908,network=Network(ebc6093a-4273-43c5-9d01-0abe8a3a37b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3fdbfd-64')
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] No VIF found with MAC fa:16:3e:1f:48:37, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.network.neutron [req-6448ac28-1c71-4434-aa09-99137c463f33 req-a97d6ae7-938d-49af-afdd-db0aa47683f3 service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Updated VIF entry in instance network info cache for port 2d3fdbfd-6453-4c6f-ad40-09561b8a4908. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG nova.network.neutron [req-6448ac28-1c71-4434-aa09-99137c463f33 req-a97d6ae7-938d-49af-afdd-db0aa47683f3 service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Updating instance_info_cache with network_info: [{"id": "2d3fdbfd-6453-4c6f-ad40-09561b8a4908", "address": "fa:16:3e:1f:48:37", "network": {"id": "ebc6093a-4273-43c5-9d01-0abe8a3a37b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1075513938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aeee537b84a4e42b0ef67c309d14c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3fdbfd-64", "ovs_interfaceid": "2d3fdbfd-6453-4c6f-ad40-09561b8a4908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:08:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6448ac28-1c71-4434-aa09-99137c463f33 req-a97d6ae7-938d-49af-afdd-db0aa47683f3 service nova] Releasing lock "refresh_cache-082c19a9-6a4f-4f27-8c77-d37db7d2306a" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:08:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:21 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692126486.664667, dad06110-8c8a-432a-91d5-8d1b840b26ca => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:08:21 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] VM Stopped (Lifecycle Event)
Aug 15 19:08:21 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e32b5250-02c0-4fce-a458-0a1c67e1e371 None None] [instance: dad06110-8c8a-432a-91d5-8d1b840b26ca] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:08:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-83d62053-07d9-4e2b-8542-92868e670168 req-66e20275-7645-4aa4-b526-780b115b7326 service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Received event network-vif-plugged-2d3fdbfd-6453-4c6f-ad40-09561b8a4908 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-83d62053-07d9-4e2b-8542-92868e670168 req-66e20275-7645-4aa4-b526-780b115b7326 service nova] Acquiring lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-83d62053-07d9-4e2b-8542-92868e670168 req-66e20275-7645-4aa4-b526-780b115b7326 service nova] Lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-83d62053-07d9-4e2b-8542-92868e670168 req-66e20275-7645-4aa4-b526-780b115b7326 service nova] Lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-83d62053-07d9-4e2b-8542-92868e670168 req-66e20275-7645-4aa4-b526-780b115b7326 service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] No waiting events found dispatching network-vif-plugged-2d3fdbfd-6453-4c6f-ad40-09561b8a4908 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:21 user nova-compute[73188]: WARNING nova.compute.manager [req-83d62053-07d9-4e2b-8542-92868e670168 req-66e20275-7645-4aa4-b526-780b115b7326 service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Received unexpected event network-vif-plugged-2d3fdbfd-6453-4c6f-ad40-09561b8a4908 for instance with vm_state building and task_state spawning.
Aug 15 19:08:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG os_brick.utils [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e950a6-1802-4158-9b1d-16a0126d2762]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7b06c5-67b8-47b9-b736-471972d10953]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5a44ce-e236-41ef-ad3d-855d32fe8b2d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa30d5a1-5dd3-475b-991e-7abf1727d4ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:08:22 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:08:22 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f4b764-e1b0-44a6-865a-f36c5fd06ac3]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG os_brick.utils [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:08:22 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Updating existing volume attachment record: d131b62c-381b-40ce-a996-75fbede5b40b {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:08:23 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126503.8065922, 082c19a9-6a4f-4f27-8c77-d37db7d2306a => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:08:23 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] VM Resumed (Lifecycle Event)
Aug 15 19:08:23 user nova-compute[73188]: DEBUG nova.compute.manager [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:08:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:08:23 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Instance spawned successfully.
Aug 15 19:08:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:08:23 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:08:23 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:08:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:23 user nova-compute[73188]: DEBUG nova.compute.manager [req-920962bc-0407-4915-a679-ee5af870ad52 req-1a5ed26a-eddb-487b-8619-8e0aff94461a service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Received event network-vif-plugged-2d3fdbfd-6453-4c6f-ad40-09561b8a4908 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-920962bc-0407-4915-a679-ee5af870ad52 req-1a5ed26a-eddb-487b-8619-8e0aff94461a service nova] Acquiring lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-920962bc-0407-4915-a679-ee5af870ad52 req-1a5ed26a-eddb-487b-8619-8e0aff94461a service nova] Lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-920962bc-0407-4915-a679-ee5af870ad52 req-1a5ed26a-eddb-487b-8619-8e0aff94461a service nova] Lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:23 user nova-compute[73188]: DEBUG nova.compute.manager [req-920962bc-0407-4915-a679-ee5af870ad52 req-1a5ed26a-eddb-487b-8619-8e0aff94461a service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] No waiting events found dispatching network-vif-plugged-2d3fdbfd-6453-4c6f-ad40-09561b8a4908 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:23 user nova-compute[73188]: WARNING nova.compute.manager [req-920962bc-0407-4915-a679-ee5af870ad52 req-1a5ed26a-eddb-487b-8619-8e0aff94461a service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Received unexpected event network-vif-plugged-2d3fdbfd-6453-4c6f-ad40-09561b8a4908 for instance with vm_state building and task_state spawning.
Aug 15 19:08:23 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:08:23 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126503.8070872, 082c19a9-6a4f-4f27-8c77-d37db7d2306a => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:08:23 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] VM Started (Lifecycle Event)
Aug 15 19:08:23 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:08:24 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:08:24 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:08:24 user nova-compute[73188]: INFO nova.compute.manager [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Took 5.96 seconds to spawn the instance on the hypervisor.
Aug 15 19:08:24 user nova-compute[73188]: DEBUG nova.compute.manager [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:08:24 user nova-compute[73188]: INFO nova.compute.manager [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Took 8.58 seconds to build instance.
Aug 15 19:08:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2d2b3b6a-0651-4166-ac04-99cb9c5d454f tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.682s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:27 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692126492.806878, fd74b385-fcfa-4a38-b869-0f5a8328188c => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:08:27 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] VM Stopped (Lifecycle Event)
Aug 15 19:08:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-9bd7dfff-ae62-482a-bc3a-4422509ff04b None None] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:08:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG nova.compute.manager [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:08:33 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Creating image(s)
Aug 15 19:08:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Did not create local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Ensure instance console log exists: /opt/stack/data/nova/instances/3d713d03-3e60-4dec-a295-a4652ac21842/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Start _get_guest_xml network_info=[{"id": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "address": "fa:16:3e:b4:8c:fd", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8c4e95-fc", "ovs_interfaceid": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELbiNtlV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3d713d03-3e60-4dec-a295-a4652ac21842', 'attached_at': '', 'detached_at': '', 'volume_id': '8f900015-9127-4c92-b74d-568597372c4c', 'serial': '8f900015-9127-4c92-b74d-568597372c4c'}, 'attachment_id': 'd131b62c-381b-40ce-a996-75fbede5b40b', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:08:33 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:08:33 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:08:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELbiNtlV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:08:33 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:08:33 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:08:33 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:08:33 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:08:33 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:08:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44aa1fa-2513-4797-9672-f6d58976a575]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:08:33 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f507cce5-b7ed-41d7-a915-5ed28a0c50bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c] added
Aug 15 19:08:33 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db1ff10-61b4-428d-abae-28f1268628d0]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[96078470-e8a9-4420-acc3-c8c6d516fb48]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELbiNtlV {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELbiNtlV" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[827fe908-2611-4c84-a4be-5c99938f58a7]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ELbiNtlV'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3abc922-b5b5-4149-aa91-f5119ac9fa35]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c1cff3-961d-4313-9489-0338dc318b25]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:34 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:34 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1508b9d-7d58-4507-9cc2-1bdf4f80b59d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c, portal: 172.16.0.220,3260]
Aug 15 19:08:34 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c, portal: 172.16.0.220,3260] successful.
Aug 15 19:08:34 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0d3f2d-3a7a-4272-86b3-37ee16fef11c]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[69028705-403e-4117-8b58-40bb515f0691]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:34 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:34 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:34 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3593edfd-ce11-4bba-989b-18f7ae781362]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: None {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG nova.compute.manager [req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e req-0e50e065-2336-4b99-9842-2decc4b73a23 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Received event volume-reimaged-5f013040-56d6-4ad2-aa09-4346f46f544b {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e req-0e50e065-2336-4b99-9842-2decc4b73a23 service nova] Acquiring lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e req-0e50e065-2336-4b99-9842-2decc4b73a23 service nova] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e req-0e50e065-2336-4b99-9842-2decc4b73a23 service nova] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG nova.compute.manager [req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e req-0e50e065-2336-4b99-9842-2decc4b73a23 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Processing event volume-reimaged-5f013040-56d6-4ad2-aa09-4346f46f544b {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Instance event wait completed in 19 seconds for volume-reimaged {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:08:34 user nova-compute[73188]: INFO nova.virt.block_device [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Booting with volume 5f013040-56d6-4ad2-aa09-4346f46f544b at /dev/vda
Aug 15 19:08:34 user nova-compute[73188]: DEBUG os_brick.utils [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b88605c-6835-489d-8cc2-439e94d61bcb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8c3aab-9bb8-435b-affa-337b2418ce4e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4782b01d-5cab-470b-88a4-ffc1fbbf017e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6a33c7-a666-467d-8f03-52864f7eb9e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:08:34 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:08:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d284be8b-9c05-4b8c-93ee-8108b7b9d985]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG os_brick.utils [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:08:34 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Updating existing volume attachment record: 7fef8839-49c3-4a35-932d-420cf214a2a0 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELbiNtlV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23965353562323366', 'path': '/dev/sdb'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965353562323366', 'path': '/dev/sdb'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1431736966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1431736966',id=13,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ab4e1cccd434f6c83f2f9e4687d274e',ramdisk_id='',reservation_id='r-kff5lb5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:08:16Z,user_data=None,user_id='bad952eceaec400396fd0a28c438c761',uuid=3d713d03-3e60-4dec-a295-a4652ac21842,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "address": "fa:16:3e:b4:8c:fd", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8c4e95-fc", "ovs_interfaceid": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converting VIF {"id": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "address": "fa:16:3e:b4:8c:fd", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8c4e95-fc", "ovs_interfaceid": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:8c:fd,bridge_name='br-int',has_traffic_filtering=True,id=3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8c4e95-fc') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG nova.objects.instance [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d713d03-3e60-4dec-a295-a4652ac21842 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:08:35 user nova-compute[73188]:   <uuid>3d713d03-3e60-4dec-a295-a4652ac21842</uuid>
Aug 15 19:08:35 user nova-compute[73188]:   <name>instance-0000000d</name>
Aug 15 19:08:35 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:08:35 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:08:35 user nova-compute[73188]:   <metadata>
Aug 15 19:08:35 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:08:35 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:08:35 user nova-compute[73188]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1431736966</nova:name>
Aug 15 19:08:35 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:08:33</nova:creationTime>
Aug 15 19:08:35 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:08:35 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:08:35 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:08:35 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:08:35 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:08:35 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:08:35 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:08:35 user nova-compute[73188]:       <nova:owner>
Aug 15 19:08:35 user nova-compute[73188]:         <nova:user uuid="bad952eceaec400396fd0a28c438c761">tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member</nova:user>
Aug 15 19:08:35 user nova-compute[73188]:         <nova:project uuid="0ab4e1cccd434f6c83f2f9e4687d274e">tempest-ServerBootFromVolumeStableRescueTest-1886926549</nova:project>
Aug 15 19:08:35 user nova-compute[73188]:       </nova:owner>
Aug 15 19:08:35 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:08:35 user nova-compute[73188]:       <nova:ports>
Aug 15 19:08:35 user nova-compute[73188]:         <nova:port uuid="3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d">
Aug 15 19:08:35 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 19:08:35 user nova-compute[73188]:         </nova:port>
Aug 15 19:08:35 user nova-compute[73188]:       </nova:ports>
Aug 15 19:08:35 user nova-compute[73188]:     </nova:instance>
Aug 15 19:08:35 user nova-compute[73188]:   </metadata>
Aug 15 19:08:35 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:08:35 user nova-compute[73188]:     <system>
Aug 15 19:08:35 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:08:35 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:08:35 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:08:35 user nova-compute[73188]:       <entry name="serial">3d713d03-3e60-4dec-a295-a4652ac21842</entry>
Aug 15 19:08:35 user nova-compute[73188]:       <entry name="uuid">3d713d03-3e60-4dec-a295-a4652ac21842</entry>
Aug 15 19:08:35 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:08:35 user nova-compute[73188]:     </system>
Aug 15 19:08:35 user nova-compute[73188]:   </sysinfo>
Aug 15 19:08:35 user nova-compute[73188]:   <os>
Aug 15 19:08:35 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:08:35 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:08:35 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:08:35 user nova-compute[73188]:   </os>
Aug 15 19:08:35 user nova-compute[73188]:   <features>
Aug 15 19:08:35 user nova-compute[73188]:     <acpi/>
Aug 15 19:08:35 user nova-compute[73188]:     <apic/>
Aug 15 19:08:35 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:08:35 user nova-compute[73188]:   </features>
Aug 15 19:08:35 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:08:35 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:08:35 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:08:35 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:08:35 user nova-compute[73188]:   </clock>
Aug 15 19:08:35 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:08:35 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:08:35 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:08:35 user nova-compute[73188]:   </cpu>
Aug 15 19:08:35 user nova-compute[73188]:   <devices>
Aug 15 19:08:35 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:08:35 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:08:35 user nova-compute[73188]:       <source dev="/dev/sdb"/>
Aug 15 19:08:35 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:08:35 user nova-compute[73188]:       <serial>8f900015-9127-4c92-b74d-568597372c4c</serial>
Aug 15 19:08:35 user nova-compute[73188]:     </disk>
Aug 15 19:08:35 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:08:35 user nova-compute[73188]:       <mac address="fa:16:3e:b4:8c:fd"/>
Aug 15 19:08:35 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:08:35 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:08:35 user nova-compute[73188]:       <target dev="tap3a8c4e95-fc"/>
Aug 15 19:08:35 user nova-compute[73188]:     </interface>
Aug 15 19:08:35 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:08:35 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/3d713d03-3e60-4dec-a295-a4652ac21842/console.log" append="off"/>
Aug 15 19:08:35 user nova-compute[73188]:     </serial>
Aug 15 19:08:35 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:08:35 user nova-compute[73188]:     <video>
Aug 15 19:08:35 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:08:35 user nova-compute[73188]:     </video>
Aug 15 19:08:35 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:08:35 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:08:35 user nova-compute[73188]:     </rng>
Aug 15 19:08:35 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:08:35 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:08:35 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:08:35 user nova-compute[73188]:     </memballoon>
Aug 15 19:08:35 user nova-compute[73188]:   </devices>
Aug 15 19:08:35 user nova-compute[73188]: </domain>
Aug 15 19:08:35 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1431736966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1431736966',id=13,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ab4e1cccd434f6c83f2f9e4687d274e',ramdisk_id='',reservation_id='r-kff5lb5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:08:16Z,user_data=None,user_id='bad952eceaec400396fd0a28c438c761',uuid=3d713d03-3e60-4dec-a295-a4652ac21842,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "address": "fa:16:3e:b4:8c:fd", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8c4e95-fc", "ovs_interfaceid": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converting VIF {"id": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "address": "fa:16:3e:b4:8c:fd", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8c4e95-fc", "ovs_interfaceid": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:8c:fd,bridge_name='br-int',has_traffic_filtering=True,id=3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8c4e95-fc') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG os_vif [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:8c:fd,bridge_name='br-int',has_traffic_filtering=True,id=3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8c4e95-fc') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a8c4e95-fc, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a8c4e95-fc, col_values=(('external_ids', {'iface-id': '3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:8c:fd', 'vm-uuid': '3d713d03-3e60-4dec-a295-a4652ac21842'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:35 user nova-compute[73188]: INFO os_vif [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:8c:fd,bridge_name='br-int',has_traffic_filtering=True,id=3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8c4e95-fc')
Aug 15 19:08:35 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] No VIF found with MAC fa:16:3e:b4:8c:fd, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:08:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:36 user nova-compute[73188]: DEBUG nova.compute.manager [req-ff069968-1151-48a5-8318-6ea1d79ee725 req-0b4582d0-c75d-4ce5-bd3f-e0e75594c741 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received event network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ff069968-1151-48a5-8318-6ea1d79ee725 req-0b4582d0-c75d-4ce5-bd3f-e0e75594c741 service nova] Acquiring lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ff069968-1151-48a5-8318-6ea1d79ee725 req-0b4582d0-c75d-4ce5-bd3f-e0e75594c741 service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ff069968-1151-48a5-8318-6ea1d79ee725 req-0b4582d0-c75d-4ce5-bd3f-e0e75594c741 service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:36 user nova-compute[73188]: DEBUG nova.compute.manager [req-ff069968-1151-48a5-8318-6ea1d79ee725 req-0b4582d0-c75d-4ce5-bd3f-e0e75594c741 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] No waiting events found dispatching network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:36 user nova-compute[73188]: WARNING nova.compute.manager [req-ff069968-1151-48a5-8318-6ea1d79ee725 req-0b4582d0-c75d-4ce5-bd3f-e0e75594c741 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received unexpected event network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d for instance with vm_state building and task_state spawning.
Aug 15 19:08:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:38 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126518.8980777, 3d713d03-3e60-4dec-a295-a4652ac21842 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:08:38 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] VM Resumed (Lifecycle Event)
Aug 15 19:08:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-d626b1dd-8840-4766-8f67-b3e1460e3fc6 req-901a565d-5e2c-40f2-bc73-86c8f58a47ce service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received event network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d626b1dd-8840-4766-8f67-b3e1460e3fc6 req-901a565d-5e2c-40f2-bc73-86c8f58a47ce service nova] Acquiring lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d626b1dd-8840-4766-8f67-b3e1460e3fc6 req-901a565d-5e2c-40f2-bc73-86c8f58a47ce service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d626b1dd-8840-4766-8f67-b3e1460e3fc6 req-901a565d-5e2c-40f2-bc73-86c8f58a47ce service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-d626b1dd-8840-4766-8f67-b3e1460e3fc6 req-901a565d-5e2c-40f2-bc73-86c8f58a47ce service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] No waiting events found dispatching network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:38 user nova-compute[73188]: WARNING nova.compute.manager [req-d626b1dd-8840-4766-8f67-b3e1460e3fc6 req-901a565d-5e2c-40f2-bc73-86c8f58a47ce service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received unexpected event network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d for instance with vm_state building and task_state spawning.
Aug 15 19:08:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:08:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:08:38 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Instance spawned successfully.
Aug 15 19:08:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:08:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:08:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:08:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:38 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:08:38 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126518.9012618, 3d713d03-3e60-4dec-a295-a4652ac21842 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:08:38 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] VM Started (Lifecycle Event)
Aug 15 19:08:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:08:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:08:38 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:08:39 user nova-compute[73188]: INFO nova.compute.manager [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Took 5.20 seconds to spawn the instance on the hypervisor.
Aug 15 19:08:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:08:39 user nova-compute[73188]: INFO nova.compute.manager [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Took 23.71 seconds to build instance.
Aug 15 19:08:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7f37a016-863c-40e8-ab68-b867c4656a77 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "3d713d03-3e60-4dec-a295-a4652ac21842" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.839s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:08:45 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Creating image(s)
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Did not create local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Ensure instance console log exists: /opt/stack/data/nova/instances/fd74b385-fcfa-4a38-b869-0f5a8328188c/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Start _get_guest_xml network_info=[{"id": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "address": "fa:16:3e:f2:d4:61", "network": {"id": "b9a20327-d2f1-4377-943b-0d2cc3a7dbd9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1246109159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1509fdfe31e4f26baac3a8be4b8d894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4790711-6b", "ovs_interfaceid": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwoJimEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fd74b385-fcfa-4a38-b869-0f5a8328188c', 'attached_at': '', 'detached_at': '', 'volume_id': '5f013040-56d6-4ad2-aa09-4346f46f544b', 'serial': '5f013040-56d6-4ad2-aa09-4346f46f544b'}, 'attachment_id': '7fef8839-49c3-4a35-932d-420cf214a2a0', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:08:45 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 19:08:45 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.objects.instance [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lazy-loading 'vcpu_model' on Instance uuid fd74b385-fcfa-4a38-b869-0f5a8328188c {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwoJimEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:08:45 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 19:08:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:08:45 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 19:08:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:08:45 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cd4ca0-a22c-45a6-a05b-22be21a40023]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:08:45 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ff57e1b-97d0-41a4-8bb5-c4d66c4794ce req-3ee17d1e-ae24-44e4-8c5a-f7751de77d12 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-changed-f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ff57e1b-97d0-41a4-8bb5-c4d66c4794ce req-3ee17d1e-ae24-44e4-8c5a-f7751de77d12 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Refreshing instance network info cache due to event network-changed-f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ff57e1b-97d0-41a4-8bb5-c4d66c4794ce req-3ee17d1e-ae24-44e4-8c5a-f7751de77d12 service nova] Acquiring lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ff57e1b-97d0-41a4-8bb5-c4d66c4794ce req-3ee17d1e-ae24-44e4-8c5a-f7751de77d12 service nova] Acquired lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.network.neutron [req-2ff57e1b-97d0-41a4-8bb5-c4d66c4794ce req-3ee17d1e-ae24-44e4-8c5a-f7751de77d12 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Refreshing network info cache for port f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[438cbb7a-1df0-4dd5-9124-ef50c523471b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b] added
Aug 15 19:08:45 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[341bbc7e-46ac-4c4a-baf6-f82b2671372e]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8f8e7b-467b-4603-a9f7-4a5a62e20006]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lwoJimEr {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lwoJimEr" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[988a95e2-ee4e-4bfe-ac21-b53e43358c7e]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lwoJimEr'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c73105-801a-4394-9e81-8789743027e5]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddc0014-0780-453c-b1f8-cc8a1206c7c5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:45 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:45 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac3c7d4-bf38-4efd-8cff-684c66843273]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b, portal: 172.16.0.220,3260]
Aug 15 19:08:45 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b, portal: 172.16.0.220,3260] successful.
Aug 15 19:08:45 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[516bc4ec-43c4-4fda-b2f8-a9a42936cb5a]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0debf5-229f-46ad-a255-90dd9e9b8a1e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:45 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:45 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:45 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] HCTL ('41', '-', '-', 0) found on session 16 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.101s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e17efb-25ea-4933-9dcd-1f11f9ca7bee]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Searching for a device in session 16 and hctl ['41', '*', '*', 0] yield: None {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.network.neutron [req-2ff57e1b-97d0-41a4-8bb5-c4d66c4794ce req-3ee17d1e-ae24-44e4-8c5a-f7751de77d12 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Updated VIF entry in instance network info cache for port f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:08:45 user nova-compute[73188]: DEBUG nova.network.neutron [req-2ff57e1b-97d0-41a4-8bb5-c4d66c4794ce req-3ee17d1e-ae24-44e4-8c5a-f7751de77d12 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Updating instance_info_cache with network_info: [{"id": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "address": "fa:16:3e:81:58:43", "network": {"id": "788628d4-c380-4e07-8d19-602530f78430", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1614362335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af6d04-8c", "ovs_interfaceid": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "address": "fa:16:3e:8a:45:a9", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab59fd7-0d", "ovs_interfaceid": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "00607676-9218-41f8-945f-8c4ed6834882", "address": "fa:16:3e:51:84:98", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00607676-92", "ovs_interfaceid": "00607676-9218-41f8-945f-8c4ed6834882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6bdc6fd6-8a71-4118-b8ed-164cc4315200", "address": "fa:16:3e:f3:e1:e7", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bdc6fd6-8a", "ovs_interfaceid": "6bdc6fd6-8a71-4118-b8ed-164cc4315200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "address": "fa:16:3e:38:cd:12", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cab9f9c-aa", "ovs_interfaceid": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "address": "fa:16:3e:72:b0:39", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f2e9d4-a1", "ovs_interfaceid": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "address": "fa:16:3e:a3:bd:93", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc8c62-57", "ovs_interfaceid": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ff57e1b-97d0-41a4-8bb5-c4d66c4794ce req-3ee17d1e-ae24-44e4-8c5a-f7751de77d12 service nova] Releasing lock "refresh_cache-03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Searching for a device in session 16 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwoJimEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.485s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] <== connect_volume: return (1487ms) {'type': 'block', 'scsi_wwn': '23161346437393466', 'path': '/dev/sdj'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161346437393466', 'path': '/dev/sdj'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T19:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-177848102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-465202991',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaBGa9KkwqWE1Q78AJMY7JlCjjnEVbtGOA19dY6uOf/g7Nc83Gf5QTFxXyhKxitOoCVD+9s7ju99GRuHp8fE8zuC/kBIVt9HsyWnGOgpWJZiCHV3u4bydMPINjm7GJs7w==',key_name='tempest-keypair-1090329827',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:06:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f1509fdfe31e4f26baac3a8be4b8d894',ramdisk_id='',reservation_id='r-fj96x5lg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-893119363',owner_user_name='tempest-ServerActionsV293TestJSON-893119363-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:08:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f94daba64eb347959248376b01bce161',uuid=fd74b385-fcfa-4a38-b869-0f5a8328188c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "address": "fa:16:3e:f2:d4:61", "network": {"id": "b9a20327-d2f1-4377-943b-0d2cc3a7dbd9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1246109159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1509fdfe31e4f26baac3a8be4b8d894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4790711-6b", "ovs_interfaceid": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Converting VIF {"id": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "address": "fa:16:3e:f2:d4:61", "network": {"id": "b9a20327-d2f1-4377-943b-0d2cc3a7dbd9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1246109159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1509fdfe31e4f26baac3a8be4b8d894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4790711-6b", "ovs_interfaceid": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:d4:61,bridge_name='br-int',has_traffic_filtering=True,id=e4790711-6bf9-4e86-bacd-c9e822edc6a9,network=Network(b9a20327-d2f1-4377-943b-0d2cc3a7dbd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4790711-6b') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:08:46 user nova-compute[73188]:   <uuid>fd74b385-fcfa-4a38-b869-0f5a8328188c</uuid>
Aug 15 19:08:46 user nova-compute[73188]:   <name>instance-00000009</name>
Aug 15 19:08:46 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:08:46 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:08:46 user nova-compute[73188]:   <metadata>
Aug 15 19:08:46 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:08:46 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:08:46 user nova-compute[73188]:       <nova:name>tempest-ServerActionsV293TestJSON-server-177848102</nova:name>
Aug 15 19:08:46 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:08:45</nova:creationTime>
Aug 15 19:08:46 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:08:46 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:08:46 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:08:46 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:08:46 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:08:46 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:08:46 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:08:46 user nova-compute[73188]:       <nova:owner>
Aug 15 19:08:46 user nova-compute[73188]:         <nova:user uuid="f94daba64eb347959248376b01bce161">tempest-ServerActionsV293TestJSON-893119363-project-member</nova:user>
Aug 15 19:08:46 user nova-compute[73188]:         <nova:project uuid="f1509fdfe31e4f26baac3a8be4b8d894">tempest-ServerActionsV293TestJSON-893119363</nova:project>
Aug 15 19:08:46 user nova-compute[73188]:       </nova:owner>
Aug 15 19:08:46 user nova-compute[73188]:       <nova:ports>
Aug 15 19:08:46 user nova-compute[73188]:         <nova:port uuid="e4790711-6bf9-4e86-bacd-c9e822edc6a9">
Aug 15 19:08:46 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 19:08:46 user nova-compute[73188]:         </nova:port>
Aug 15 19:08:46 user nova-compute[73188]:       </nova:ports>
Aug 15 19:08:46 user nova-compute[73188]:     </nova:instance>
Aug 15 19:08:46 user nova-compute[73188]:   </metadata>
Aug 15 19:08:46 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:08:46 user nova-compute[73188]:     <system>
Aug 15 19:08:46 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:08:46 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:08:46 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:08:46 user nova-compute[73188]:       <entry name="serial">fd74b385-fcfa-4a38-b869-0f5a8328188c</entry>
Aug 15 19:08:46 user nova-compute[73188]:       <entry name="uuid">fd74b385-fcfa-4a38-b869-0f5a8328188c</entry>
Aug 15 19:08:46 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:08:46 user nova-compute[73188]:     </system>
Aug 15 19:08:46 user nova-compute[73188]:   </sysinfo>
Aug 15 19:08:46 user nova-compute[73188]:   <os>
Aug 15 19:08:46 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:08:46 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:08:46 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:08:46 user nova-compute[73188]:   </os>
Aug 15 19:08:46 user nova-compute[73188]:   <features>
Aug 15 19:08:46 user nova-compute[73188]:     <acpi/>
Aug 15 19:08:46 user nova-compute[73188]:     <apic/>
Aug 15 19:08:46 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:08:46 user nova-compute[73188]:   </features>
Aug 15 19:08:46 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:08:46 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:08:46 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:08:46 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:08:46 user nova-compute[73188]:   </clock>
Aug 15 19:08:46 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:08:46 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:08:46 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:08:46 user nova-compute[73188]:   </cpu>
Aug 15 19:08:46 user nova-compute[73188]:   <devices>
Aug 15 19:08:46 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:08:46 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:08:46 user nova-compute[73188]:       <source dev="/dev/sdj"/>
Aug 15 19:08:46 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:08:46 user nova-compute[73188]:       <serial>5f013040-56d6-4ad2-aa09-4346f46f544b</serial>
Aug 15 19:08:46 user nova-compute[73188]:     </disk>
Aug 15 19:08:46 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:08:46 user nova-compute[73188]:       <mac address="fa:16:3e:f2:d4:61"/>
Aug 15 19:08:46 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:08:46 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:08:46 user nova-compute[73188]:       <target dev="tape4790711-6b"/>
Aug 15 19:08:46 user nova-compute[73188]:     </interface>
Aug 15 19:08:46 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:08:46 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/fd74b385-fcfa-4a38-b869-0f5a8328188c/console.log" append="off"/>
Aug 15 19:08:46 user nova-compute[73188]:     </serial>
Aug 15 19:08:46 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:08:46 user nova-compute[73188]:     <video>
Aug 15 19:08:46 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:08:46 user nova-compute[73188]:     </video>
Aug 15 19:08:46 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:08:46 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:08:46 user nova-compute[73188]:     </rng>
Aug 15 19:08:46 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:08:46 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:08:46 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:08:46 user nova-compute[73188]:     </memballoon>
Aug 15 19:08:46 user nova-compute[73188]:   </devices>
Aug 15 19:08:46 user nova-compute[73188]: </domain>
Aug 15 19:08:46 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T19:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-177848102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-465202991',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaBGa9KkwqWE1Q78AJMY7JlCjjnEVbtGOA19dY6uOf/g7Nc83Gf5QTFxXyhKxitOoCVD+9s7ju99GRuHp8fE8zuC/kBIVt9HsyWnGOgpWJZiCHV3u4bydMPINjm7GJs7w==',key_name='tempest-keypair-1090329827',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:06:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f1509fdfe31e4f26baac3a8be4b8d894',ramdisk_id='',reservation_id='r-fj96x5lg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-893119363',owner_user_name='tempest-ServerActionsV293TestJSON-893119363-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:08:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f94daba64eb347959248376b01bce161',uuid=fd74b385-fcfa-4a38-b869-0f5a8328188c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "address": "fa:16:3e:f2:d4:61", "network": {"id": "b9a20327-d2f1-4377-943b-0d2cc3a7dbd9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1246109159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1509fdfe31e4f26baac3a8be4b8d894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4790711-6b", "ovs_interfaceid": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Converting VIF {"id": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "address": "fa:16:3e:f2:d4:61", "network": {"id": "b9a20327-d2f1-4377-943b-0d2cc3a7dbd9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1246109159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1509fdfe31e4f26baac3a8be4b8d894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4790711-6b", "ovs_interfaceid": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:d4:61,bridge_name='br-int',has_traffic_filtering=True,id=e4790711-6bf9-4e86-bacd-c9e822edc6a9,network=Network(b9a20327-d2f1-4377-943b-0d2cc3a7dbd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4790711-6b') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG os_vif [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:d4:61,bridge_name='br-int',has_traffic_filtering=True,id=e4790711-6bf9-4e86-bacd-c9e822edc6a9,network=Network(b9a20327-d2f1-4377-943b-0d2cc3a7dbd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4790711-6b') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4790711-6b, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4790711-6b, col_values=(('external_ids', {'iface-id': 'e4790711-6bf9-4e86-bacd-c9e822edc6a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:d4:61', 'vm-uuid': 'fd74b385-fcfa-4a38-b869-0f5a8328188c'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:46 user nova-compute[73188]: INFO os_vif [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:d4:61,bridge_name='br-int',has_traffic_filtering=True,id=e4790711-6bf9-4e86-bacd-c9e822edc6a9,network=Network(b9a20327-d2f1-4377-943b-0d2cc3a7dbd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4790711-6b')
Aug 15 19:08:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:08:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] No VIF found with MAC fa:16:3e:f2:d4:61, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:08:47 user nova-compute[73188]: DEBUG nova.compute.manager [req-d959f4f1-d35a-4964-9669-5718e11dfe98 req-859fcdec-6f2e-45a5-a533-1fabecf9f476 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-changed-76516ed7-f500-4002-9ea5-14cb411ef40e {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:47 user nova-compute[73188]: DEBUG nova.compute.manager [req-d959f4f1-d35a-4964-9669-5718e11dfe98 req-859fcdec-6f2e-45a5-a533-1fabecf9f476 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Refreshing instance network info cache due to event network-changed-76516ed7-f500-4002-9ea5-14cb411ef40e. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:08:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d959f4f1-d35a-4964-9669-5718e11dfe98 req-859fcdec-6f2e-45a5-a533-1fabecf9f476 service nova] Acquiring lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:08:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d959f4f1-d35a-4964-9669-5718e11dfe98 req-859fcdec-6f2e-45a5-a533-1fabecf9f476 service nova] Acquired lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:08:47 user nova-compute[73188]: DEBUG nova.network.neutron [req-d959f4f1-d35a-4964-9669-5718e11dfe98 req-859fcdec-6f2e-45a5-a533-1fabecf9f476 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Refreshing network info cache for port 76516ed7-f500-4002-9ea5-14cb411ef40e {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:08:47 user nova-compute[73188]: DEBUG nova.network.neutron [req-d959f4f1-d35a-4964-9669-5718e11dfe98 req-859fcdec-6f2e-45a5-a533-1fabecf9f476 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Updated VIF entry in instance network info cache for port 76516ed7-f500-4002-9ea5-14cb411ef40e. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:08:47 user nova-compute[73188]: DEBUG nova.network.neutron [req-d959f4f1-d35a-4964-9669-5718e11dfe98 req-859fcdec-6f2e-45a5-a533-1fabecf9f476 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Updating instance_info_cache with network_info: [{"id": "76516ed7-f500-4002-9ea5-14cb411ef40e", "address": "fa:16:3e:98:81:f4", "network": {"id": "c2d692fb-b4f7-4e5f-bc90-2de58035637b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-476302846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516ed7-f5", "ovs_interfaceid": "76516ed7-f500-4002-9ea5-14cb411ef40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c169fd9d-21c0-4104-af83-51ee360612b5", "address": "fa:16:3e:5b:5c:7e", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc169fd9d-21", "ovs_interfaceid": "c169fd9d-21c0-4104-af83-51ee360612b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "address": "fa:16:3e:05:3c:92", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a3682d0-74", "ovs_interfaceid": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "59186294-47fd-4da4-8961-419b39b16970", "address": "fa:16:3e:31:38:e2", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59186294-47", "ovs_interfaceid": "59186294-47fd-4da4-8961-419b39b16970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b570288f-2a5e-422e-a42f-20acf7269946", "address": "fa:16:3e:02:ca:a7", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb570288f-2a", "ovs_interfaceid": "b570288f-2a5e-422e-a42f-20acf7269946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "address": "fa:16:3e:a4:22:08", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6171fcf-6d", "ovs_interfaceid": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "address": "fa:16:3e:84:8d:cb", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53f593-c9", "ovs_interfaceid": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:08:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d959f4f1-d35a-4964-9669-5718e11dfe98 req-859fcdec-6f2e-45a5-a533-1fabecf9f476 service nova] Releasing lock "refresh_cache-deb3ccb4-136f-4873-959d-edecdc436291" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:08:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:47 user nova-compute[73188]: INFO nova.compute.manager [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Terminating instance
Aug 15 19:08:47 user nova-compute[73188]: DEBUG nova.compute.manager [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:08:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG nova.compute.manager [req-365bec5c-6f56-4332-b9a1-5324795fc075 req-d7f82cfc-2569-4250-bc8d-dcf6934126fc service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-unplugged-dab59fd7-0d18-4dd9-88f2-27b156f957c4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-365bec5c-6f56-4332-b9a1-5324795fc075 req-d7f82cfc-2569-4250-bc8d-dcf6934126fc service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-365bec5c-6f56-4332-b9a1-5324795fc075 req-d7f82cfc-2569-4250-bc8d-dcf6934126fc service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-365bec5c-6f56-4332-b9a1-5324795fc075 req-d7f82cfc-2569-4250-bc8d-dcf6934126fc service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG nova.compute.manager [req-365bec5c-6f56-4332-b9a1-5324795fc075 req-d7f82cfc-2569-4250-bc8d-dcf6934126fc service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-unplugged-dab59fd7-0d18-4dd9-88f2-27b156f957c4 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG nova.compute.manager [req-365bec5c-6f56-4332-b9a1-5324795fc075 req-d7f82cfc-2569-4250-bc8d-dcf6934126fc service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-unplugged-dab59fd7-0d18-4dd9-88f2-27b156f957c4 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG nova.compute.manager [req-099219b6-a489-490e-994e-ccc5052f91a4 req-46d9b698-8960-4549-b4fe-2205d2fa6669 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-unplugged-6bdc6fd6-8a71-4118-b8ed-164cc4315200 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-099219b6-a489-490e-994e-ccc5052f91a4 req-46d9b698-8960-4549-b4fe-2205d2fa6669 service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-099219b6-a489-490e-994e-ccc5052f91a4 req-46d9b698-8960-4549-b4fe-2205d2fa6669 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-099219b6-a489-490e-994e-ccc5052f91a4 req-46d9b698-8960-4549-b4fe-2205d2fa6669 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG nova.compute.manager [req-099219b6-a489-490e-994e-ccc5052f91a4 req-46d9b698-8960-4549-b4fe-2205d2fa6669 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-unplugged-6bdc6fd6-8a71-4118-b8ed-164cc4315200 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG nova.compute.manager [req-099219b6-a489-490e-994e-ccc5052f91a4 req-46d9b698-8960-4549-b4fe-2205d2fa6669 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-unplugged-6bdc6fd6-8a71-4118-b8ed-164cc4315200 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "deb3ccb4-136f-4873-959d-edecdc436291" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:48 user nova-compute[73188]: INFO nova.compute.manager [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Terminating instance
Aug 15 19:08:48 user nova-compute[73188]: DEBUG nova.compute.manager [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG nova.compute.manager [req-31f8dbcb-0838-465b-8e75-1147282688ab req-79e20e1b-03c2-402e-868a-0f4f8baefecc service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-unplugged-f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-31f8dbcb-0838-465b-8e75-1147282688ab req-79e20e1b-03c2-402e-868a-0f4f8baefecc service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-31f8dbcb-0838-465b-8e75-1147282688ab req-79e20e1b-03c2-402e-868a-0f4f8baefecc service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-31f8dbcb-0838-465b-8e75-1147282688ab req-79e20e1b-03c2-402e-868a-0f4f8baefecc service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG nova.compute.manager [req-31f8dbcb-0838-465b-8e75-1147282688ab req-79e20e1b-03c2-402e-868a-0f4f8baefecc service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-unplugged-f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG nova.compute.manager [req-31f8dbcb-0838-465b-8e75-1147282688ab req-79e20e1b-03c2-402e-868a-0f4f8baefecc service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-unplugged-f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG nova.compute.manager [req-31f8dbcb-0838-465b-8e75-1147282688ab req-79e20e1b-03c2-402e-868a-0f4f8baefecc service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-plugged-f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-31f8dbcb-0838-465b-8e75-1147282688ab req-79e20e1b-03c2-402e-868a-0f4f8baefecc service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-31f8dbcb-0838-465b-8e75-1147282688ab req-79e20e1b-03c2-402e-868a-0f4f8baefecc service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-31f8dbcb-0838-465b-8e75-1147282688ab req-79e20e1b-03c2-402e-868a-0f4f8baefecc service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG nova.compute.manager [req-31f8dbcb-0838-465b-8e75-1147282688ab req-79e20e1b-03c2-402e-868a-0f4f8baefecc service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-plugged-f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:49 user nova-compute[73188]: WARNING nova.compute.manager [req-31f8dbcb-0838-465b-8e75-1147282688ab req-79e20e1b-03c2-402e-868a-0f4f8baefecc service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received unexpected event network-vif-plugged-f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4 for instance with vm_state active and task_state deleting.
Aug 15 19:08:49 user nova-compute[73188]: DEBUG nova.compute.manager [req-31f8dbcb-0838-465b-8e75-1147282688ab req-79e20e1b-03c2-402e-868a-0f4f8baefecc service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Received event network-vif-plugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-31f8dbcb-0838-465b-8e75-1147282688ab req-79e20e1b-03c2-402e-868a-0f4f8baefecc service nova] Acquiring lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-31f8dbcb-0838-465b-8e75-1147282688ab req-79e20e1b-03c2-402e-868a-0f4f8baefecc service nova] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-31f8dbcb-0838-465b-8e75-1147282688ab req-79e20e1b-03c2-402e-868a-0f4f8baefecc service nova] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG nova.compute.manager [req-31f8dbcb-0838-465b-8e75-1147282688ab req-79e20e1b-03c2-402e-868a-0f4f8baefecc service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] No waiting events found dispatching network-vif-plugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:49 user nova-compute[73188]: WARNING nova.compute.manager [req-31f8dbcb-0838-465b-8e75-1147282688ab req-79e20e1b-03c2-402e-868a-0f4f8baefecc service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Received unexpected event network-vif-plugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 19:08:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:49 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Instance destroyed successfully.
Aug 15 19:08:49 user nova-compute[73188]: DEBUG nova.objects.instance [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lazy-loading 'resources' on Instance uuid 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114388087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114388087',id=10,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1idcKZ1xBbWg0gYfVVvOJ4qKeCJ/9fHvAZz/gBB7d+sI7S/Wu2WW23N0v1n+rEzVqwKc3OTOLXDu8ZE2aPLsO4i+R6405lRbPdsNEMKO6raHFlQEQsmUo+TGOLSa69uQ==',key_name='tempest-keypair-286492792',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:07:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0915a1c5e7e14afe8831b426b42d0d35',ramdisk_id='',reservation_id='r-ak0gitqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2132869133',owner_user_name='tempest-TaggedBootDevicesTest-2132869133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e174da762209454a8cab943a1bc8e010',uuid=03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "address": "fa:16:3e:81:58:43", "network": {"id": "788628d4-c380-4e07-8d19-602530f78430", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1614362335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af6d04-8c", "ovs_interfaceid": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converting VIF {"id": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "address": "fa:16:3e:81:58:43", "network": {"id": "788628d4-c380-4e07-8d19-602530f78430", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1614362335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af6d04-8c", "ovs_interfaceid": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:58:43,bridge_name='br-int',has_traffic_filtering=True,id=f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4,network=Network(788628d4-c380-4e07-8d19-602530f78430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3af6d04-8c') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG os_vif [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:58:43,bridge_name='br-int',has_traffic_filtering=True,id=f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4,network=Network(788628d4-c380-4e07-8d19-602530f78430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3af6d04-8c') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3af6d04-8c, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:50 user nova-compute[73188]: INFO os_vif [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:58:43,bridge_name='br-int',has_traffic_filtering=True,id=f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4,network=Network(788628d4-c380-4e07-8d19-602530f78430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3af6d04-8c')
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114388087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114388087',id=10,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1idcKZ1xBbWg0gYfVVvOJ4qKeCJ/9fHvAZz/gBB7d+sI7S/Wu2WW23N0v1n+rEzVqwKc3OTOLXDu8ZE2aPLsO4i+R6405lRbPdsNEMKO6raHFlQEQsmUo+TGOLSa69uQ==',key_name='tempest-keypair-286492792',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:07:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0915a1c5e7e14afe8831b426b42d0d35',ramdisk_id='',reservation_id='r-ak0gitqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2132869133',owner_user_name='tempest-TaggedBootDevicesTest-2132869133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e174da762209454a8cab943a1bc8e010',uuid=03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "address": "fa:16:3e:8a:45:a9", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab59fd7-0d", "ovs_interfaceid": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converting VIF {"id": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "address": "fa:16:3e:8a:45:a9", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab59fd7-0d", "ovs_interfaceid": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:45:a9,bridge_name='br-int',has_traffic_filtering=True,id=dab59fd7-0d18-4dd9-88f2-27b156f957c4,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdab59fd7-0d') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG os_vif [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:45:a9,bridge_name='br-int',has_traffic_filtering=True,id=dab59fd7-0d18-4dd9-88f2-27b156f957c4,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdab59fd7-0d') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdab59fd7-0d, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-ef632f33-78b3-46d4-ba14-87a2d0f271d0 req-fd507054-d011-47a8-9c8b-2025a04bad9e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-plugged-dab59fd7-0d18-4dd9-88f2-27b156f957c4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ef632f33-78b3-46d4-ba14-87a2d0f271d0 req-fd507054-d011-47a8-9c8b-2025a04bad9e service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ef632f33-78b3-46d4-ba14-87a2d0f271d0 req-fd507054-d011-47a8-9c8b-2025a04bad9e service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ef632f33-78b3-46d4-ba14-87a2d0f271d0 req-fd507054-d011-47a8-9c8b-2025a04bad9e service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-ef632f33-78b3-46d4-ba14-87a2d0f271d0 req-fd507054-d011-47a8-9c8b-2025a04bad9e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-plugged-dab59fd7-0d18-4dd9-88f2-27b156f957c4 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:50 user nova-compute[73188]: WARNING nova.compute.manager [req-ef632f33-78b3-46d4-ba14-87a2d0f271d0 req-fd507054-d011-47a8-9c8b-2025a04bad9e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received unexpected event network-vif-plugged-dab59fd7-0d18-4dd9-88f2-27b156f957c4 for instance with vm_state active and task_state deleting.
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-ef632f33-78b3-46d4-ba14-87a2d0f271d0 req-fd507054-d011-47a8-9c8b-2025a04bad9e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-unplugged-95cc8c62-5790-417a-bc3f-ebf4028f99e3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ef632f33-78b3-46d4-ba14-87a2d0f271d0 req-fd507054-d011-47a8-9c8b-2025a04bad9e service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ef632f33-78b3-46d4-ba14-87a2d0f271d0 req-fd507054-d011-47a8-9c8b-2025a04bad9e service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ef632f33-78b3-46d4-ba14-87a2d0f271d0 req-fd507054-d011-47a8-9c8b-2025a04bad9e service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-ef632f33-78b3-46d4-ba14-87a2d0f271d0 req-fd507054-d011-47a8-9c8b-2025a04bad9e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-unplugged-95cc8c62-5790-417a-bc3f-ebf4028f99e3 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-ef632f33-78b3-46d4-ba14-87a2d0f271d0 req-fd507054-d011-47a8-9c8b-2025a04bad9e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-unplugged-95cc8c62-5790-417a-bc3f-ebf4028f99e3 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-ef632f33-78b3-46d4-ba14-87a2d0f271d0 req-fd507054-d011-47a8-9c8b-2025a04bad9e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-plugged-95cc8c62-5790-417a-bc3f-ebf4028f99e3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ef632f33-78b3-46d4-ba14-87a2d0f271d0 req-fd507054-d011-47a8-9c8b-2025a04bad9e service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ef632f33-78b3-46d4-ba14-87a2d0f271d0 req-fd507054-d011-47a8-9c8b-2025a04bad9e service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ef632f33-78b3-46d4-ba14-87a2d0f271d0 req-fd507054-d011-47a8-9c8b-2025a04bad9e service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-ef632f33-78b3-46d4-ba14-87a2d0f271d0 req-fd507054-d011-47a8-9c8b-2025a04bad9e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-plugged-95cc8c62-5790-417a-bc3f-ebf4028f99e3 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:50 user nova-compute[73188]: WARNING nova.compute.manager [req-ef632f33-78b3-46d4-ba14-87a2d0f271d0 req-fd507054-d011-47a8-9c8b-2025a04bad9e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received unexpected event network-vif-plugged-95cc8c62-5790-417a-bc3f-ebf4028f99e3 for instance with vm_state active and task_state deleting.
Aug 15 19:08:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:08:50 user nova-compute[73188]: INFO os_vif [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:45:a9,bridge_name='br-int',has_traffic_filtering=True,id=dab59fd7-0d18-4dd9-88f2-27b156f957c4,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdab59fd7-0d')
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114388087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114388087',id=10,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1idcKZ1xBbWg0gYfVVvOJ4qKeCJ/9fHvAZz/gBB7d+sI7S/Wu2WW23N0v1n+rEzVqwKc3OTOLXDu8ZE2aPLsO4i+R6405lRbPdsNEMKO6raHFlQEQsmUo+TGOLSa69uQ==',key_name='tempest-keypair-286492792',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:07:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0915a1c5e7e14afe8831b426b42d0d35',ramdisk_id='',reservation_id='r-ak0gitqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2132869133',owner_user_name='tempest-TaggedBootDevicesTest-2132869133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e174da762209454a8cab943a1bc8e010',uuid=03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00607676-9218-41f8-945f-8c4ed6834882", "address": "fa:16:3e:51:84:98", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00607676-92", "ovs_interfaceid": "00607676-9218-41f8-945f-8c4ed6834882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converting VIF {"id": "00607676-9218-41f8-945f-8c4ed6834882", "address": "fa:16:3e:51:84:98", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00607676-92", "ovs_interfaceid": "00607676-9218-41f8-945f-8c4ed6834882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:84:98,bridge_name='br-int',has_traffic_filtering=True,id=00607676-9218-41f8-945f-8c4ed6834882,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap00607676-92') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG os_vif [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:84:98,bridge_name='br-int',has_traffic_filtering=True,id=00607676-9218-41f8-945f-8c4ed6834882,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap00607676-92') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126530.6375666, fd74b385-fcfa-4a38-b869-0f5a8328188c => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:08:50 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] VM Resumed (Lifecycle Event)
Aug 15 19:08:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00607676-92, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:08:50 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Instance spawned successfully.
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-plugged-6bdc6fd6-8a71-4118-b8ed-164cc4315200 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-plugged-6bdc6fd6-8a71-4118-b8ed-164cc4315200 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:50 user nova-compute[73188]: WARNING nova.compute.manager [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received unexpected event network-vif-plugged-6bdc6fd6-8a71-4118-b8ed-164cc4315200 for instance with vm_state active and task_state deleting.
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-unplugged-38f2e9d4-a1e3-4d92-a45c-114c4dcb5920 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-unplugged-38f2e9d4-a1e3-4d92-a45c-114c4dcb5920 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-unplugged-38f2e9d4-a1e3-4d92-a45c-114c4dcb5920 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-plugged-38f2e9d4-a1e3-4d92-a45c-114c4dcb5920 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-plugged-38f2e9d4-a1e3-4d92-a45c-114c4dcb5920 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:50 user nova-compute[73188]: WARNING nova.compute.manager [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received unexpected event network-vif-plugged-38f2e9d4-a1e3-4d92-a45c-114c4dcb5920 for instance with vm_state active and task_state deleting.
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-unplugged-76516ed7-f500-4002-9ea5-14cb411ef40e {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-unplugged-76516ed7-f500-4002-9ea5-14cb411ef40e {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-85920a45-c3ee-4ba3-b50a-b0534cbb1bd9 req-4b715763-677a-47a3-a615-c6e5c087a94e service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-unplugged-76516ed7-f500-4002-9ea5-14cb411ef40e for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:08:50 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126530.6376855, fd74b385-fcfa-4a38-b869-0f5a8328188c => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:08:50 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] VM Started (Lifecycle Event)
Aug 15 19:08:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:08:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:08:50 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:08:51 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Instance destroyed successfully.
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.objects.instance [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lazy-loading 'resources' on Instance uuid deb3ccb4-136f-4873-959d-edecdc436291 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: INFO os_vif [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:84:98,bridge_name='br-int',has_traffic_filtering=True,id=00607676-9218-41f8-945f-8c4ed6834882,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap00607676-92')
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114388087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114388087',id=10,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1idcKZ1xBbWg0gYfVVvOJ4qKeCJ/9fHvAZz/gBB7d+sI7S/Wu2WW23N0v1n+rEzVqwKc3OTOLXDu8ZE2aPLsO4i+R6405lRbPdsNEMKO6raHFlQEQsmUo+TGOLSa69uQ==',key_name='tempest-keypair-286492792',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:07:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0915a1c5e7e14afe8831b426b42d0d35',ramdisk_id='',reservation_id='r-ak0gitqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2132869133',owner_user_name='tempest-TaggedBootDevicesTest-2132869133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e174da762209454a8cab943a1bc8e010',uuid=03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6bdc6fd6-8a71-4118-b8ed-164cc4315200", "address": "fa:16:3e:f3:e1:e7", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bdc6fd6-8a", "ovs_interfaceid": "6bdc6fd6-8a71-4118-b8ed-164cc4315200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converting VIF {"id": "6bdc6fd6-8a71-4118-b8ed-164cc4315200", "address": "fa:16:3e:f3:e1:e7", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bdc6fd6-8a", "ovs_interfaceid": "6bdc6fd6-8a71-4118-b8ed-164cc4315200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e1:e7,bridge_name='br-int',has_traffic_filtering=True,id=6bdc6fd6-8a71-4118-b8ed-164cc4315200,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bdc6fd6-8a') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG os_vif [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e1:e7,bridge_name='br-int',has_traffic_filtering=True,id=6bdc6fd6-8a71-4118-b8ed-164cc4315200,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bdc6fd6-8a') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614732338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614732338',id=11,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBDQbv5n4VEeAvnAJ6tL9DsIUI/WahvlehI4iRSJ5keiKnx9QoeH7H+4PhwiyV7+zTpaUX9W8mjhZGfCB80JLMGAaZwM+VSUf0vH7rrELMUW4OCdj0q5KkBtNzCwU0SAA==',key_name='tempest-keypair-890925727',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:07:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3df3ab2300ae46699d4d309268f83415',ramdisk_id='',reservation_id='r-7nkntget',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1842772812',owner_user_name='tempest-TaggedBootDevicesTest_v242-1842772812-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:07:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0d1232acc0d4041872c5ee40b4c826e',uuid=deb3ccb4-136f-4873-959d-edecdc436291,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76516ed7-f500-4002-9ea5-14cb411ef40e", "address": "fa:16:3e:98:81:f4", "network": {"id": "c2d692fb-b4f7-4e5f-bc90-2de58035637b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-476302846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516ed7-f5", "ovs_interfaceid": "76516ed7-f500-4002-9ea5-14cb411ef40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converting VIF {"id": "76516ed7-f500-4002-9ea5-14cb411ef40e", "address": "fa:16:3e:98:81:f4", "network": {"id": "c2d692fb-b4f7-4e5f-bc90-2de58035637b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-476302846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516ed7-f5", "ovs_interfaceid": "76516ed7-f500-4002-9ea5-14cb411ef40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:81:f4,bridge_name='br-int',has_traffic_filtering=True,id=76516ed7-f500-4002-9ea5-14cb411ef40e,network=Network(c2d692fb-b4f7-4e5f-bc90-2de58035637b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516ed7-f5') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG os_vif [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:81:f4,bridge_name='br-int',has_traffic_filtering=True,id=76516ed7-f500-4002-9ea5-14cb411ef40e,network=Network(c2d692fb-b4f7-4e5f-bc90-2de58035637b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516ed7-f5') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6bdc6fd6-8a, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.objects.instance [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73188) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7c0e30a9-b4ca-4121-b0d9-d0747047c43e tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.084s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76516ed7-f5, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:51 user nova-compute[73188]: INFO os_vif [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e1:e7,bridge_name='br-int',has_traffic_filtering=True,id=6bdc6fd6-8a71-4118-b8ed-164cc4315200,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bdc6fd6-8a')
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114388087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114388087',id=10,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1idcKZ1xBbWg0gYfVVvOJ4qKeCJ/9fHvAZz/gBB7d+sI7S/Wu2WW23N0v1n+rEzVqwKc3OTOLXDu8ZE2aPLsO4i+R6405lRbPdsNEMKO6raHFlQEQsmUo+TGOLSa69uQ==',key_name='tempest-keypair-286492792',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:07:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0915a1c5e7e14afe8831b426b42d0d35',ramdisk_id='',reservation_id='r-ak0gitqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2132869133',owner_user_name='tempest-TaggedBootDevicesTest-2132869133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e174da762209454a8cab943a1bc8e010',uuid=03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "address": "fa:16:3e:38:cd:12", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cab9f9c-aa", "ovs_interfaceid": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converting VIF {"id": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "address": "fa:16:3e:38:cd:12", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cab9f9c-aa", "ovs_interfaceid": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:cd:12,bridge_name='br-int',has_traffic_filtering=True,id=3cab9f9c-aa69-41e1-b2b1-1397b068fb0f,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cab9f9c-aa') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG os_vif [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:cd:12,bridge_name='br-int',has_traffic_filtering=True,id=3cab9f9c-aa69-41e1-b2b1-1397b068fb0f,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cab9f9c-aa') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Received event network-vif-plugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Acquiring lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] No waiting events found dispatching network-vif-plugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:51 user nova-compute[73188]: WARNING nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Received unexpected event network-vif-plugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 for instance with vm_state active and task_state None.
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-unplugged-00607676-9218-41f8-945f-8c4ed6834882 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-unplugged-00607676-9218-41f8-945f-8c4ed6834882 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-unplugged-00607676-9218-41f8-945f-8c4ed6834882 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-plugged-00607676-9218-41f8-945f-8c4ed6834882 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-plugged-00607676-9218-41f8-945f-8c4ed6834882 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:51 user nova-compute[73188]: WARNING nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received unexpected event network-vif-plugged-00607676-9218-41f8-945f-8c4ed6834882 for instance with vm_state active and task_state deleting.
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-unplugged-3cab9f9c-aa69-41e1-b2b1-1397b068fb0f {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-unplugged-3cab9f9c-aa69-41e1-b2b1-1397b068fb0f {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-unplugged-3cab9f9c-aa69-41e1-b2b1-1397b068fb0f for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-plugged-3cab9f9c-aa69-41e1-b2b1-1397b068fb0f {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Acquiring lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] No waiting events found dispatching network-vif-plugged-3cab9f9c-aa69-41e1-b2b1-1397b068fb0f {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:51 user nova-compute[73188]: WARNING nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received unexpected event network-vif-plugged-3cab9f9c-aa69-41e1-b2b1-1397b068fb0f for instance with vm_state active and task_state deleting.
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-unplugged-c169fd9d-21c0-4104-af83-51ee360612b5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-unplugged-c169fd9d-21c0-4104-af83-51ee360612b5 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-unplugged-c169fd9d-21c0-4104-af83-51ee360612b5 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-plugged-c169fd9d-21c0-4104-af83-51ee360612b5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-plugged-c169fd9d-21c0-4104-af83-51ee360612b5 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:51 user nova-compute[73188]: WARNING nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received unexpected event network-vif-plugged-c169fd9d-21c0-4104-af83-51ee360612b5 for instance with vm_state active and task_state deleting.
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-unplugged-b570288f-2a5e-422e-a42f-20acf7269946 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-unplugged-b570288f-2a5e-422e-a42f-20acf7269946 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-unplugged-b570288f-2a5e-422e-a42f-20acf7269946 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-plugged-b570288f-2a5e-422e-a42f-20acf7269946 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-plugged-b570288f-2a5e-422e-a42f-20acf7269946 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:51 user nova-compute[73188]: WARNING nova.compute.manager [req-f8a52773-a33e-4749-8a60-ef94f34b0093 req-9c4839d4-2ac4-4206-aefe-cfe86d835f50 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received unexpected event network-vif-plugged-b570288f-2a5e-422e-a42f-20acf7269946 for instance with vm_state active and task_state deleting.
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3cab9f9c-aa, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:51 user nova-compute[73188]: INFO os_vif [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:81:f4,bridge_name='br-int',has_traffic_filtering=True,id=76516ed7-f500-4002-9ea5-14cb411ef40e,network=Network(c2d692fb-b4f7-4e5f-bc90-2de58035637b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76516ed7-f5')
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614732338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614732338',id=11,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBDQbv5n4VEeAvnAJ6tL9DsIUI/WahvlehI4iRSJ5keiKnx9QoeH7H+4PhwiyV7+zTpaUX9W8mjhZGfCB80JLMGAaZwM+VSUf0vH7rrELMUW4OCdj0q5KkBtNzCwU0SAA==',key_name='tempest-keypair-890925727',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:07:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3df3ab2300ae46699d4d309268f83415',ramdisk_id='',reservation_id='r-7nkntget',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1842772812',owner_user_name='tempest-TaggedBootDevicesTest_v242-1842772812-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:07:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0d1232acc0d4041872c5ee40b4c826e',uuid=deb3ccb4-136f-4873-959d-edecdc436291,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c169fd9d-21c0-4104-af83-51ee360612b5", "address": "fa:16:3e:5b:5c:7e", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc169fd9d-21", "ovs_interfaceid": "c169fd9d-21c0-4104-af83-51ee360612b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converting VIF {"id": "c169fd9d-21c0-4104-af83-51ee360612b5", "address": "fa:16:3e:5b:5c:7e", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc169fd9d-21", "ovs_interfaceid": "c169fd9d-21c0-4104-af83-51ee360612b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:5c:7e,bridge_name='br-int',has_traffic_filtering=True,id=c169fd9d-21c0-4104-af83-51ee360612b5,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc169fd9d-21') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG os_vif [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:5c:7e,bridge_name='br-int',has_traffic_filtering=True,id=c169fd9d-21c0-4104-af83-51ee360612b5,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc169fd9d-21') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc169fd9d-21, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:08:51 user nova-compute[73188]: INFO os_vif [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:cd:12,bridge_name='br-int',has_traffic_filtering=True,id=3cab9f9c-aa69-41e1-b2b1-1397b068fb0f,network=Network(9d707cdf-8091-40f1-9199-725f57578667),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cab9f9c-aa')
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114388087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114388087',id=10,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1idcKZ1xBbWg0gYfVVvOJ4qKeCJ/9fHvAZz/gBB7d+sI7S/Wu2WW23N0v1n+rEzVqwKc3OTOLXDu8ZE2aPLsO4i+R6405lRbPdsNEMKO6raHFlQEQsmUo+TGOLSa69uQ==',key_name='tempest-keypair-286492792',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:07:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0915a1c5e7e14afe8831b426b42d0d35',ramdisk_id='',reservation_id='r-ak0gitqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2132869133',owner_user_name='tempest-TaggedBootDevicesTest-2132869133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e174da762209454a8cab943a1bc8e010',uuid=03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "address": "fa:16:3e:72:b0:39", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f2e9d4-a1", "ovs_interfaceid": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converting VIF {"id": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "address": "fa:16:3e:72:b0:39", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f2e9d4-a1", "ovs_interfaceid": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:b0:39,bridge_name='br-int',has_traffic_filtering=True,id=38f2e9d4-a1e3-4d92-a45c-114c4dcb5920,network=Network(e3585509-12cc-4551-ad46-7f06ce049df0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f2e9d4-a1') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG os_vif [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:b0:39,bridge_name='br-int',has_traffic_filtering=True,id=38f2e9d4-a1e3-4d92-a45c-114c4dcb5920,network=Network(e3585509-12cc-4551-ad46-7f06ce049df0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f2e9d4-a1') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38f2e9d4-a1, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:51 user nova-compute[73188]: INFO os_vif [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:5c:7e,bridge_name='br-int',has_traffic_filtering=True,id=c169fd9d-21c0-4104-af83-51ee360612b5,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc169fd9d-21')
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614732338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614732338',id=11,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBDQbv5n4VEeAvnAJ6tL9DsIUI/WahvlehI4iRSJ5keiKnx9QoeH7H+4PhwiyV7+zTpaUX9W8mjhZGfCB80JLMGAaZwM+VSUf0vH7rrELMUW4OCdj0q5KkBtNzCwU0SAA==',key_name='tempest-keypair-890925727',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:07:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3df3ab2300ae46699d4d309268f83415',ramdisk_id='',reservation_id='r-7nkntget',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1842772812',owner_user_name='tempest-TaggedBootDevicesTest_v242-1842772812-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:07:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0d1232acc0d4041872c5ee40b4c826e',uuid=deb3ccb4-136f-4873-959d-edecdc436291,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "address": "fa:16:3e:05:3c:92", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a3682d0-74", "ovs_interfaceid": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converting VIF {"id": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "address": "fa:16:3e:05:3c:92", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a3682d0-74", "ovs_interfaceid": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:3c:92,bridge_name='br-int',has_traffic_filtering=True,id=9a3682d0-74e3-46c7-89cc-bc90a5da8de0,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9a3682d0-74') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG os_vif [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:3c:92,bridge_name='br-int',has_traffic_filtering=True,id=9a3682d0-74e3-46c7-89cc-bc90a5da8de0,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9a3682d0-74') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:08:51 user nova-compute[73188]: INFO nova.compute.claims [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Claim successful on node user
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a3682d0-74, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:51 user nova-compute[73188]: INFO os_vif [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:b0:39,bridge_name='br-int',has_traffic_filtering=True,id=38f2e9d4-a1e3-4d92-a45c-114c4dcb5920,network=Network(e3585509-12cc-4551-ad46-7f06ce049df0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38f2e9d4-a1')
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114388087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114388087',id=10,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1idcKZ1xBbWg0gYfVVvOJ4qKeCJ/9fHvAZz/gBB7d+sI7S/Wu2WW23N0v1n+rEzVqwKc3OTOLXDu8ZE2aPLsO4i+R6405lRbPdsNEMKO6raHFlQEQsmUo+TGOLSa69uQ==',key_name='tempest-keypair-286492792',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:07:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0915a1c5e7e14afe8831b426b42d0d35',ramdisk_id='',reservation_id='r-ak0gitqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2132869133',owner_user_name='tempest-TaggedBootDevicesTest-2132869133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e174da762209454a8cab943a1bc8e010',uuid=03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "address": "fa:16:3e:a3:bd:93", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc8c62-57", "ovs_interfaceid": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converting VIF {"id": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "address": "fa:16:3e:a3:bd:93", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc8c62-57", "ovs_interfaceid": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:bd:93,bridge_name='br-int',has_traffic_filtering=True,id=95cc8c62-5790-417a-bc3f-ebf4028f99e3,network=Network(e3585509-12cc-4551-ad46-7f06ce049df0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cc8c62-57') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG os_vif [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:bd:93,bridge_name='br-int',has_traffic_filtering=True,id=95cc8c62-5790-417a-bc3f-ebf4028f99e3,network=Network(e3585509-12cc-4551-ad46-7f06ce049df0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cc8c62-57') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95cc8c62-57, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:52 user nova-compute[73188]: INFO os_vif [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:3c:92,bridge_name='br-int',has_traffic_filtering=True,id=9a3682d0-74e3-46c7-89cc-bc90a5da8de0,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9a3682d0-74')
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614732338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614732338',id=11,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBDQbv5n4VEeAvnAJ6tL9DsIUI/WahvlehI4iRSJ5keiKnx9QoeH7H+4PhwiyV7+zTpaUX9W8mjhZGfCB80JLMGAaZwM+VSUf0vH7rrELMUW4OCdj0q5KkBtNzCwU0SAA==',key_name='tempest-keypair-890925727',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:07:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3df3ab2300ae46699d4d309268f83415',ramdisk_id='',reservation_id='r-7nkntget',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1842772812',owner_user_name='tempest-TaggedBootDevicesTest_v242-1842772812-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:07:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0d1232acc0d4041872c5ee40b4c826e',uuid=deb3ccb4-136f-4873-959d-edecdc436291,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59186294-47fd-4da4-8961-419b39b16970", "address": "fa:16:3e:31:38:e2", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59186294-47", "ovs_interfaceid": "59186294-47fd-4da4-8961-419b39b16970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converting VIF {"id": "59186294-47fd-4da4-8961-419b39b16970", "address": "fa:16:3e:31:38:e2", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59186294-47", "ovs_interfaceid": "59186294-47fd-4da4-8961-419b39b16970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:38:e2,bridge_name='br-int',has_traffic_filtering=True,id=59186294-47fd-4da4-8961-419b39b16970,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59186294-47') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_vif [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:38:e2,bridge_name='br-int',has_traffic_filtering=True,id=59186294-47fd-4da4-8961-419b39b16970,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59186294-47') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59186294-47, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:52 user nova-compute[73188]: INFO os_vif [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:bd:93,bridge_name='br-int',has_traffic_filtering=True,id=95cc8c62-5790-417a-bc3f-ebf4028f99e3,network=Network(e3585509-12cc-4551-ad46-7f06ce049df0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cc8c62-57')
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZCXBQdbI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:08:52 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd441b64-b7f5-405a-a34d-8150421aa1fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:52 user nova-compute[73188]: INFO os_vif [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:38:e2,bridge_name='br-int',has_traffic_filtering=True,id=59186294-47fd-4da4-8961-419b39b16970,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59186294-47')
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614732338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614732338',id=11,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBDQbv5n4VEeAvnAJ6tL9DsIUI/WahvlehI4iRSJ5keiKnx9QoeH7H+4PhwiyV7+zTpaUX9W8mjhZGfCB80JLMGAaZwM+VSUf0vH7rrELMUW4OCdj0q5KkBtNzCwU0SAA==',key_name='tempest-keypair-890925727',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:07:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3df3ab2300ae46699d4d309268f83415',ramdisk_id='',reservation_id='r-7nkntget',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1842772812',owner_user_name='tempest-TaggedBootDevicesTest_v242-1842772812-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:07:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0d1232acc0d4041872c5ee40b4c826e',uuid=deb3ccb4-136f-4873-959d-edecdc436291,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b570288f-2a5e-422e-a42f-20acf7269946", "address": "fa:16:3e:02:ca:a7", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb570288f-2a", "ovs_interfaceid": "b570288f-2a5e-422e-a42f-20acf7269946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converting VIF {"id": "b570288f-2a5e-422e-a42f-20acf7269946", "address": "fa:16:3e:02:ca:a7", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb570288f-2a", "ovs_interfaceid": "b570288f-2a5e-422e-a42f-20acf7269946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:ca:a7,bridge_name='br-int',has_traffic_filtering=True,id=b570288f-2a5e-422e-a42f-20acf7269946,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb570288f-2a') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_vif [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:ca:a7,bridge_name='br-int',has_traffic_filtering=True,id=b570288f-2a5e-422e-a42f-20acf7269946,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb570288f-2a') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb570288f-2a, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:52 user nova-compute[73188]: INFO os_vif [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:ca:a7,bridge_name='br-int',has_traffic_filtering=True,id=b570288f-2a5e-422e-a42f-20acf7269946,network=Network(dcb19da3-498e-4196-88e8-de604ce00929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb570288f-2a')
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614732338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614732338',id=11,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBDQbv5n4VEeAvnAJ6tL9DsIUI/WahvlehI4iRSJ5keiKnx9QoeH7H+4PhwiyV7+zTpaUX9W8mjhZGfCB80JLMGAaZwM+VSUf0vH7rrELMUW4OCdj0q5KkBtNzCwU0SAA==',key_name='tempest-keypair-890925727',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:07:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3df3ab2300ae46699d4d309268f83415',ramdisk_id='',reservation_id='r-7nkntget',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1842772812',owner_user_name='tempest-TaggedBootDevicesTest_v242-1842772812-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:07:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0d1232acc0d4041872c5ee40b4c826e',uuid=deb3ccb4-136f-4873-959d-edecdc436291,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "address": "fa:16:3e:a4:22:08", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6171fcf-6d", "ovs_interfaceid": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converting VIF {"id": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "address": "fa:16:3e:a4:22:08", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6171fcf-6d", "ovs_interfaceid": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:22:08,bridge_name='br-int',has_traffic_filtering=True,id=b6171fcf-6d3c-4e00-b032-e62467a9ff71,network=Network(003b5e43-d77e-4b83-a772-3a0ccf66fc76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6171fcf-6d') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_vif [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:22:08,bridge_name='br-int',has_traffic_filtering=True,id=b6171fcf-6d3c-4e00-b032-e62467a9ff71,network=Network(003b5e43-d77e-4b83-a772-3a0ccf66fc76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6171fcf-6d') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7ea302-f9ec-4d5c-add7-74b7cc889ae6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:52 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:52 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f280832bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f'): ({'sdf'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Removing single pathed devices sdf {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6171fcf-6d, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:52 user nova-compute[73188]: INFO os_vif [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:22:08,bridge_name='br-int',has_traffic_filtering=True,id=b6171fcf-6d3c-4e00-b032-e62467a9ff71,network=Network(003b5e43-d77e-4b83-a772-3a0ccf66fc76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6171fcf-6d')
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614732338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614732338',id=11,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBDQbv5n4VEeAvnAJ6tL9DsIUI/WahvlehI4iRSJ5keiKnx9QoeH7H+4PhwiyV7+zTpaUX9W8mjhZGfCB80JLMGAaZwM+VSUf0vH7rrELMUW4OCdj0q5KkBtNzCwU0SAA==',key_name='tempest-keypair-890925727',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:07:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3df3ab2300ae46699d4d309268f83415',ramdisk_id='',reservation_id='r-7nkntget',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1842772812',owner_user_name='tempest-TaggedBootDevicesTest_v242-1842772812-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:07:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0d1232acc0d4041872c5ee40b4c826e',uuid=deb3ccb4-136f-4873-959d-edecdc436291,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "address": "fa:16:3e:84:8d:cb", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53f593-c9", "ovs_interfaceid": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converting VIF {"id": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "address": "fa:16:3e:84:8d:cb", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53f593-c9", "ovs_interfaceid": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:8d:cb,bridge_name='br-int',has_traffic_filtering=True,id=4e53f593-c9c9-478d-bc1b-f0315d8eb2a5,network=Network(003b5e43-d77e-4b83-a772-3a0ccf66fc76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e53f593-c9') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_vif [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:8d:cb,bridge_name='br-int',has_traffic_filtering=True,id=4e53f593-c9c9-478d-bc1b-f0315d8eb2a5,network=Network(003b5e43-d77e-4b83-a772-3a0ccf66fc76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e53f593-c9') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e53f593-c9, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0a299d-03cf-47d4-8bf9-fcf685d5621e]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:08:52 user nova-compute[73188]: INFO os_vif [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:8d:cb,bridge_name='br-int',has_traffic_filtering=True,id=4e53f593-c9c9-478d-bc1b-f0315d8eb2a5,network=Network(003b5e43-d77e-4b83-a772-3a0ccf66fc76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e53f593-c9')
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pfcSAumY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:08:52 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f44b81-699c-41dc-9a44-0bd2aae03101]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Flushing IO for device /dev/sdf {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d3f580-4ded-4a26-86f9-c417cab624b1]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e95c9f-5e10-4149-b2be-9d5249cb3c21]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] SCSI volumes sdf have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d234fa31-8259-4c03-a8cc-e170538ffc63]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[be923d19-cc7c-4972-bc5d-f2b84572b084]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f, portal: 172.16.0.220,3260]
Aug 15 19:08:52 user nova-compute[73188]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f, portal: 172.16.0.220,3260] successful.
Aug 15 19:08:52 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:804d1e95-bd0e-4563-a254-f31e66fa0b1f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd67e09e-bc8c-4d19-9732-c6e125bedb6f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] <== disconnect_volume: return (403ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.285s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XragvTUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:08:52 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5530855c-9284-41c6-b6a9-22b9757f0bd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.802s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[206379b1-c867-49f6-a2d8-225a14dbbbdc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:52 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:52 user nova-compute[73188]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 (non-flash)
Aug 15 19:08:52 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281018cb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75'): ({'sdh'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Removing single pathed devices sdh {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[704b7982-eeb1-4c72-90fa-575d7e5bde00]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25bf1b7-5d82-43ca-ad41-20620e345a5e]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Flushing IO for device /dev/sdh {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe40b17-5a82-435b-b33a-02987bae9a52]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:08:52 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.056s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cace554-abbe-4d4f-9e32-452b56154e6c]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] SCSI volumes sdh have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5541d6b9-f7b8-4b28-9462-8dfd3866347d]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.policy [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a55d8274ea6d4970921dcbc36d8a00b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4761b15a8dae4f7cab8c13ace5b42ddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-plugged-76516ed7-f500-4002-9ea5-14cb411ef40e {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-plugged-76516ed7-f500-4002-9ea5-14cb411ef40e {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:52 user nova-compute[73188]: WARNING nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received unexpected event network-vif-plugged-76516ed7-f500-4002-9ea5-14cb411ef40e for instance with vm_state active and task_state deleting.
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-unplugged-9a3682d0-74e3-46c7-89cc-bc90a5da8de0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-unplugged-9a3682d0-74e3-46c7-89cc-bc90a5da8de0 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-unplugged-9a3682d0-74e3-46c7-89cc-bc90a5da8de0 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-plugged-9a3682d0-74e3-46c7-89cc-bc90a5da8de0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-plugged-9a3682d0-74e3-46c7-89cc-bc90a5da8de0 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:52 user nova-compute[73188]: WARNING nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received unexpected event network-vif-plugged-9a3682d0-74e3-46c7-89cc-bc90a5da8de0 for instance with vm_state active and task_state deleting.
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-unplugged-59186294-47fd-4da4-8961-419b39b16970 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-unplugged-59186294-47fd-4da4-8961-419b39b16970 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-unplugged-59186294-47fd-4da4-8961-419b39b16970 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-plugged-59186294-47fd-4da4-8961-419b39b16970 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-plugged-59186294-47fd-4da4-8961-419b39b16970 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:52 user nova-compute[73188]: WARNING nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received unexpected event network-vif-plugged-59186294-47fd-4da4-8961-419b39b16970 for instance with vm_state active and task_state deleting.
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-unplugged-4e53f593-c9c9-478d-bc1b-f0315d8eb2a5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-unplugged-4e53f593-c9c9-478d-bc1b-f0315d8eb2a5 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-unplugged-4e53f593-c9c9-478d-bc1b-f0315d8eb2a5 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-plugged-4e53f593-c9c9-478d-bc1b-f0315d8eb2a5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-plugged-4e53f593-c9c9-478d-bc1b-f0315d8eb2a5 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:52 user nova-compute[73188]: WARNING nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received unexpected event network-vif-plugged-4e53f593-c9c9-478d-bc1b-f0315d8eb2a5 for instance with vm_state active and task_state deleting.
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-unplugged-b6171fcf-6d3c-4e00-b032-e62467a9ff71 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-unplugged-b6171fcf-6d3c-4e00-b032-e62467a9ff71 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-unplugged-b6171fcf-6d3c-4e00-b032-e62467a9ff71 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-plugged-b6171fcf-6d3c-4e00-b032-e62467a9ff71 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Acquiring lock "deb3ccb4-136f-4873-959d-edecdc436291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] Lock "deb3ccb4-136f-4873-959d-edecdc436291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] No waiting events found dispatching network-vif-plugged-b6171fcf-6d3c-4e00-b032-e62467a9ff71 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:52 user nova-compute[73188]: WARNING nova.compute.manager [req-2ba4458a-97a9-4a4f-8035-9d7330e23979 req-d57c49d1-e7f0-4a7f-be61-c93b65675f72 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received unexpected event network-vif-plugged-b6171fcf-6d3c-4e00-b032-e62467a9ff71 for instance with vm_state active and task_state deleting.
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:08:52 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Creating image(s)
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "/opt/stack/data/nova/instances/9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "/opt/stack/data/nova/instances/9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0510a4-6948-4c11-b097-c270b5c21b01]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75, portal: 172.16.0.220,3260]
Aug 15 19:08:52 user nova-compute[73188]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75, portal: 172.16.0.220,3260] successful.
Aug 15 19:08:52 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9671649a-4f11-4f60-a64d-a0093c2d8d75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1760a845-779c-41a5-9339-7f1f3c8d8f4d]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] <== disconnect_volume: return (660ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.367s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGykxVWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:08:52 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:08:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2000b2c8-9c73-43bf-a89d-bd886d70c2df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab37433-fb19-4194-8af8-2fbd4bed13f2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:53 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:08:53 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:53 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:53 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:53 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:53 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:53 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:08:53 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:53 user nova-compute[73188]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c (non-flash)
Aug 15 19:08:53 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:53 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:53 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28082b8af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c'): ({'sdc'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Removing single pathed devices sdc {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a752289d-0764-4343-a82d-55db91576474]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f954d9a-f363-42fc-ae3a-5d203edb00fe]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Flushing IO for device /dev/sdc {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3c3038-d003-47a2-be46-962539141689]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.196s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5579fa24-2928-40d3-8548-6066111a525f]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] SCSI volumes sdc have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfc5849-3377-4122-82db-40d8e69656bb]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca552bc-b56f-4826-86d6-973273a3e8a4]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c, portal: 172.16.0.220,3260]
Aug 15 19:08:53 user nova-compute[73188]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c, portal: 172.16.0.220,3260] successful.
Aug 15 19:08:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.196s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ab6393-d020-4b11-8272-837dac22413c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e27eb4-a123-435a-9c0b-f8a69581b4ee]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] <== disconnect_volume: return (752ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.379s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIEWTCKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:08:53 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7/disk 1073741824" returned: 0 in 0.054s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[984e623b-9687-486e-ab78-c1dec1dd0269]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7736b75d-aa9e-4038-afe6-94993a9a9461]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:53 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:08:53 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:53 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:53 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:53 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:53 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:08:53 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:53 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:53 user nova-compute[73188]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 (non-flash)
Aug 15 19:08:53 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28082ac160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4'): ({'sde'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Removing single pathed devices sde {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b957c3-6fb6-49e4-ae9a-cf6bae3dfbd0]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Successfully created port: 484e78f1-880c-43ec-ac83-983201fdc835 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6183c113-206b-4e46-aef0-7069f735fb01]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Flushing IO for device /dev/sde {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c937b6f-a845-409d-8893-ad1d511398e1]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.196s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.111s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebdec45-3b6e-4705-8892-3f30f0a6ae5c]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] SCSI volumes sde have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b41b40-e257-44e9-bfe7-a5ec89b5ded5]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e69f1c3-3667-4622-9b6e-5f0b6eb73951]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4, portal: 172.16.0.220,3260]
Aug 15 19:08:53 user nova-compute[73188]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4, portal: 172.16.0.220,3260] successful.
Aug 15 19:08:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Cannot resize image /opt/stack/data/nova/instances/9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG nova.objects.instance [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lazy-loading 'migration_context' on Instance uuid 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ce9c7e-39dd-45e3-acd4-0423ef7e37a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.062s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d76de38-cf0d-40b1-ab9f-0f8f8eb7f521]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.538s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] <== disconnect_volume: return (917ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.534s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CHjalEfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:08:53 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:08:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a460cc-8e3c-4737-bbd3-beb2d6438adb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0980f1c7-45d9-4846-8f1a-25a248572535]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:54 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:08:54 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:54 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:54 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:54 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:54 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:08:54 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:54 user nova-compute[73188]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 (non-flash)
Aug 15 19:08:54 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:54 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28082b9000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133'): ({'sdd'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Removing single pathed devices sdd {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1a0218-b22a-48da-aca6-b0c23f275b32]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Ensure instance console log exists: /opt/stack/data/nova/instances/9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f27c351-58bc-4ad4-8512-0929510e6c23]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Flushing IO for device /dev/sdd {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59b2c9d-7198-4f8c-9fdb-e6699efa6684]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1b0fe6-a1cd-4eae-a596-3f23a1d81c5d]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] SCSI volumes sdd have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[313cfb09-4f46-44cb-9a83-3c2802d04fac]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dad2da-6236-43c2-b7fa-4665769e509e]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133, portal: 172.16.0.220,3260]
Aug 15 19:08:54 user nova-compute[73188]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133, portal: 172.16.0.220,3260] successful.
Aug 15 19:08:54 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae554626-7b3b-410b-9fca-505913bf4133 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7810be91-1d5d-4783-a842-8937f14b6af7]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] <== disconnect_volume: return (907ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:08:54 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Deleting instance files /opt/stack/data/nova/instances/03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b_del
Aug 15 19:08:54 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Deletion of /opt/stack/data/nova/instances/03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b_del complete
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.379s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[760cab13-1356-4388-a6ac-a4e40d99958c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8598b599-8675-4e52-bda3-73a1498cf5d6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:54 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:08:54 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:54 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:54 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:08:54 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:08:54 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:08:54 user nova-compute[73188]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d (non-flash)
Aug 15 19:08:54 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28082b9510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d'): ({'sdg'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Removing single pathed devices sdg {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69bb577-abb7-4587-a56f-4b38b30b537f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:54 user nova-compute[73188]: INFO nova.compute.manager [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Took 6.58 seconds to destroy the instance on the hypervisor.
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[917d04db-283a-4f9b-9bf9-26ddfb433314]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Flushing IO for device /dev/sdg {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5193b0-c813-422a-803c-2dad88080405]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f39d5d5-34be-435b-82d7-83c6496596d0]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] SCSI volumes sdg have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[20527ca2-86dc-4b2d-8d48-5ddc2e98986a]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc3777a-7f6a-4bed-8ddb-b11835c7d150]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d, portal: 172.16.0.220,3260]
Aug 15 19:08:54 user nova-compute[73188]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d, portal: 172.16.0.220,3260] successful.
Aug 15 19:08:54 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cc80c9-2627-41d5-b417-df4d88cc657d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5562f7f1-1616-4513-8ea5-4092efeeb30a]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] <== disconnect_volume: return (722ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:08:54 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Deleting instance files /opt/stack/data/nova/instances/deb3ccb4-136f-4873-959d-edecdc436291_del
Aug 15 19:08:54 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Deletion of /opt/stack/data/nova/instances/deb3ccb4-136f-4873-959d-edecdc436291_del complete
Aug 15 19:08:54 user nova-compute[73188]: INFO nova.compute.manager [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Took 5.80 seconds to destroy the instance on the hypervisor.
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: deb3ccb4-136f-4873-959d-edecdc436291] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Successfully updated port: 484e78f1-880c-43ec-ac83-983201fdc835 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "refresh_cache-9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquired lock "refresh_cache-9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG nova.compute.manager [req-0fc88ceb-43c4-4b47-8679-1e52b82fc01c req-887ff123-5595-48e9-867c-82396465fed7 service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Received event network-changed-484e78f1-880c-43ec-ac83-983201fdc835 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG nova.compute.manager [req-0fc88ceb-43c4-4b47-8679-1e52b82fc01c req-887ff123-5595-48e9-867c-82396465fed7 service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Refreshing instance network info cache due to event network-changed-484e78f1-880c-43ec-ac83-983201fdc835. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0fc88ceb-43c4-4b47-8679-1e52b82fc01c req-887ff123-5595-48e9-867c-82396465fed7 service nova] Acquiring lock "refresh_cache-9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:08:54 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Updating instance_info_cache with network_info: [{"id": "484e78f1-880c-43ec-ac83-983201fdc835", "address": "fa:16:3e:49:eb:35", "network": {"id": "574343fe-52ff-4be4-9622-e61a33db8396", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-946260414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4761b15a8dae4f7cab8c13ace5b42ddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484e78f1-88", "ovs_interfaceid": "484e78f1-880c-43ec-ac83-983201fdc835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Releasing lock "refresh_cache-9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Instance network_info: |[{"id": "484e78f1-880c-43ec-ac83-983201fdc835", "address": "fa:16:3e:49:eb:35", "network": {"id": "574343fe-52ff-4be4-9622-e61a33db8396", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-946260414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4761b15a8dae4f7cab8c13ace5b42ddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484e78f1-88", "ovs_interfaceid": "484e78f1-880c-43ec-ac83-983201fdc835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0fc88ceb-43c4-4b47-8679-1e52b82fc01c req-887ff123-5595-48e9-867c-82396465fed7 service nova] Acquired lock "refresh_cache-9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.network.neutron [req-0fc88ceb-43c4-4b47-8679-1e52b82fc01c req-887ff123-5595-48e9-867c-82396465fed7 service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Refreshing network info cache for port 484e78f1-880c-43ec-ac83-983201fdc835 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Start _get_guest_xml network_info=[{"id": "484e78f1-880c-43ec-ac83-983201fdc835", "address": "fa:16:3e:49:eb:35", "network": {"id": "574343fe-52ff-4be4-9622-e61a33db8396", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-946260414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4761b15a8dae4f7cab8c13ace5b42ddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484e78f1-88", "ovs_interfaceid": "484e78f1-880c-43ec-ac83-983201fdc835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:08:55 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:08:55 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:08:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-337236358',display_name='tempest-VolumesAdminNegativeTest-server-337236358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-337236358',id=15,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4761b15a8dae4f7cab8c13ace5b42ddd',ramdisk_id='',reservation_id='r-bj59es47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1347354909',owner_user_name='tempest-VolumesAdminNegativeTest-1347354909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:08:53Z,user_data=None,user_id='a55d8274ea6d4970921dcbc36d8a00b3',uuid=9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "484e78f1-880c-43ec-ac83-983201fdc835", "address": "fa:16:3e:49:eb:35", "network": {"id": "574343fe-52ff-4be4-9622-e61a33db8396", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-946260414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4761b15a8dae4f7cab8c13ace5b42ddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484e78f1-88", "ovs_interfaceid": "484e78f1-880c-43ec-ac83-983201fdc835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Converting VIF {"id": "484e78f1-880c-43ec-ac83-983201fdc835", "address": "fa:16:3e:49:eb:35", "network": {"id": "574343fe-52ff-4be4-9622-e61a33db8396", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-946260414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4761b15a8dae4f7cab8c13ace5b42ddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484e78f1-88", "ovs_interfaceid": "484e78f1-880c-43ec-ac83-983201fdc835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:eb:35,bridge_name='br-int',has_traffic_filtering=True,id=484e78f1-880c-43ec-ac83-983201fdc835,network=Network(574343fe-52ff-4be4-9622-e61a33db8396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484e78f1-88') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.objects.instance [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:08:55 user nova-compute[73188]:   <uuid>9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7</uuid>
Aug 15 19:08:55 user nova-compute[73188]:   <name>instance-0000000f</name>
Aug 15 19:08:55 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:08:55 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:08:55 user nova-compute[73188]:   <metadata>
Aug 15 19:08:55 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:08:55 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:08:55 user nova-compute[73188]:       <nova:name>tempest-VolumesAdminNegativeTest-server-337236358</nova:name>
Aug 15 19:08:55 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:08:55</nova:creationTime>
Aug 15 19:08:55 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:08:55 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:08:55 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:08:55 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:08:55 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:08:55 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:08:55 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:08:55 user nova-compute[73188]:       <nova:owner>
Aug 15 19:08:55 user nova-compute[73188]:         <nova:user uuid="a55d8274ea6d4970921dcbc36d8a00b3">tempest-VolumesAdminNegativeTest-1347354909-project-member</nova:user>
Aug 15 19:08:55 user nova-compute[73188]:         <nova:project uuid="4761b15a8dae4f7cab8c13ace5b42ddd">tempest-VolumesAdminNegativeTest-1347354909</nova:project>
Aug 15 19:08:55 user nova-compute[73188]:       </nova:owner>
Aug 15 19:08:55 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:08:55 user nova-compute[73188]:       <nova:ports>
Aug 15 19:08:55 user nova-compute[73188]:         <nova:port uuid="484e78f1-880c-43ec-ac83-983201fdc835">
Aug 15 19:08:55 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 19:08:55 user nova-compute[73188]:         </nova:port>
Aug 15 19:08:55 user nova-compute[73188]:       </nova:ports>
Aug 15 19:08:55 user nova-compute[73188]:     </nova:instance>
Aug 15 19:08:55 user nova-compute[73188]:   </metadata>
Aug 15 19:08:55 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:08:55 user nova-compute[73188]:     <system>
Aug 15 19:08:55 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:08:55 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:08:55 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:08:55 user nova-compute[73188]:       <entry name="serial">9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7</entry>
Aug 15 19:08:55 user nova-compute[73188]:       <entry name="uuid">9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7</entry>
Aug 15 19:08:55 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:08:55 user nova-compute[73188]:     </system>
Aug 15 19:08:55 user nova-compute[73188]:   </sysinfo>
Aug 15 19:08:55 user nova-compute[73188]:   <os>
Aug 15 19:08:55 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:08:55 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:08:55 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:08:55 user nova-compute[73188]:   </os>
Aug 15 19:08:55 user nova-compute[73188]:   <features>
Aug 15 19:08:55 user nova-compute[73188]:     <acpi/>
Aug 15 19:08:55 user nova-compute[73188]:     <apic/>
Aug 15 19:08:55 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:08:55 user nova-compute[73188]:   </features>
Aug 15 19:08:55 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:08:55 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:08:55 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:08:55 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:08:55 user nova-compute[73188]:   </clock>
Aug 15 19:08:55 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:08:55 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:08:55 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:08:55 user nova-compute[73188]:   </cpu>
Aug 15 19:08:55 user nova-compute[73188]:   <devices>
Aug 15 19:08:55 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:08:55 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:08:55 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7/disk"/>
Aug 15 19:08:55 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:08:55 user nova-compute[73188]:     </disk>
Aug 15 19:08:55 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:08:55 user nova-compute[73188]:       <mac address="fa:16:3e:49:eb:35"/>
Aug 15 19:08:55 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:08:55 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:08:55 user nova-compute[73188]:       <target dev="tap484e78f1-88"/>
Aug 15 19:08:55 user nova-compute[73188]:     </interface>
Aug 15 19:08:55 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:08:55 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7/console.log" append="off"/>
Aug 15 19:08:55 user nova-compute[73188]:     </serial>
Aug 15 19:08:55 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:08:55 user nova-compute[73188]:     <video>
Aug 15 19:08:55 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:08:55 user nova-compute[73188]:     </video>
Aug 15 19:08:55 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:08:55 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:08:55 user nova-compute[73188]:     </rng>
Aug 15 19:08:55 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:08:55 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:08:55 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:08:55 user nova-compute[73188]:     </memballoon>
Aug 15 19:08:55 user nova-compute[73188]:   </devices>
Aug 15 19:08:55 user nova-compute[73188]: </domain>
Aug 15 19:08:55 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:08:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-337236358',display_name='tempest-VolumesAdminNegativeTest-server-337236358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-337236358',id=15,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4761b15a8dae4f7cab8c13ace5b42ddd',ramdisk_id='',reservation_id='r-bj59es47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1347354909',owner_user_name='tempest-VolumesAdminNegativeTest-1347354909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:08:53Z,user_data=None,user_id='a55d8274ea6d4970921dcbc36d8a00b3',uuid=9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "484e78f1-880c-43ec-ac83-983201fdc835", "address": "fa:16:3e:49:eb:35", "network": {"id": "574343fe-52ff-4be4-9622-e61a33db8396", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-946260414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4761b15a8dae4f7cab8c13ace5b42ddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484e78f1-88", "ovs_interfaceid": "484e78f1-880c-43ec-ac83-983201fdc835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Converting VIF {"id": "484e78f1-880c-43ec-ac83-983201fdc835", "address": "fa:16:3e:49:eb:35", "network": {"id": "574343fe-52ff-4be4-9622-e61a33db8396", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-946260414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4761b15a8dae4f7cab8c13ace5b42ddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484e78f1-88", "ovs_interfaceid": "484e78f1-880c-43ec-ac83-983201fdc835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:eb:35,bridge_name='br-int',has_traffic_filtering=True,id=484e78f1-880c-43ec-ac83-983201fdc835,network=Network(574343fe-52ff-4be4-9622-e61a33db8396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484e78f1-88') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG os_vif [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:eb:35,bridge_name='br-int',has_traffic_filtering=True,id=484e78f1-880c-43ec-ac83-983201fdc835,network=Network(574343fe-52ff-4be4-9622-e61a33db8396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484e78f1-88') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap484e78f1-88, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap484e78f1-88, col_values=(('external_ids', {'iface-id': '484e78f1-880c-43ec-ac83-983201fdc835', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:eb:35', 'vm-uuid': '9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:55 user nova-compute[73188]: INFO os_vif [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:eb:35,bridge_name='br-int',has_traffic_filtering=True,id=484e78f1-880c-43ec-ac83-983201fdc835,network=Network(574343fe-52ff-4be4-9622-e61a33db8396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484e78f1-88')
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] No VIF found with MAC fa:16:3e:49:eb:35, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.network.neutron [req-0fc88ceb-43c4-4b47-8679-1e52b82fc01c req-887ff123-5595-48e9-867c-82396465fed7 service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Updated VIF entry in instance network info cache for port 484e78f1-880c-43ec-ac83-983201fdc835. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG nova.network.neutron [req-0fc88ceb-43c4-4b47-8679-1e52b82fc01c req-887ff123-5595-48e9-867c-82396465fed7 service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Updating instance_info_cache with network_info: [{"id": "484e78f1-880c-43ec-ac83-983201fdc835", "address": "fa:16:3e:49:eb:35", "network": {"id": "574343fe-52ff-4be4-9622-e61a33db8396", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-946260414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4761b15a8dae4f7cab8c13ace5b42ddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484e78f1-88", "ovs_interfaceid": "484e78f1-880c-43ec-ac83-983201fdc835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0fc88ceb-43c4-4b47-8679-1e52b82fc01c req-887ff123-5595-48e9-867c-82396465fed7 service nova] Releasing lock "refresh_cache-9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:08:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:56 user nova-compute[73188]: DEBUG nova.compute.manager [req-9d75ff79-327e-41dc-aec4-4a9d7281e925 req-3c30c84e-8731-41f8-9452-031eeafd3b57 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-deleted-6bdc6fd6-8a71-4118-b8ed-164cc4315200 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:56 user nova-compute[73188]: INFO nova.compute.manager [req-9d75ff79-327e-41dc-aec4-4a9d7281e925 req-3c30c84e-8731-41f8-9452-031eeafd3b57 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Neutron deleted interface 6bdc6fd6-8a71-4118-b8ed-164cc4315200; detaching it from the instance and deleting it from the info cache
Aug 15 19:08:56 user nova-compute[73188]: DEBUG nova.network.neutron [req-9d75ff79-327e-41dc-aec4-4a9d7281e925 req-3c30c84e-8731-41f8-9452-031eeafd3b57 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Updating instance_info_cache with network_info: [{"id": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "address": "fa:16:3e:81:58:43", "network": {"id": "788628d4-c380-4e07-8d19-602530f78430", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1614362335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af6d04-8c", "ovs_interfaceid": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "address": "fa:16:3e:8a:45:a9", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab59fd7-0d", "ovs_interfaceid": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "00607676-9218-41f8-945f-8c4ed6834882", "address": "fa:16:3e:51:84:98", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00607676-92", "ovs_interfaceid": "00607676-9218-41f8-945f-8c4ed6834882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "address": "fa:16:3e:38:cd:12", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cab9f9c-aa", "ovs_interfaceid": "3cab9f9c-aa69-41e1-b2b1-1397b068fb0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "address": "fa:16:3e:72:b0:39", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f2e9d4-a1", "ovs_interfaceid": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "address": "fa:16:3e:a3:bd:93", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc8c62-57", "ovs_interfaceid": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:08:56 user nova-compute[73188]: DEBUG nova.compute.manager [req-9d75ff79-327e-41dc-aec4-4a9d7281e925 req-3c30c84e-8731-41f8-9452-031eeafd3b57 service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Detach interface failed, port_id=6bdc6fd6-8a71-4118-b8ed-164cc4315200, reason: Instance 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:08:56 user nova-compute[73188]: DEBUG nova.compute.manager [req-ff22cd43-83a6-4427-9b53-6462360d86b9 req-2f9d1175-4db7-406a-99ae-8fdc949b3a34 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-deleted-b570288f-2a5e-422e-a42f-20acf7269946 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:56 user nova-compute[73188]: INFO nova.compute.manager [req-ff22cd43-83a6-4427-9b53-6462360d86b9 req-2f9d1175-4db7-406a-99ae-8fdc949b3a34 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Neutron deleted interface b570288f-2a5e-422e-a42f-20acf7269946; detaching it from the instance and deleting it from the info cache
Aug 15 19:08:56 user nova-compute[73188]: DEBUG nova.network.neutron [req-ff22cd43-83a6-4427-9b53-6462360d86b9 req-2f9d1175-4db7-406a-99ae-8fdc949b3a34 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Updating instance_info_cache with network_info: [{"id": "76516ed7-f500-4002-9ea5-14cb411ef40e", "address": "fa:16:3e:98:81:f4", "network": {"id": "c2d692fb-b4f7-4e5f-bc90-2de58035637b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-476302846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516ed7-f5", "ovs_interfaceid": "76516ed7-f500-4002-9ea5-14cb411ef40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c169fd9d-21c0-4104-af83-51ee360612b5", "address": "fa:16:3e:5b:5c:7e", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc169fd9d-21", "ovs_interfaceid": "c169fd9d-21c0-4104-af83-51ee360612b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "address": "fa:16:3e:05:3c:92", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a3682d0-74", "ovs_interfaceid": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "59186294-47fd-4da4-8961-419b39b16970", "address": "fa:16:3e:31:38:e2", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59186294-47", "ovs_interfaceid": "59186294-47fd-4da4-8961-419b39b16970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "address": "fa:16:3e:a4:22:08", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6171fcf-6d", "ovs_interfaceid": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "address": "fa:16:3e:84:8d:cb", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53f593-c9", "ovs_interfaceid": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:08:56 user nova-compute[73188]: DEBUG nova.compute.manager [req-ff22cd43-83a6-4427-9b53-6462360d86b9 req-2f9d1175-4db7-406a-99ae-8fdc949b3a34 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Detach interface failed, port_id=b570288f-2a5e-422e-a42f-20acf7269946, reason: Instance deb3ccb4-136f-4873-959d-edecdc436291 could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:08:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:57 user nova-compute[73188]: DEBUG nova.compute.manager [req-edf24570-c818-459c-b67c-62491e386921 req-2c203059-1dce-4545-9d39-4b6db9497336 service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Received event network-vif-plugged-484e78f1-880c-43ec-ac83-983201fdc835 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-edf24570-c818-459c-b67c-62491e386921 req-2c203059-1dce-4545-9d39-4b6db9497336 service nova] Acquiring lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-edf24570-c818-459c-b67c-62491e386921 req-2c203059-1dce-4545-9d39-4b6db9497336 service nova] Lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-edf24570-c818-459c-b67c-62491e386921 req-2c203059-1dce-4545-9d39-4b6db9497336 service nova] Lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:57 user nova-compute[73188]: DEBUG nova.compute.manager [req-edf24570-c818-459c-b67c-62491e386921 req-2c203059-1dce-4545-9d39-4b6db9497336 service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] No waiting events found dispatching network-vif-plugged-484e78f1-880c-43ec-ac83-983201fdc835 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:57 user nova-compute[73188]: WARNING nova.compute.manager [req-edf24570-c818-459c-b67c-62491e386921 req-2c203059-1dce-4545-9d39-4b6db9497336 service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Received unexpected event network-vif-plugged-484e78f1-880c-43ec-ac83-983201fdc835 for instance with vm_state building and task_state spawning.
Aug 15 19:08:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Acquiring lock "e8b88f49-7f48-4170-af8a-aa1de706f218" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Lock "e8b88f49-7f48-4170-af8a-aa1de706f218" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Acquiring lock "e8b88f49-7f48-4170-af8a-aa1de706f218-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Lock "e8b88f49-7f48-4170-af8a-aa1de706f218-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Lock "e8b88f49-7f48-4170-af8a-aa1de706f218-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:58 user nova-compute[73188]: INFO nova.compute.manager [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Terminating instance
Aug 15 19:08:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:58 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Instance destroyed successfully.
Aug 15 19:08:58 user nova-compute[73188]: DEBUG nova.objects.instance [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Lazy-loading 'resources' on Instance uuid e8b88f49-7f48-4170-af8a-aa1de706f218 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-45c5ae70-abf1-4b8f-8d80-53c2ad3354db req-0aa6971b-97ac-404b-9ef9-7411f794a37e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-deleted-3cab9f9c-aa69-41e1-b2b1-1397b068fb0f {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:58 user nova-compute[73188]: INFO nova.compute.manager [req-45c5ae70-abf1-4b8f-8d80-53c2ad3354db req-0aa6971b-97ac-404b-9ef9-7411f794a37e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Neutron deleted interface 3cab9f9c-aa69-41e1-b2b1-1397b068fb0f; detaching it from the instance and deleting it from the info cache
Aug 15 19:08:58 user nova-compute[73188]: DEBUG nova.network.neutron [req-45c5ae70-abf1-4b8f-8d80-53c2ad3354db req-0aa6971b-97ac-404b-9ef9-7411f794a37e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Updating instance_info_cache with network_info: [{"id": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "address": "fa:16:3e:81:58:43", "network": {"id": "788628d4-c380-4e07-8d19-602530f78430", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1614362335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af6d04-8c", "ovs_interfaceid": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "address": "fa:16:3e:8a:45:a9", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab59fd7-0d", "ovs_interfaceid": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "00607676-9218-41f8-945f-8c4ed6834882", "address": "fa:16:3e:51:84:98", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00607676-92", "ovs_interfaceid": "00607676-9218-41f8-945f-8c4ed6834882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "address": "fa:16:3e:72:b0:39", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38f2e9d4-a1", "ovs_interfaceid": "38f2e9d4-a1e3-4d92-a45c-114c4dcb5920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "address": "fa:16:3e:a3:bd:93", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc8c62-57", "ovs_interfaceid": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1165510733',display_name='tempest-VolumesAssistedSnapshotsTest-server-1165510733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1165510733',id=6,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTFy9hzXGJ0F/fF1bPYanwZleH9Y5TlMUVhGGxlMrePHT8c2PLIQuYokiozB/EVRizZyLqDxCxNdJ+/FHR8OW4Afe4cNVLh3xCdGZIfyo7DRP+p3rm1ghCaiiiira6Agg==',key_name='tempest-keypair-1933432392',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:05:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b49dcc697ced4397bc0760dc41be30cc',ramdisk_id='',reservation_id='r-ahht7937',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-814188799',owner_user_name='tempest-VolumesAssistedSnapshotsTest-814188799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:06:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19800e8916e542239bf9b015d2df8de2',uuid=e8b88f49-7f48-4170-af8a-aa1de706f218,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9ef2f68-c2c1-464b-8942-572fe28ceba3", "address": "fa:16:3e:10:15:fd", "network": {"id": "e6808e77-8eb3-4298-a05b-dd25f9f39bb0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-711659466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b49dcc697ced4397bc0760dc41be30cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ef2f68-c2", "ovs_interfaceid": "a9ef2f68-c2c1-464b-8942-572fe28ceba3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Converting VIF {"id": "a9ef2f68-c2c1-464b-8942-572fe28ceba3", "address": "fa:16:3e:10:15:fd", "network": {"id": "e6808e77-8eb3-4298-a05b-dd25f9f39bb0", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-711659466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b49dcc697ced4397bc0760dc41be30cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ef2f68-c2", "ovs_interfaceid": "a9ef2f68-c2c1-464b-8942-572fe28ceba3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:15:fd,bridge_name='br-int',has_traffic_filtering=True,id=a9ef2f68-c2c1-464b-8942-572fe28ceba3,network=Network(e6808e77-8eb3-4298-a05b-dd25f9f39bb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9ef2f68-c2') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG os_vif [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:15:fd,bridge_name='br-int',has_traffic_filtering=True,id=a9ef2f68-c2c1-464b-8942-572fe28ceba3,network=Network(e6808e77-8eb3-4298-a05b-dd25f9f39bb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9ef2f68-c2') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-b6aee320-e710-4f66-b9c1-b4e52c0c944f req-05daf90b-322a-43a1-be67-2d96ff7c6d8b service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-deleted-59186294-47fd-4da4-8961-419b39b16970 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:58 user nova-compute[73188]: INFO nova.compute.manager [req-b6aee320-e710-4f66-b9c1-b4e52c0c944f req-05daf90b-322a-43a1-be67-2d96ff7c6d8b service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Neutron deleted interface 59186294-47fd-4da4-8961-419b39b16970; detaching it from the instance and deleting it from the info cache
Aug 15 19:08:58 user nova-compute[73188]: DEBUG nova.network.neutron [req-b6aee320-e710-4f66-b9c1-b4e52c0c944f req-05daf90b-322a-43a1-be67-2d96ff7c6d8b service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Updating instance_info_cache with network_info: [{"id": "76516ed7-f500-4002-9ea5-14cb411ef40e", "address": "fa:16:3e:98:81:f4", "network": {"id": "c2d692fb-b4f7-4e5f-bc90-2de58035637b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-476302846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76516ed7-f5", "ovs_interfaceid": "76516ed7-f500-4002-9ea5-14cb411ef40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c169fd9d-21c0-4104-af83-51ee360612b5", "address": "fa:16:3e:5b:5c:7e", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc169fd9d-21", "ovs_interfaceid": "c169fd9d-21c0-4104-af83-51ee360612b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "address": "fa:16:3e:05:3c:92", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a3682d0-74", "ovs_interfaceid": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "address": "fa:16:3e:a4:22:08", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6171fcf-6d", "ovs_interfaceid": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "address": "fa:16:3e:84:8d:cb", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53f593-c9", "ovs_interfaceid": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9ef2f68-c2, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:08:58 user nova-compute[73188]: INFO os_vif [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:15:fd,bridge_name='br-int',has_traffic_filtering=True,id=a9ef2f68-c2c1-464b-8942-572fe28ceba3,network=Network(e6808e77-8eb3-4298-a05b-dd25f9f39bb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9ef2f68-c2')
Aug 15 19:08:58 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Deleting instance files /opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218_del
Aug 15 19:08:58 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Deletion of /opt/stack/data/nova/instances/e8b88f49-7f48-4170-af8a-aa1de706f218_del complete
Aug 15 19:08:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-45c5ae70-abf1-4b8f-8d80-53c2ad3354db req-0aa6971b-97ac-404b-9ef9-7411f794a37e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Detach interface failed, port_id=3cab9f9c-aa69-41e1-b2b1-1397b068fb0f, reason: Instance 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-45c5ae70-abf1-4b8f-8d80-53c2ad3354db req-0aa6971b-97ac-404b-9ef9-7411f794a37e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-deleted-38f2e9d4-a1e3-4d92-a45c-114c4dcb5920 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:58 user nova-compute[73188]: INFO nova.compute.manager [req-45c5ae70-abf1-4b8f-8d80-53c2ad3354db req-0aa6971b-97ac-404b-9ef9-7411f794a37e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Neutron deleted interface 38f2e9d4-a1e3-4d92-a45c-114c4dcb5920; detaching it from the instance and deleting it from the info cache
Aug 15 19:08:58 user nova-compute[73188]: DEBUG nova.network.neutron [req-45c5ae70-abf1-4b8f-8d80-53c2ad3354db req-0aa6971b-97ac-404b-9ef9-7411f794a37e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Updating instance_info_cache with network_info: [{"id": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "address": "fa:16:3e:81:58:43", "network": {"id": "788628d4-c380-4e07-8d19-602530f78430", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1614362335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af6d04-8c", "ovs_interfaceid": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "address": "fa:16:3e:8a:45:a9", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab59fd7-0d", "ovs_interfaceid": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "00607676-9218-41f8-945f-8c4ed6834882", "address": "fa:16:3e:51:84:98", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00607676-92", "ovs_interfaceid": "00607676-9218-41f8-945f-8c4ed6834882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "address": "fa:16:3e:a3:bd:93", "network": {"id": "e3585509-12cc-4551-ad46-7f06ce049df0", "bridge": "br-int", "label": "tempest-device-tagging-net2-350672524", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc8c62-57", "ovs_interfaceid": "95cc8c62-5790-417a-bc3f-ebf4028f99e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-b6aee320-e710-4f66-b9c1-b4e52c0c944f req-05daf90b-322a-43a1-be67-2d96ff7c6d8b service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Detach interface failed, port_id=59186294-47fd-4da4-8961-419b39b16970, reason: Instance deb3ccb4-136f-4873-959d-edecdc436291 could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-b6aee320-e710-4f66-b9c1-b4e52c0c944f req-05daf90b-322a-43a1-be67-2d96ff7c6d8b service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-deleted-76516ed7-f500-4002-9ea5-14cb411ef40e {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:58 user nova-compute[73188]: INFO nova.compute.manager [req-b6aee320-e710-4f66-b9c1-b4e52c0c944f req-05daf90b-322a-43a1-be67-2d96ff7c6d8b service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Neutron deleted interface 76516ed7-f500-4002-9ea5-14cb411ef40e; detaching it from the instance and deleting it from the info cache
Aug 15 19:08:58 user nova-compute[73188]: DEBUG nova.network.neutron [req-b6aee320-e710-4f66-b9c1-b4e52c0c944f req-05daf90b-322a-43a1-be67-2d96ff7c6d8b service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Updating instance_info_cache with network_info: [{"id": "c169fd9d-21c0-4104-af83-51ee360612b5", "address": "fa:16:3e:5b:5c:7e", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc169fd9d-21", "ovs_interfaceid": "c169fd9d-21c0-4104-af83-51ee360612b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "address": "fa:16:3e:05:3c:92", "network": {"id": "dcb19da3-498e-4196-88e8-de604ce00929", "bridge": "br-int", "label": "tempest-device-tagging-net1-1677989251", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a3682d0-74", "ovs_interfaceid": "9a3682d0-74e3-46c7-89cc-bc90a5da8de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "address": "fa:16:3e:a4:22:08", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6171fcf-6d", "ovs_interfaceid": "b6171fcf-6d3c-4e00-b032-e62467a9ff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "address": "fa:16:3e:84:8d:cb", "network": {"id": "003b5e43-d77e-4b83-a772-3a0ccf66fc76", "bridge": "br-int", "label": "tempest-device-tagging-net2-1171806859", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3df3ab2300ae46699d4d309268f83415", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e53f593-c9", "ovs_interfaceid": "4e53f593-c9c9-478d-bc1b-f0315d8eb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-45c5ae70-abf1-4b8f-8d80-53c2ad3354db req-0aa6971b-97ac-404b-9ef9-7411f794a37e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Detach interface failed, port_id=38f2e9d4-a1e3-4d92-a45c-114c4dcb5920, reason: Instance 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:08:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-45c5ae70-abf1-4b8f-8d80-53c2ad3354db req-0aa6971b-97ac-404b-9ef9-7411f794a37e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-deleted-95cc8c62-5790-417a-bc3f-ebf4028f99e3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:58 user nova-compute[73188]: INFO nova.compute.manager [req-45c5ae70-abf1-4b8f-8d80-53c2ad3354db req-0aa6971b-97ac-404b-9ef9-7411f794a37e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Neutron deleted interface 95cc8c62-5790-417a-bc3f-ebf4028f99e3; detaching it from the instance and deleting it from the info cache
Aug 15 19:08:58 user nova-compute[73188]: DEBUG nova.network.neutron [req-45c5ae70-abf1-4b8f-8d80-53c2ad3354db req-0aa6971b-97ac-404b-9ef9-7411f794a37e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Updating instance_info_cache with network_info: [{"id": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "address": "fa:16:3e:81:58:43", "network": {"id": "788628d4-c380-4e07-8d19-602530f78430", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1614362335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af6d04-8c", "ovs_interfaceid": "f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "address": "fa:16:3e:8a:45:a9", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab59fd7-0d", "ovs_interfaceid": "dab59fd7-0d18-4dd9-88f2-27b156f957c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "00607676-9218-41f8-945f-8c4ed6834882", "address": "fa:16:3e:51:84:98", "network": {"id": "9d707cdf-8091-40f1-9199-725f57578667", "bridge": "br-int", "label": "tempest-device-tagging-net1-1370868351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0915a1c5e7e14afe8831b426b42d0d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00607676-92", "ovs_interfaceid": "00607676-9218-41f8-945f-8c4ed6834882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.compute.manager [req-b6aee320-e710-4f66-b9c1-b4e52c0c944f req-05daf90b-322a-43a1-be67-2d96ff7c6d8b service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Detach interface failed, port_id=76516ed7-f500-4002-9ea5-14cb411ef40e, reason: Instance deb3ccb4-136f-4873-959d-edecdc436291 could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.compute.manager [req-b6aee320-e710-4f66-b9c1-b4e52c0c944f req-05daf90b-322a-43a1-be67-2d96ff7c6d8b service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Received event network-vif-unplugged-a9ef2f68-c2c1-464b-8942-572fe28ceba3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b6aee320-e710-4f66-b9c1-b4e52c0c944f req-05daf90b-322a-43a1-be67-2d96ff7c6d8b service nova] Acquiring lock "e8b88f49-7f48-4170-af8a-aa1de706f218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b6aee320-e710-4f66-b9c1-b4e52c0c944f req-05daf90b-322a-43a1-be67-2d96ff7c6d8b service nova] Lock "e8b88f49-7f48-4170-af8a-aa1de706f218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b6aee320-e710-4f66-b9c1-b4e52c0c944f req-05daf90b-322a-43a1-be67-2d96ff7c6d8b service nova] Lock "e8b88f49-7f48-4170-af8a-aa1de706f218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.compute.manager [req-b6aee320-e710-4f66-b9c1-b4e52c0c944f req-05daf90b-322a-43a1-be67-2d96ff7c6d8b service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] No waiting events found dispatching network-vif-unplugged-a9ef2f68-c2c1-464b-8942-572fe28ceba3 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.compute.manager [req-b6aee320-e710-4f66-b9c1-b4e52c0c944f req-05daf90b-322a-43a1-be67-2d96ff7c6d8b service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Received event network-vif-unplugged-a9ef2f68-c2c1-464b-8942-572fe28ceba3 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:08:59 user nova-compute[73188]: INFO nova.compute.manager [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 15 19:08:59 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.compute.manager [req-45c5ae70-abf1-4b8f-8d80-53c2ad3354db req-0aa6971b-97ac-404b-9ef9-7411f794a37e service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Detach interface failed, port_id=95cc8c62-5790-417a-bc3f-ebf4028f99e3, reason: Instance 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126539.288582, 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:08:59 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] VM Resumed (Lifecycle Event)
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:08:59 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Instance spawned successfully.
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.compute.manager [req-93903121-3bd2-43fe-add3-72459d8b1c1d req-9062e1e1-9303-4ce2-b467-3322b00c56bc service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Received event network-vif-plugged-484e78f1-880c-43ec-ac83-983201fdc835 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-93903121-3bd2-43fe-add3-72459d8b1c1d req-9062e1e1-9303-4ce2-b467-3322b00c56bc service nova] Acquiring lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-93903121-3bd2-43fe-add3-72459d8b1c1d req-9062e1e1-9303-4ce2-b467-3322b00c56bc service nova] Lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-93903121-3bd2-43fe-add3-72459d8b1c1d req-9062e1e1-9303-4ce2-b467-3322b00c56bc service nova] Lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.compute.manager [req-93903121-3bd2-43fe-add3-72459d8b1c1d req-9062e1e1-9303-4ce2-b467-3322b00c56bc service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] No waiting events found dispatching network-vif-plugged-484e78f1-880c-43ec-ac83-983201fdc835 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:08:59 user nova-compute[73188]: WARNING nova.compute.manager [req-93903121-3bd2-43fe-add3-72459d8b1c1d req-9062e1e1-9303-4ce2-b467-3322b00c56bc service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Received unexpected event network-vif-plugged-484e78f1-880c-43ec-ac83-983201fdc835 for instance with vm_state building and task_state spawning.
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:08:59 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126539.2968943, 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:08:59 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] VM Started (Lifecycle Event)
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:08:59 user nova-compute[73188]: INFO nova.compute.manager [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Took 6.53 seconds to spawn the instance on the hypervisor.
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:08:59 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:08:59 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Took 5.19 seconds to deallocate network for instance.
Aug 15 19:08:59 user nova-compute[73188]: INFO nova.compute.manager [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Took 7.78 seconds to build instance.
Aug 15 19:08:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b07fa2b4-d0a8-4cc6-872e-99b5a8c6a317 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.938s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:08:59 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:08:59 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Took 5.09 seconds to deallocate network for instance.
Aug 15 19:09:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:00 user nova-compute[73188]: DEBUG nova.compute.manager [req-1d9d8a6a-f0ae-4fe9-ad4f-34e9a2094fee req-0b8c897e-7ce0-481d-8b24-02e935cd6a4d service nova] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Received event network-vif-deleted-f3af6d04-8c4c-4bd8-85fb-9e2769c7a3c4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:09:01 user nova-compute[73188]: DEBUG nova.compute.manager [req-8312cfaf-d8f7-405a-b48e-89cec69819af req-93884c1e-8f7d-4c45-a057-f528bb684007 service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Received event network-vif-plugged-a9ef2f68-c2c1-464b-8942-572fe28ceba3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:09:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8312cfaf-d8f7-405a-b48e-89cec69819af req-93884c1e-8f7d-4c45-a057-f528bb684007 service nova] Acquiring lock "e8b88f49-7f48-4170-af8a-aa1de706f218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8312cfaf-d8f7-405a-b48e-89cec69819af req-93884c1e-8f7d-4c45-a057-f528bb684007 service nova] Lock "e8b88f49-7f48-4170-af8a-aa1de706f218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8312cfaf-d8f7-405a-b48e-89cec69819af req-93884c1e-8f7d-4c45-a057-f528bb684007 service nova] Lock "e8b88f49-7f48-4170-af8a-aa1de706f218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:01 user nova-compute[73188]: DEBUG nova.compute.manager [req-8312cfaf-d8f7-405a-b48e-89cec69819af req-93884c1e-8f7d-4c45-a057-f528bb684007 service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] No waiting events found dispatching network-vif-plugged-a9ef2f68-c2c1-464b-8942-572fe28ceba3 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:09:01 user nova-compute[73188]: WARNING nova.compute.manager [req-8312cfaf-d8f7-405a-b48e-89cec69819af req-93884c1e-8f7d-4c45-a057-f528bb684007 service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Received unexpected event network-vif-plugged-a9ef2f68-c2c1-464b-8942-572fe28ceba3 for instance with vm_state active and task_state deleting.
Aug 15 19:09:01 user nova-compute[73188]: DEBUG nova.compute.manager [req-8312cfaf-d8f7-405a-b48e-89cec69819af req-93884c1e-8f7d-4c45-a057-f528bb684007 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-deleted-4e53f593-c9c9-478d-bc1b-f0315d8eb2a5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:09:01 user nova-compute[73188]: DEBUG nova.compute.manager [req-8312cfaf-d8f7-405a-b48e-89cec69819af req-93884c1e-8f7d-4c45-a057-f528bb684007 service nova] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Received event network-vif-deleted-b6171fcf-6d3c-4e00-b032-e62467a9ff71 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:09:01 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:09:01 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Took 2.05 seconds to deallocate network for instance.
Aug 15 19:09:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:01 user nova-compute[73188]: DEBUG nova.compute.manager [req-8159e4c7-f6ef-42e3-8a51-b4fb07cd540f req-5553788b-3551-4a98-a9cb-75db7e8aa10f service nova] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Received event network-vif-deleted-a9ef2f68-c2c1-464b-8942-572fe28ceba3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:09:01 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:09:01 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:09:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.618s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:01 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Deleted allocations for instance e8b88f49-7f48-4170-af8a-aa1de706f218
Aug 15 19:09:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-59bf0beb-6fe2-49e9-ab0c-6dcec8e89356 tempest-VolumesAssistedSnapshotsTest-814188799 tempest-VolumesAssistedSnapshotsTest-814188799-project-member] Lock "e8b88f49-7f48-4170-af8a-aa1de706f218" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.958s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:02 user nova-compute[73188]: INFO nova.compute.manager [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Took 2.88 seconds to detach 3 volumes for instance.
Aug 15 19:09:02 user nova-compute[73188]: INFO nova.compute.manager [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Took 3.14 seconds to detach 3 volumes for instance.
Aug 15 19:09:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:03 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:09:03 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:09:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.445s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:03 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Deleted allocations for instance deb3ccb4-136f-4873-959d-edecdc436291
Aug 15 19:09:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-265dbda6-60fd-4935-ab9a-23388acbcce9 tempest-TaggedBootDevicesTest_v242-1842772812 tempest-TaggedBootDevicesTest_v242-1842772812-project-member] Lock "deb3ccb4-136f-4873-959d-edecdc436291" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.466s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:03 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:09:03 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:09:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.475s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:03 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Deleted allocations for instance 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b
Aug 15 19:09:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f339135f-af33-48d9-b5fa-c2a19ac86641 tempest-TaggedBootDevicesTest-2132869133 tempest-TaggedBootDevicesTest-2132869133-project-member] Lock "03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.027s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Acquiring lock "588767b7-fc11-4c92-9404-cf1333b53748" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "588767b7-fc11-4c92-9404-cf1333b53748" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Acquiring lock "588767b7-fc11-4c92-9404-cf1333b53748-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "588767b7-fc11-4c92-9404-cf1333b53748-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "588767b7-fc11-4c92-9404-cf1333b53748-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:04 user nova-compute[73188]: INFO nova.compute.manager [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Terminating instance
Aug 15 19:09:04 user nova-compute[73188]: DEBUG nova.compute.manager [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:09:04 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692126529.913236, 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:09:04 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] VM Stopped (Lifecycle Event)
Aug 15 19:09:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:04 user nova-compute[73188]: DEBUG nova.compute.manager [None req-83b073d7-26c8-4f7f-91ab-4c4c986a56f1 None None] [instance: 03f0cb2f-e52f-46b2-868b-2a3dd5d8a54b] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:09:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:05 user nova-compute[73188]: DEBUG nova.compute.manager [req-f776fbc6-9b5a-4401-a055-1d43dd44ed14 req-f5c2824a-40da-4063-935b-09ea1239ba5f service nova] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Received event network-vif-unplugged-fc0af479-6591-486e-b7c7-bd9a9205ead9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:09:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f776fbc6-9b5a-4401-a055-1d43dd44ed14 req-f5c2824a-40da-4063-935b-09ea1239ba5f service nova] Acquiring lock "588767b7-fc11-4c92-9404-cf1333b53748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f776fbc6-9b5a-4401-a055-1d43dd44ed14 req-f5c2824a-40da-4063-935b-09ea1239ba5f service nova] Lock "588767b7-fc11-4c92-9404-cf1333b53748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f776fbc6-9b5a-4401-a055-1d43dd44ed14 req-f5c2824a-40da-4063-935b-09ea1239ba5f service nova] Lock "588767b7-fc11-4c92-9404-cf1333b53748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:05 user nova-compute[73188]: DEBUG nova.compute.manager [req-f776fbc6-9b5a-4401-a055-1d43dd44ed14 req-f5c2824a-40da-4063-935b-09ea1239ba5f service nova] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] No waiting events found dispatching network-vif-unplugged-fc0af479-6591-486e-b7c7-bd9a9205ead9 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:09:05 user nova-compute[73188]: DEBUG nova.compute.manager [req-f776fbc6-9b5a-4401-a055-1d43dd44ed14 req-f5c2824a-40da-4063-935b-09ea1239ba5f service nova] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Received event network-vif-unplugged-fc0af479-6591-486e-b7c7-bd9a9205ead9 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:09:05 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Instance destroyed successfully.
Aug 15 19:09:05 user nova-compute[73188]: DEBUG nova.objects.instance [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lazy-loading 'resources' on Instance uuid 588767b7-fc11-4c92-9404-cf1333b53748 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:09:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1237541807',display_name='tempest-ServersNegativeTestJSON-server-1237541807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1237541807',id=12,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:07:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f959aaaf0fe4406a723804e59eb47ae',ramdisk_id='',reservation_id='r-lj6ilu3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1086586370',owner_user_name='tempest-ServersNegativeTestJSON-1086586370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:07:22Z,user_data=None,user_id='86c870adbae94c43808f8418d9c8aebd',uuid=588767b7-fc11-4c92-9404-cf1333b53748,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc0af479-6591-486e-b7c7-bd9a9205ead9", "address": "fa:16:3e:1e:8f:5e", "network": {"id": "8c59b78f-940b-409a-a485-2ee269ef8a5f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2048234860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f959aaaf0fe4406a723804e59eb47ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0af479-65", "ovs_interfaceid": "fc0af479-6591-486e-b7c7-bd9a9205ead9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:09:05 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Converting VIF {"id": "fc0af479-6591-486e-b7c7-bd9a9205ead9", "address": "fa:16:3e:1e:8f:5e", "network": {"id": "8c59b78f-940b-409a-a485-2ee269ef8a5f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2048234860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f959aaaf0fe4406a723804e59eb47ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc0af479-65", "ovs_interfaceid": "fc0af479-6591-486e-b7c7-bd9a9205ead9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:09:05 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:8f:5e,bridge_name='br-int',has_traffic_filtering=True,id=fc0af479-6591-486e-b7c7-bd9a9205ead9,network=Network(8c59b78f-940b-409a-a485-2ee269ef8a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc0af479-65') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:09:05 user nova-compute[73188]: DEBUG os_vif [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:8f:5e,bridge_name='br-int',has_traffic_filtering=True,id=fc0af479-6591-486e-b7c7-bd9a9205ead9,network=Network(8c59b78f-940b-409a-a485-2ee269ef8a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc0af479-65') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:09:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc0af479-65, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:09:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:09:05 user nova-compute[73188]: INFO os_vif [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:8f:5e,bridge_name='br-int',has_traffic_filtering=True,id=fc0af479-6591-486e-b7c7-bd9a9205ead9,network=Network(8c59b78f-940b-409a-a485-2ee269ef8a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc0af479-65')
Aug 15 19:09:05 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Deleting instance files /opt/stack/data/nova/instances/588767b7-fc11-4c92-9404-cf1333b53748_del
Aug 15 19:09:05 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Deletion of /opt/stack/data/nova/instances/588767b7-fc11-4c92-9404-cf1333b53748_del complete
Aug 15 19:09:05 user nova-compute[73188]: INFO nova.compute.manager [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 15 19:09:05 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:09:05 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:09:05 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692126531.0486977, deb3ccb4-136f-4873-959d-edecdc436291 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:09:06 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: deb3ccb4-136f-4873-959d-edecdc436291] VM Stopped (Lifecycle Event)
Aug 15 19:09:06 user nova-compute[73188]: DEBUG nova.compute.manager [None req-76c3c641-823f-41c5-a7df-31312d95cada None None] [instance: deb3ccb4-136f-4873-959d-edecdc436291] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:09:06 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Took 0.56 seconds to deallocate network for instance.
Aug 15 19:09:06 user nova-compute[73188]: DEBUG nova.compute.manager [req-d2c34306-35b6-43fe-b5a0-e46cdcdb7057 req-4f309f3c-6d7f-4077-b412-9669ebc60b22 service nova] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Received event network-vif-deleted-fc0af479-6591-486e-b7c7-bd9a9205ead9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:09:06 user nova-compute[73188]: INFO nova.compute.manager [req-d2c34306-35b6-43fe-b5a0-e46cdcdb7057 req-4f309f3c-6d7f-4077-b412-9669ebc60b22 service nova] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Neutron deleted interface fc0af479-6591-486e-b7c7-bd9a9205ead9; detaching it from the instance and deleting it from the info cache
Aug 15 19:09:06 user nova-compute[73188]: DEBUG nova.network.neutron [req-d2c34306-35b6-43fe-b5a0-e46cdcdb7057 req-4f309f3c-6d7f-4077-b412-9669ebc60b22 service nova] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG nova.compute.manager [req-d2c34306-35b6-43fe-b5a0-e46cdcdb7057 req-4f309f3c-6d7f-4077-b412-9669ebc60b22 service nova] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Detach interface failed, port_id=fc0af479-6591-486e-b7c7-bd9a9205ead9, reason: Instance 588767b7-fc11-4c92-9404-cf1333b53748 could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Acquiring lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Acquiring lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:06 user nova-compute[73188]: INFO nova.compute.manager [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Terminating instance
Aug 15 19:09:06 user nova-compute[73188]: DEBUG nova.compute.manager [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG nova.compute.manager [req-efb1886e-9df6-440e-b10e-145f2e9be00e req-3d107f9f-bb0e-4d1d-837c-575bd8267639 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Received event network-vif-unplugged-d54026b3-10a6-44bb-9cc1-cb52b47fbfe2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-efb1886e-9df6-440e-b10e-145f2e9be00e req-3d107f9f-bb0e-4d1d-837c-575bd8267639 service nova] Acquiring lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-efb1886e-9df6-440e-b10e-145f2e9be00e req-3d107f9f-bb0e-4d1d-837c-575bd8267639 service nova] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-efb1886e-9df6-440e-b10e-145f2e9be00e req-3d107f9f-bb0e-4d1d-837c-575bd8267639 service nova] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG nova.compute.manager [req-efb1886e-9df6-440e-b10e-145f2e9be00e req-3d107f9f-bb0e-4d1d-837c-575bd8267639 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] No waiting events found dispatching network-vif-unplugged-d54026b3-10a6-44bb-9cc1-cb52b47fbfe2 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG nova.compute.manager [req-efb1886e-9df6-440e-b10e-145f2e9be00e req-3d107f9f-bb0e-4d1d-837c-575bd8267639 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Received event network-vif-unplugged-d54026b3-10a6-44bb-9cc1-cb52b47fbfe2 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:09:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:06 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Deleted allocations for instance 588767b7-fc11-4c92-9404-cf1333b53748
Aug 15 19:09:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f43f065e-a74b-48bb-bdbe-ef12ba95c004 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "588767b7-fc11-4c92-9404-cf1333b53748" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.026s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:07 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Instance destroyed successfully.
Aug 15 19:09:07 user nova-compute[73188]: DEBUG nova.objects.instance [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lazy-loading 'resources' on Instance uuid 069eb3a9-59dc-45aa-a664-712ebbbad7e7 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:09:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T19:05:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-346712273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-346712273',id=7,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI7jXbeKw9zkf9/iIPvh7NB96wHBiVSd3tkGEgzRo7xcm/prE4XrAY5tS3bsMANa/m2oKIroukS/BgU5oVeuE62dlrCZmBmzDdHgRhV9W1LqC6AQ0bblC4H1qHiGzHZfg==',key_name='tempest-keypair-223053783',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:06:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb6846c6807243379e6b5de3868c2fb2',ramdisk_id='',reservation_id='r-krs477l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-241567705',owner_user_name='tempest-TaggedAttachmentsTest-241567705-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:06:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42c99d8a73ce4d2c9a6c98ebcec844bf',uuid=069eb3a9-59dc-45aa-a664-712ebbbad7e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "address": "fa:16:3e:99:31:c4", "network": {"id": "b0e519b5-4707-426d-b7c1-d5fc433bfbaa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2015894405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54026b3-10", "ovs_interfaceid": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:09:07 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Converting VIF {"id": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "address": "fa:16:3e:99:31:c4", "network": {"id": "b0e519b5-4707-426d-b7c1-d5fc433bfbaa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2015894405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6846c6807243379e6b5de3868c2fb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54026b3-10", "ovs_interfaceid": "d54026b3-10a6-44bb-9cc1-cb52b47fbfe2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:09:07 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:31:c4,bridge_name='br-int',has_traffic_filtering=True,id=d54026b3-10a6-44bb-9cc1-cb52b47fbfe2,network=Network(b0e519b5-4707-426d-b7c1-d5fc433bfbaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd54026b3-10') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:09:07 user nova-compute[73188]: DEBUG os_vif [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:31:c4,bridge_name='br-int',has_traffic_filtering=True,id=d54026b3-10a6-44bb-9cc1-cb52b47fbfe2,network=Network(b0e519b5-4707-426d-b7c1-d5fc433bfbaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd54026b3-10') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:09:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd54026b3-10, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:09:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:09:07 user nova-compute[73188]: INFO os_vif [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:31:c4,bridge_name='br-int',has_traffic_filtering=True,id=d54026b3-10a6-44bb-9cc1-cb52b47fbfe2,network=Network(b0e519b5-4707-426d-b7c1-d5fc433bfbaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd54026b3-10')
Aug 15 19:09:07 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Deleting instance files /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7_del
Aug 15 19:09:07 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Deletion of /opt/stack/data/nova/instances/069eb3a9-59dc-45aa-a664-712ebbbad7e7_del complete
Aug 15 19:09:07 user nova-compute[73188]: INFO nova.compute.manager [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 15 19:09:07 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:09:07 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:09:07 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:09:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-fa4365be-059f-417f-87a7-27c008ad983f req-ab7f9266-4230-4bfc-bff9-f387695be1b6 service nova] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Received event network-vif-plugged-fc0af479-6591-486e-b7c7-bd9a9205ead9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:09:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fa4365be-059f-417f-87a7-27c008ad983f req-ab7f9266-4230-4bfc-bff9-f387695be1b6 service nova] Acquiring lock "588767b7-fc11-4c92-9404-cf1333b53748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fa4365be-059f-417f-87a7-27c008ad983f req-ab7f9266-4230-4bfc-bff9-f387695be1b6 service nova] Lock "588767b7-fc11-4c92-9404-cf1333b53748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fa4365be-059f-417f-87a7-27c008ad983f req-ab7f9266-4230-4bfc-bff9-f387695be1b6 service nova] Lock "588767b7-fc11-4c92-9404-cf1333b53748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-fa4365be-059f-417f-87a7-27c008ad983f req-ab7f9266-4230-4bfc-bff9-f387695be1b6 service nova] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] No waiting events found dispatching network-vif-plugged-fc0af479-6591-486e-b7c7-bd9a9205ead9 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:09:07 user nova-compute[73188]: WARNING nova.compute.manager [req-fa4365be-059f-417f-87a7-27c008ad983f req-ab7f9266-4230-4bfc-bff9-f387695be1b6 service nova] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Received unexpected event network-vif-plugged-fc0af479-6591-486e-b7c7-bd9a9205ead9 for instance with vm_state deleted and task_state None.
Aug 15 19:09:08 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:09:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-90ba274e-e4d7-4aaf-bd80-fc429c885f99 req-1bcfe241-b65a-4c28-b3b8-133fb86e676e service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Received event network-vif-deleted-d54026b3-10a6-44bb-9cc1-cb52b47fbfe2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:09:08 user nova-compute[73188]: INFO nova.compute.manager [req-90ba274e-e4d7-4aaf-bd80-fc429c885f99 req-1bcfe241-b65a-4c28-b3b8-133fb86e676e service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Neutron deleted interface d54026b3-10a6-44bb-9cc1-cb52b47fbfe2; detaching it from the instance and deleting it from the info cache
Aug 15 19:09:08 user nova-compute[73188]: DEBUG nova.network.neutron [req-90ba274e-e4d7-4aaf-bd80-fc429c885f99 req-1bcfe241-b65a-4c28-b3b8-133fb86e676e service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:09:08 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Took 1.04 seconds to deallocate network for instance.
Aug 15 19:09:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-90ba274e-e4d7-4aaf-bd80-fc429c885f99 req-1bcfe241-b65a-4c28-b3b8-133fb86e676e service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Detach interface failed, port_id=d54026b3-10a6-44bb-9cc1-cb52b47fbfe2, reason: Instance 069eb3a9-59dc-45aa-a664-712ebbbad7e7 could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:09:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:08 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:09:08 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:09:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:08 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Deleted allocations for instance 069eb3a9-59dc-45aa-a664-712ebbbad7e7
Aug 15 19:09:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-f4c95616-3930-44aa-8330-401df73ef03a req-ebadeb3b-59f6-4e36-bdda-beea3c3ce955 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Received event network-vif-plugged-d54026b3-10a6-44bb-9cc1-cb52b47fbfe2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:09:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f4c95616-3930-44aa-8330-401df73ef03a req-ebadeb3b-59f6-4e36-bdda-beea3c3ce955 service nova] Acquiring lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f4c95616-3930-44aa-8330-401df73ef03a req-ebadeb3b-59f6-4e36-bdda-beea3c3ce955 service nova] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f4c95616-3930-44aa-8330-401df73ef03a req-ebadeb3b-59f6-4e36-bdda-beea3c3ce955 service nova] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-f4c95616-3930-44aa-8330-401df73ef03a req-ebadeb3b-59f6-4e36-bdda-beea3c3ce955 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] No waiting events found dispatching network-vif-plugged-d54026b3-10a6-44bb-9cc1-cb52b47fbfe2 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:09:08 user nova-compute[73188]: WARNING nova.compute.manager [req-f4c95616-3930-44aa-8330-401df73ef03a req-ebadeb3b-59f6-4e36-bdda-beea3c3ce955 service nova] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Received unexpected event network-vif-plugged-d54026b3-10a6-44bb-9cc1-cb52b47fbfe2 for instance with vm_state deleted and task_state None.
Aug 15 19:09:08 user nova-compute[73188]: DEBUG nova.objects.instance [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lazy-loading 'flavor' on Instance uuid d1b5f5bf-9672-40a8-83da-3a8f25007e91 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:09:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d446b5b7-ed39-42cb-88c4-81dfa1383efd tempest-TaggedAttachmentsTest-241567705 tempest-TaggedAttachmentsTest-241567705-project-member] Lock "069eb3a9-59dc-45aa-a664-712ebbbad7e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.551s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:08 user nova-compute[73188]: INFO nova.compute.manager [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Attaching volume a56bdc00-9527-4777-a55c-7791842e4c65 to /dev/vdb
Aug 15 19:09:09 user nova-compute[73188]: DEBUG os_brick.utils [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d270df10-1ac4-414d-a67d-6c89f067c81e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc3162e-fd0a-43c7-ba32-171f950e8411]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd151de-7463-40d6-991b-e9eae9cd4936]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b4acdb-a92b-4812-99b2-46ca480e4385]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:09:09 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:09:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d65d2ad-3548-4a50-9de9-157274d965d1]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG os_brick.utils [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Updating existing volume attachment record: 66565f9a-d6d4-4ea1-9080-1f39de878bd5 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:09:09 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:09:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:11 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:09:11 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:09:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-c3ca002b-c535-4b87-8d39-861ce6847f12" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:09:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-c3ca002b-c535-4b87-8d39-861ce6847f12" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:09:11 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:09:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:12 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Updating instance_info_cache with network_info: [{"id": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "address": "fa:16:3e:ce:f4:29", "network": {"id": "574343fe-52ff-4be4-9622-e61a33db8396", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-946260414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4761b15a8dae4f7cab8c13ace5b42ddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933ca0dd-f8", "ovs_interfaceid": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:09:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-c3ca002b-c535-4b87-8d39-861ce6847f12" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:09:12 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:09:12 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:09:12 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:09:12 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:09:13 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:09:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:09:13 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:09:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:13 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:09:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:09:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:13 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692126538.8376603, e8b88f49-7f48-4170-af8a-aa1de706f218 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:09:13 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] VM Stopped (Lifecycle Event)
Aug 15 19:09:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8726f244-4471-4e5c-a6b8-e44f87cbbfd5 None None] [instance: e8b88f49-7f48-4170-af8a-aa1de706f218] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:09:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:09:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:09:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:17 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:09:17 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:09:17 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=7427MB free_disk=25.64923095703125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:09:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:17 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:09:17 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance d1b5f5bf-9672-40a8-83da-3a8f25007e91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:09:17 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 7caf434b-1484-4832-afee-0e2454bb5089 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:09:17 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance c3ca002b-c535-4b87-8d39-861ce6847f12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:09:17 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 0d5df01f-2a14-423a-9872-69132a3874ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:09:17 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance fd74b385-fcfa-4a38-b869-0f5a8328188c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:09:17 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3d713d03-3e60-4dec-a295-a4652ac21842 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:09:17 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 082c19a9-6a4f-4f27-8c77-d37db7d2306a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:09:17 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:09:17 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:09:17 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:09:17 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:09:17 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:09:17 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:09:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:18 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:09:18 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUBLTriK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:09:19 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:09:19 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:09:19 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa00f806-560c-4320-93ef-dfed4f46043a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:09:19 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cfd137-914d-4f41-ae17-367e7fc7602d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65] added
Aug 15 19:09:19 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[878626e4-49ca-4fb7-8474-ae66998f7a18]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaabd8f-aa74-40e2-ab92-03732ff1bfbe]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUBLTriK {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUBLTriK" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9447dbcb-7e48-47a2-bd93-90797b2d5bbb]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cUBLTriK'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5b75cd-c97e-4972-a691-eafa5b3440fc]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e14e434-05d7-4830-852e-d974351aa40a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:09:19 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:09:19 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:09:19 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:09:19 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:09:19 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:09:19 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a85d5c-ed3d-4f76-824c-e9e55d673caf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260]
Aug 15 19:09:19 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260] successful.
Aug 15 19:09:19 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[de57f3c0-abda-4b8b-8e88-cb87e4401d7b]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[04446f35-c21a-487f-becc-5f1d37511387]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:09:19 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:09:19 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:09:19 user nova-compute[73188]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)
Aug 15 19:09:19 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:09:19 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:09:19 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:09:19 user nova-compute[73188]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)
Aug 15 19:09:19 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf353d6-8855-4e5e-ae4d-c69e522dc235]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:09:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUBLTriK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:09:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:20 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692126545.4861386, 588767b7-fc11-4c92-9404-cf1333b53748 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:09:20 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] VM Stopped (Lifecycle Event)
Aug 15 19:09:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-49c71d9c-e6f2-42ed-bc67-751d0f3ade31 None None] [instance: 588767b7-fc11-4c92-9404-cf1333b53748] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:09:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:09:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23833613130326337', 'path': '/dev/sdc'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:09:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833613130326337', 'path': '/dev/sdc'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:09:20 user nova-compute[73188]: DEBUG nova.objects.instance [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lazy-loading 'flavor' on Instance uuid d1b5f5bf-9672-40a8-83da-3a8f25007e91 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:09:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:09:20 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:09:20 user nova-compute[73188]:   <source dev="/dev/sdc"/>
Aug 15 19:09:20 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:09:20 user nova-compute[73188]:   <serial>a56bdc00-9527-4777-a55c-7791842e4c65</serial>
Aug 15 19:09:20 user nova-compute[73188]: </disk>
Aug 15 19:09:20 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:09:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:21 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:09:21 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:09:21 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] No VIF found with MAC fa:16:3e:10:5e:42, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:09:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cf1f8c-3e2f-4509-822d-38bd263faadf tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.404s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:22 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692126547.0856893, 069eb3a9-59dc-45aa-a664-712ebbbad7e7 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:09:22 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] VM Stopped (Lifecycle Event)
Aug 15 19:09:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-01138969-b79d-46f9-8d6f-1d9931f0f908 None None] [instance: 069eb3a9-59dc-45aa-a664-712ebbbad7e7] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:09:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:23 user nova-compute[73188]: DEBUG nova.compute.manager [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Stashing vm_state: active {{(pid=73188) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 15 19:09:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:23 user nova-compute[73188]: DEBUG nova.objects.instance [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lazy-loading 'pci_requests' on Instance uuid d1b5f5bf-9672-40a8-83da-3a8f25007e91 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:09:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:09:23 user nova-compute[73188]: INFO nova.compute.claims [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Claim successful on node user
Aug 15 19:09:23 user nova-compute[73188]: DEBUG nova.objects.instance [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lazy-loading 'resources' on Instance uuid d1b5f5bf-9672-40a8-83da-3a8f25007e91 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:09:23 user nova-compute[73188]: DEBUG nova.objects.instance [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lazy-loading 'pci_devices' on Instance uuid d1b5f5bf-9672-40a8-83da-3a8f25007e91 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:09:23 user nova-compute[73188]: INFO nova.compute.resource_tracker [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Updating resource usage from migration a18c76a8-2919-4104-9914-c7a6c3903ca4
Aug 15 19:09:23 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:09:23 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:09:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.520s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:23 user nova-compute[73188]: INFO nova.compute.manager [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Migrating
Aug 15 19:09:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:09:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:09:23 user nova-compute[73188]: INFO nova.compute.rpcapi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 15 19:09:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:09:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:09:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquired lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:09:23 user nova-compute[73188]: DEBUG nova.network.neutron [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:09:24 user nova-compute[73188]: DEBUG nova.network.neutron [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Updating instance_info_cache with network_info: [{"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:09:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Releasing lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Starting migrate_disk_and_power_off {{(pid=73188) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "e00adf53-085f-436d-a09f-e97e92ca79cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "e00adf53-085f-436d-a09f-e97e92ca79cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:09:25 user nova-compute[73188]: INFO nova.compute.claims [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Claim successful on node user
Aug 15 19:09:25 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:09:25 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Instance destroyed successfully.
Aug 15 19:09:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2075783787',display_name='tempest-ServerActionsTestOtherB-server-2075783787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2075783787',id=2,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGAn2WMlt73NTUykPIA6PkYCDLbBTR2Yho5Rj2kET8coL/tBEtc4GHmcnA5ijjJ1l2hsUy4+ooa5E/SUoQZ5kfWNtXI5i4fVvpa+4mLZw6dteSEtg5YyfVDHt6PHs7vAQ==',key_name='tempest-keypair-93276017',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:05:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='418458ca9ca647788ef8dd45ced52707',ramdisk_id='',reservation_id='r-36kpwfhi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1641219687',owner_user_name='tempest-ServerActionsTestOtherB-1641219687-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60be9c6b4c1b4f4b9038a3a6af7c3648',uuid=d1b5f5bf-9672-40a8-83da-3a8f25007e91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1438605342-network", "vif_mac": "fa:16:3e:10:5e:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Converting VIF {"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1438605342-network", "vif_mac": "fa:16:3e:10:5e:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:5e:42,bridge_name='br-int',has_traffic_filtering=True,id=d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a,network=Network(10d6e7cc-813b-43e5-850a-cbdd4bd41525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5133aa6-a8') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG os_vif [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:5e:42,bridge_name='br-int',has_traffic_filtering=True,id=d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a,network=Network(10d6e7cc-813b-43e5-850a-cbdd4bd41525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5133aa6-a8') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5133aa6-a8, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:09:25 user nova-compute[73188]: INFO os_vif [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:5e:42,bridge_name='br-int',has_traffic_filtering=True,id=d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a,network=Network(10d6e7cc-813b-43e5-850a-cbdd4bd41525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5133aa6-a8')
Aug 15 19:09:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG nova.network.neutron [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUBLTriK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:09:25 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:09:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:25 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcc36bd-f833-4df5-b359-d93a4f4b896c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd53108-901c-47d2-801a-2fce24b9c534]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:09:25 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:09:25 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:09:25 user nova-compute[73188]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)
Aug 15 19:09:25 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:09:25 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:09:25 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:09:25 user nova-compute[73188]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)
Aug 15 19:09:25 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f280818bf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65'): ({'sdc'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Removing single pathed devices sdc {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[35420fbd-16f6-4067-9b03-dd7a51eed79f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG nova.policy [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c30de55a2834422c8f6df816899b881e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c085a0ccf841e297d98037c07a7111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cd8e1e-3e70-4725-a752-060e64363206]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Flushing IO for device /dev/sdc {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[32711a26-674c-4d70-9fb8-a80163b066cf]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:09:25 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Creating image(s)
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "/opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "/opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "/opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1e8f91-104a-4629-93c0-34d72e6c2168]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] SCSI volumes sdc have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e364ee17-b95f-4d50-b84e-f47c992a4362]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc649d9-c05a-4995-b944-40f422663bf4]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260]
Aug 15 19:09:26 user nova-compute[73188]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260] successful.
Aug 15 19:09:26 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02ea60f-5451-4b40-bde3-01f4408c1001]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] <== disconnect_volume: return (322ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.213s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.185s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk 1073741824" returned: 0 in 0.047s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91_resize/disk /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG nova.network.neutron [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Successfully created port: 4646dbfd-e829-4653-9e76-e34901f8ad33 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Cannot resize image /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG nova.objects.instance [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'migration_context' on Instance uuid e00adf53-085f-436d-a09f-e97e92ca79cd {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Ensure instance console log exists: /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] CMD "cp -r /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91_resize/disk /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk" returned: 0 in 0.417s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91_resize/disk.info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk.info {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] CMD "cp -r /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91_resize/disk.info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk.info" returned: 0 in 0.036s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.network.neutron [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Successfully updated port: 4646dbfd-e829-4653-9e76-e34901f8ad33 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "refresh_cache-e00adf53-085f-436d-a09f-e97e92ca79cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquired lock "refresh_cache-e00adf53-085f-436d-a09f-e97e92ca79cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.network.neutron [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.compute.manager [req-353cdf08-fc4b-46e7-be6d-a64d0bc4d8c2 req-0a01d9da-dd73-4fe1-bd52-dcf873f620c8 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Received event network-changed-4646dbfd-e829-4653-9e76-e34901f8ad33 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.compute.manager [req-353cdf08-fc4b-46e7-be6d-a64d0bc4d8c2 req-0a01d9da-dd73-4fe1-bd52-dcf873f620c8 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Refreshing instance network info cache due to event network-changed-4646dbfd-e829-4653-9e76-e34901f8ad33. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-353cdf08-fc4b-46e7-be6d-a64d0bc4d8c2 req-0a01d9da-dd73-4fe1-bd52-dcf873f620c8 service nova] Acquiring lock "refresh_cache-e00adf53-085f-436d-a09f-e97e92ca79cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.network.neutron [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.network.neutron [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Updating instance_info_cache with network_info: [{"id": "4646dbfd-e829-4653-9e76-e34901f8ad33", "address": "fa:16:3e:db:be:12", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4646dbfd-e8", "ovs_interfaceid": "4646dbfd-e829-4653-9e76-e34901f8ad33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Releasing lock "refresh_cache-e00adf53-085f-436d-a09f-e97e92ca79cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Instance network_info: |[{"id": "4646dbfd-e829-4653-9e76-e34901f8ad33", "address": "fa:16:3e:db:be:12", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4646dbfd-e8", "ovs_interfaceid": "4646dbfd-e829-4653-9e76-e34901f8ad33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-353cdf08-fc4b-46e7-be6d-a64d0bc4d8c2 req-0a01d9da-dd73-4fe1-bd52-dcf873f620c8 service nova] Acquired lock "refresh_cache-e00adf53-085f-436d-a09f-e97e92ca79cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.network.neutron [req-353cdf08-fc4b-46e7-be6d-a64d0bc4d8c2 req-0a01d9da-dd73-4fe1-bd52-dcf873f620c8 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Refreshing network info cache for port 4646dbfd-e829-4653-9e76-e34901f8ad33 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Start _get_guest_xml network_info=[{"id": "4646dbfd-e829-4653-9e76-e34901f8ad33", "address": "fa:16:3e:db:be:12", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4646dbfd-e8", "ovs_interfaceid": "4646dbfd-e829-4653-9e76-e34901f8ad33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:09:27 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:09:27 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-781006402',display_name='tempest-ServerActionsTestOtherA-server-781006402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-781006402',id=16,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIh7IYSXIzW76yUh0lcXYRIDkLihwOuaxeqKxDoqlHxog01X1wGWUVb+WSkm+7EoRfQvo2EKI4l4BqBnCc2BP7hJFNq/yIn4BoRVp0zONEwe3FPB6tn+4jOCYVx7bU/R3g==',key_name='tempest-keypair-1497630278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c085a0ccf841e297d98037c07a7111',ramdisk_id='',reservation_id='r-fh9zf6pp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2026424764',owner_user_name='tempest-ServerActionsTestOtherA-2026424764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:09:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30de55a2834422c8f6df816899b881e',uuid=e00adf53-085f-436d-a09f-e97e92ca79cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4646dbfd-e829-4653-9e76-e34901f8ad33", "address": "fa:16:3e:db:be:12", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4646dbfd-e8", "ovs_interfaceid": "4646dbfd-e829-4653-9e76-e34901f8ad33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converting VIF {"id": "4646dbfd-e829-4653-9e76-e34901f8ad33", "address": "fa:16:3e:db:be:12", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4646dbfd-e8", "ovs_interfaceid": "4646dbfd-e829-4653-9e76-e34901f8ad33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:be:12,bridge_name='br-int',has_traffic_filtering=True,id=4646dbfd-e829-4653-9e76-e34901f8ad33,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4646dbfd-e8') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.objects.instance [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'pci_devices' on Instance uuid e00adf53-085f-436d-a09f-e97e92ca79cd {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:09:27 user nova-compute[73188]:   <uuid>e00adf53-085f-436d-a09f-e97e92ca79cd</uuid>
Aug 15 19:09:27 user nova-compute[73188]:   <name>instance-00000010</name>
Aug 15 19:09:27 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:09:27 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:09:27 user nova-compute[73188]:   <metadata>
Aug 15 19:09:27 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:09:27 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:09:27 user nova-compute[73188]:       <nova:name>tempest-ServerActionsTestOtherA-server-781006402</nova:name>
Aug 15 19:09:27 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:09:27</nova:creationTime>
Aug 15 19:09:27 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:09:27 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:09:27 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:09:27 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:09:27 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:09:27 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:09:27 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:09:27 user nova-compute[73188]:       <nova:owner>
Aug 15 19:09:27 user nova-compute[73188]:         <nova:user uuid="c30de55a2834422c8f6df816899b881e">tempest-ServerActionsTestOtherA-2026424764-project-member</nova:user>
Aug 15 19:09:27 user nova-compute[73188]:         <nova:project uuid="a3c085a0ccf841e297d98037c07a7111">tempest-ServerActionsTestOtherA-2026424764</nova:project>
Aug 15 19:09:27 user nova-compute[73188]:       </nova:owner>
Aug 15 19:09:27 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:09:27 user nova-compute[73188]:       <nova:ports>
Aug 15 19:09:27 user nova-compute[73188]:         <nova:port uuid="4646dbfd-e829-4653-9e76-e34901f8ad33">
Aug 15 19:09:27 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 19:09:27 user nova-compute[73188]:         </nova:port>
Aug 15 19:09:27 user nova-compute[73188]:       </nova:ports>
Aug 15 19:09:27 user nova-compute[73188]:     </nova:instance>
Aug 15 19:09:27 user nova-compute[73188]:   </metadata>
Aug 15 19:09:27 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:09:27 user nova-compute[73188]:     <system>
Aug 15 19:09:27 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:09:27 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:09:27 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:09:27 user nova-compute[73188]:       <entry name="serial">e00adf53-085f-436d-a09f-e97e92ca79cd</entry>
Aug 15 19:09:27 user nova-compute[73188]:       <entry name="uuid">e00adf53-085f-436d-a09f-e97e92ca79cd</entry>
Aug 15 19:09:27 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:09:27 user nova-compute[73188]:     </system>
Aug 15 19:09:27 user nova-compute[73188]:   </sysinfo>
Aug 15 19:09:27 user nova-compute[73188]:   <os>
Aug 15 19:09:27 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:09:27 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:09:27 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:09:27 user nova-compute[73188]:   </os>
Aug 15 19:09:27 user nova-compute[73188]:   <features>
Aug 15 19:09:27 user nova-compute[73188]:     <acpi/>
Aug 15 19:09:27 user nova-compute[73188]:     <apic/>
Aug 15 19:09:27 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:09:27 user nova-compute[73188]:   </features>
Aug 15 19:09:27 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:09:27 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:09:27 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:09:27 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:09:27 user nova-compute[73188]:   </clock>
Aug 15 19:09:27 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:09:27 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:09:27 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:09:27 user nova-compute[73188]:   </cpu>
Aug 15 19:09:27 user nova-compute[73188]:   <devices>
Aug 15 19:09:27 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:09:27 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:09:27 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk"/>
Aug 15 19:09:27 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:09:27 user nova-compute[73188]:     </disk>
Aug 15 19:09:27 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:09:27 user nova-compute[73188]:       <mac address="fa:16:3e:db:be:12"/>
Aug 15 19:09:27 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:09:27 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:09:27 user nova-compute[73188]:       <target dev="tap4646dbfd-e8"/>
Aug 15 19:09:27 user nova-compute[73188]:     </interface>
Aug 15 19:09:27 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:09:27 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/console.log" append="off"/>
Aug 15 19:09:27 user nova-compute[73188]:     </serial>
Aug 15 19:09:27 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:09:27 user nova-compute[73188]:     <video>
Aug 15 19:09:27 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:09:27 user nova-compute[73188]:     </video>
Aug 15 19:09:27 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:09:27 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:09:27 user nova-compute[73188]:     </rng>
Aug 15 19:09:27 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:09:27 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:09:27 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:09:27 user nova-compute[73188]:     </memballoon>
Aug 15 19:09:27 user nova-compute[73188]:   </devices>
Aug 15 19:09:27 user nova-compute[73188]: </domain>
Aug 15 19:09:27 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-781006402',display_name='tempest-ServerActionsTestOtherA-server-781006402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-781006402',id=16,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIh7IYSXIzW76yUh0lcXYRIDkLihwOuaxeqKxDoqlHxog01X1wGWUVb+WSkm+7EoRfQvo2EKI4l4BqBnCc2BP7hJFNq/yIn4BoRVp0zONEwe3FPB6tn+4jOCYVx7bU/R3g==',key_name='tempest-keypair-1497630278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c085a0ccf841e297d98037c07a7111',ramdisk_id='',reservation_id='r-fh9zf6pp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2026424764',owner_user_name='tempest-ServerActionsTestOtherA-2026424764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:09:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30de55a2834422c8f6df816899b881e',uuid=e00adf53-085f-436d-a09f-e97e92ca79cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4646dbfd-e829-4653-9e76-e34901f8ad33", "address": "fa:16:3e:db:be:12", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4646dbfd-e8", "ovs_interfaceid": "4646dbfd-e829-4653-9e76-e34901f8ad33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converting VIF {"id": "4646dbfd-e829-4653-9e76-e34901f8ad33", "address": "fa:16:3e:db:be:12", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4646dbfd-e8", "ovs_interfaceid": "4646dbfd-e829-4653-9e76-e34901f8ad33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:be:12,bridge_name='br-int',has_traffic_filtering=True,id=4646dbfd-e829-4653-9e76-e34901f8ad33,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4646dbfd-e8') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG os_vif [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:be:12,bridge_name='br-int',has_traffic_filtering=True,id=4646dbfd-e829-4653-9e76-e34901f8ad33,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4646dbfd-e8') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4646dbfd-e8, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4646dbfd-e8, col_values=(('external_ids', {'iface-id': '4646dbfd-e829-4653-9e76-e34901f8ad33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:be:12', 'vm-uuid': 'e00adf53-085f-436d-a09f-e97e92ca79cd'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:27 user nova-compute[73188]: INFO os_vif [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:be:12,bridge_name='br-int',has_traffic_filtering=True,id=4646dbfd-e829-4653-9e76-e34901f8ad33,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4646dbfd-e8')
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.network.neutron [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Port d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a binding to destination host user is already ACTIVE {{(pid=73188) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:09:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] No VIF found with MAC fa:16:3e:db:be:12, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG nova.network.neutron [req-353cdf08-fc4b-46e7-be6d-a64d0bc4d8c2 req-0a01d9da-dd73-4fe1-bd52-dcf873f620c8 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Updated VIF entry in instance network info cache for port 4646dbfd-e829-4653-9e76-e34901f8ad33. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG nova.network.neutron [req-353cdf08-fc4b-46e7-be6d-a64d0bc4d8c2 req-0a01d9da-dd73-4fe1-bd52-dcf873f620c8 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Updating instance_info_cache with network_info: [{"id": "4646dbfd-e829-4653-9e76-e34901f8ad33", "address": "fa:16:3e:db:be:12", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4646dbfd-e8", "ovs_interfaceid": "4646dbfd-e829-4653-9e76-e34901f8ad33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-353cdf08-fc4b-46e7-be6d-a64d0bc4d8c2 req-0a01d9da-dd73-4fe1-bd52-dcf873f620c8 service nova] Releasing lock "refresh_cache-e00adf53-085f-436d-a09f-e97e92ca79cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquired lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG nova.network.neutron [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG nova.compute.manager [req-ce4be6d9-b9bf-4a5a-8823-ad461544efdc req-b5aa2d80-aab3-4afa-9ed1-709055207c5f service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received event network-vif-unplugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ce4be6d9-b9bf-4a5a-8823-ad461544efdc req-b5aa2d80-aab3-4afa-9ed1-709055207c5f service nova] Acquiring lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ce4be6d9-b9bf-4a5a-8823-ad461544efdc req-b5aa2d80-aab3-4afa-9ed1-709055207c5f service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ce4be6d9-b9bf-4a5a-8823-ad461544efdc req-b5aa2d80-aab3-4afa-9ed1-709055207c5f service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG nova.compute.manager [req-ce4be6d9-b9bf-4a5a-8823-ad461544efdc req-b5aa2d80-aab3-4afa-9ed1-709055207c5f service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] No waiting events found dispatching network-vif-unplugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:09:28 user nova-compute[73188]: WARNING nova.compute.manager [req-ce4be6d9-b9bf-4a5a-8823-ad461544efdc req-b5aa2d80-aab3-4afa-9ed1-709055207c5f service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received unexpected event network-vif-unplugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a for instance with vm_state active and task_state resize_migrated.
Aug 15 19:09:28 user nova-compute[73188]: DEBUG nova.network.neutron [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Updating instance_info_cache with network_info: [{"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Releasing lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG os_brick.utils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f228d03a-23e3-440b-b33b-cd4fab88b70e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d13028f-0994-4e95-911c-5c63795054d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d0a6a1-7beb-4aa6-bbfa-df22e1e09106]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[af79c8f7-8d76-493d-97e9-6241f07af977]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:09:28 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:09:28 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f65d31-42a8-4191-8cb3-bbbe75bdb00c]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:09:28 user nova-compute[73188]: DEBUG os_brick.utils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:09:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:29 user nova-compute[73188]: DEBUG nova.compute.manager [req-87cb2e08-886a-4cdc-885c-b730e9e8e962 req-177bb2d5-f763-45b0-bf58-ed98c098b274 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Received event network-vif-plugged-4646dbfd-e829-4653-9e76-e34901f8ad33 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:09:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-87cb2e08-886a-4cdc-885c-b730e9e8e962 req-177bb2d5-f763-45b0-bf58-ed98c098b274 service nova] Acquiring lock "e00adf53-085f-436d-a09f-e97e92ca79cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-87cb2e08-886a-4cdc-885c-b730e9e8e962 req-177bb2d5-f763-45b0-bf58-ed98c098b274 service nova] Lock "e00adf53-085f-436d-a09f-e97e92ca79cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-87cb2e08-886a-4cdc-885c-b730e9e8e962 req-177bb2d5-f763-45b0-bf58-ed98c098b274 service nova] Lock "e00adf53-085f-436d-a09f-e97e92ca79cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:29 user nova-compute[73188]: DEBUG nova.compute.manager [req-87cb2e08-886a-4cdc-885c-b730e9e8e962 req-177bb2d5-f763-45b0-bf58-ed98c098b274 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] No waiting events found dispatching network-vif-plugged-4646dbfd-e829-4653-9e76-e34901f8ad33 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:09:29 user nova-compute[73188]: WARNING nova.compute.manager [req-87cb2e08-886a-4cdc-885c-b730e9e8e962 req-177bb2d5-f763-45b0-bf58-ed98c098b274 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Received unexpected event network-vif-plugged-4646dbfd-e829-4653-9e76-e34901f8ad33 for instance with vm_state building and task_state spawning.
Aug 15 19:09:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:30 user nova-compute[73188]: DEBUG nova.compute.manager [req-3f9fe810-9b3a-4d2b-b22e-59eec21ea085 req-54d3c19d-d1be-4b58-b195-e22796b7cced service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received event network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:09:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3f9fe810-9b3a-4d2b-b22e-59eec21ea085 req-54d3c19d-d1be-4b58-b195-e22796b7cced service nova] Acquiring lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3f9fe810-9b3a-4d2b-b22e-59eec21ea085 req-54d3c19d-d1be-4b58-b195-e22796b7cced service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3f9fe810-9b3a-4d2b-b22e-59eec21ea085 req-54d3c19d-d1be-4b58-b195-e22796b7cced service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:30 user nova-compute[73188]: DEBUG nova.compute.manager [req-3f9fe810-9b3a-4d2b-b22e-59eec21ea085 req-54d3c19d-d1be-4b58-b195-e22796b7cced service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] No waiting events found dispatching network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:09:30 user nova-compute[73188]: WARNING nova.compute.manager [req-3f9fe810-9b3a-4d2b-b22e-59eec21ea085 req-54d3c19d-d1be-4b58-b195-e22796b7cced service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received unexpected event network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a for instance with vm_state active and task_state resize_finish.
Aug 15 19:09:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:31 user nova-compute[73188]: DEBUG nova.compute.manager [req-99db0d4a-6e0e-49da-b781-44953d125597 req-0a7c32fb-c04b-4c41-92fc-d0c9cde4e4a7 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Received event network-vif-plugged-4646dbfd-e829-4653-9e76-e34901f8ad33 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:09:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-99db0d4a-6e0e-49da-b781-44953d125597 req-0a7c32fb-c04b-4c41-92fc-d0c9cde4e4a7 service nova] Acquiring lock "e00adf53-085f-436d-a09f-e97e92ca79cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-99db0d4a-6e0e-49da-b781-44953d125597 req-0a7c32fb-c04b-4c41-92fc-d0c9cde4e4a7 service nova] Lock "e00adf53-085f-436d-a09f-e97e92ca79cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-99db0d4a-6e0e-49da-b781-44953d125597 req-0a7c32fb-c04b-4c41-92fc-d0c9cde4e4a7 service nova] Lock "e00adf53-085f-436d-a09f-e97e92ca79cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:31 user nova-compute[73188]: DEBUG nova.compute.manager [req-99db0d4a-6e0e-49da-b781-44953d125597 req-0a7c32fb-c04b-4c41-92fc-d0c9cde4e4a7 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] No waiting events found dispatching network-vif-plugged-4646dbfd-e829-4653-9e76-e34901f8ad33 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:09:31 user nova-compute[73188]: WARNING nova.compute.manager [req-99db0d4a-6e0e-49da-b781-44953d125597 req-0a7c32fb-c04b-4c41-92fc-d0c9cde4e4a7 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Received unexpected event network-vif-plugged-4646dbfd-e829-4653-9e76-e34901f8ad33 for instance with vm_state building and task_state spawning.
Aug 15 19:09:31 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126571.5882978, e00adf53-085f-436d-a09f-e97e92ca79cd => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:09:31 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] VM Resumed (Lifecycle Event)
Aug 15 19:09:31 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:09:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:09:31 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Instance spawned successfully.
Aug 15 19:09:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:09:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:09:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:09:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:09:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:09:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:09:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:09:31 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:09:31 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:09:31 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:09:31 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126571.590032, e00adf53-085f-436d-a09f-e97e92ca79cd => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:09:31 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] VM Started (Lifecycle Event)
Aug 15 19:09:31 user nova-compute[73188]: INFO nova.compute.manager [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Took 5.73 seconds to spawn the instance on the hypervisor.
Aug 15 19:09:31 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:09:31 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:09:31 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:09:31 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:09:31 user nova-compute[73188]: INFO nova.compute.manager [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Took 6.44 seconds to build instance.
Aug 15 19:09:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c856f0e0-0557-4309-80ee-52cc960373a9 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "e00adf53-085f-436d-a09f-e97e92ca79cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.539s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Starting finish_migration {{(pid=73188) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Instance directory exists: not creating {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 19:09:38 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Creating image(s)
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.objects.instance [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lazy-loading 'trusted_certs' on Instance uuid d1b5f5bf-9672-40a8-83da-3a8f25007e91 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.182s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk. size=21474836480 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk 21474836480 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk 21474836480" returned: 0 in 0.049s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Did not create local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Ensure instance console log exists: /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Start _get_guest_xml network_info=[{"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1438605342-network", "vif_mac": "fa:16:3e:10:5e:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUBLTriK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd1b5f5bf-9672-40a8-83da-3a8f25007e91', 'attached_at': '2023-08-15T19:09:38.000000', 'detached_at': '', 'volume_id': 'a56bdc00-9527-4777-a55c-7791842e4c65', 'serial': 'a56bdc00-9527-4777-a55c-7791842e4c65'}, 'attachment_id': '5dc25821-b640-42dd-86c0-b2743602bc4a', 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:09:38 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:09:38 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.objects.instance [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lazy-loading 'vcpu_model' on Instance uuid d1b5f5bf-9672-40a8-83da-3a8f25007e91 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUBLTriK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:09:38 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:09:38 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:09:38 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:09:38 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:09:38 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c38c169-6595-44cc-955b-98c7a59d001d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:09:38 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[85df1723-79f0-4696-b59f-080d8e1f76bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65] added
Aug 15 19:09:38 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fc504e-919a-4cba-acf3-c5e272bcf9e1]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3ea580-c301-4fe2-9022-7e053b3a1f2c]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUBLTriK {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUBLTriK" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba134d8-b09c-4e4d-9e49-dd43359cff35]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cUBLTriK'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2d0b2e-a637-44f6-9dd9-47e5c33242e0]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd262f3c-d1c8-4494-ba33-d9ecb7f6de38]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:09:38 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:09:38 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:09:38 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:09:38 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:09:38 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:09:38 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4121c995-387c-46c2-bd77-62a51065be5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260]
Aug 15 19:09:38 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260] successful.
Aug 15 19:09:38 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc5985b-059d-4164-ba5f-fdfcf4e8c98f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a6dc9a-8450-4757-b358-26a795942926]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:09:38 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:09:38 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:09:38 user nova-compute[73188]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)
Aug 15 19:09:38 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:09:38 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:09:38 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:09:38 user nova-compute[73188]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)
Aug 15 19:09:38 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:09:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:09:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:09:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57a6fdd-d422-4bc3-8590-54a1bd21f3c8]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:09:39 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: None {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUBLTriK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23833613130326337', 'path': '/dev/sdc'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833613130326337', 'path': '/dev/sdc'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2075783787',display_name='tempest-ServerActionsTestOtherB-server-2075783787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2075783787',id=2,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGAn2WMlt73NTUykPIA6PkYCDLbBTR2Yho5Rj2kET8coL/tBEtc4GHmcnA5ijjJ1l2hsUy4+ooa5E/SUoQZ5kfWNtXI5i4fVvpa+4mLZw6dteSEtg5YyfVDHt6PHs7vAQ==',key_name='tempest-keypair-93276017',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:05:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='418458ca9ca647788ef8dd45ced52707',ramdisk_id='',reservation_id='r-36kpwfhi',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1641219687',owner_user_name='tempest-ServerActionsTestOtherB-1641219687-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:09:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60be9c6b4c1b4f4b9038a3a6af7c3648',uuid=d1b5f5bf-9672-40a8-83da-3a8f25007e91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1438605342-network", "vif_mac": "fa:16:3e:10:5e:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Converting VIF {"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1438605342-network", "vif_mac": "fa:16:3e:10:5e:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:5e:42,bridge_name='br-int',has_traffic_filtering=True,id=d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a,network=Network(10d6e7cc-813b-43e5-850a-cbdd4bd41525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5133aa6-a8') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:09:40 user nova-compute[73188]:   <uuid>d1b5f5bf-9672-40a8-83da-3a8f25007e91</uuid>
Aug 15 19:09:40 user nova-compute[73188]:   <name>instance-00000002</name>
Aug 15 19:09:40 user nova-compute[73188]:   <memory>2097152</memory>
Aug 15 19:09:40 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:09:40 user nova-compute[73188]:   <metadata>
Aug 15 19:09:40 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:09:40 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:09:40 user nova-compute[73188]:       <nova:name>tempest-ServerActionsTestOtherB-server-2075783787</nova:name>
Aug 15 19:09:40 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:09:38</nova:creationTime>
Aug 15 19:09:40 user nova-compute[73188]:       <nova:flavor name="m1.small">
Aug 15 19:09:40 user nova-compute[73188]:         <nova:memory>2048</nova:memory>
Aug 15 19:09:40 user nova-compute[73188]:         <nova:disk>20</nova:disk>
Aug 15 19:09:40 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:09:40 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:09:40 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:09:40 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:09:40 user nova-compute[73188]:       <nova:owner>
Aug 15 19:09:40 user nova-compute[73188]:         <nova:user uuid="60be9c6b4c1b4f4b9038a3a6af7c3648">tempest-ServerActionsTestOtherB-1641219687-project-member</nova:user>
Aug 15 19:09:40 user nova-compute[73188]:         <nova:project uuid="418458ca9ca647788ef8dd45ced52707">tempest-ServerActionsTestOtherB-1641219687</nova:project>
Aug 15 19:09:40 user nova-compute[73188]:       </nova:owner>
Aug 15 19:09:40 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:09:40 user nova-compute[73188]:       <nova:ports>
Aug 15 19:09:40 user nova-compute[73188]:         <nova:port uuid="d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a">
Aug 15 19:09:40 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 19:09:40 user nova-compute[73188]:         </nova:port>
Aug 15 19:09:40 user nova-compute[73188]:       </nova:ports>
Aug 15 19:09:40 user nova-compute[73188]:     </nova:instance>
Aug 15 19:09:40 user nova-compute[73188]:   </metadata>
Aug 15 19:09:40 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:09:40 user nova-compute[73188]:     <system>
Aug 15 19:09:40 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:09:40 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:09:40 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:09:40 user nova-compute[73188]:       <entry name="serial">d1b5f5bf-9672-40a8-83da-3a8f25007e91</entry>
Aug 15 19:09:40 user nova-compute[73188]:       <entry name="uuid">d1b5f5bf-9672-40a8-83da-3a8f25007e91</entry>
Aug 15 19:09:40 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:09:40 user nova-compute[73188]:     </system>
Aug 15 19:09:40 user nova-compute[73188]:   </sysinfo>
Aug 15 19:09:40 user nova-compute[73188]:   <os>
Aug 15 19:09:40 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:09:40 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:09:40 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:09:40 user nova-compute[73188]:   </os>
Aug 15 19:09:40 user nova-compute[73188]:   <features>
Aug 15 19:09:40 user nova-compute[73188]:     <acpi/>
Aug 15 19:09:40 user nova-compute[73188]:     <apic/>
Aug 15 19:09:40 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:09:40 user nova-compute[73188]:   </features>
Aug 15 19:09:40 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:09:40 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:09:40 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:09:40 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:09:40 user nova-compute[73188]:   </clock>
Aug 15 19:09:40 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:09:40 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:09:40 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:09:40 user nova-compute[73188]:   </cpu>
Aug 15 19:09:40 user nova-compute[73188]:   <devices>
Aug 15 19:09:40 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:09:40 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:09:40 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk"/>
Aug 15 19:09:40 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:09:40 user nova-compute[73188]:     </disk>
Aug 15 19:09:40 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:09:40 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:09:40 user nova-compute[73188]:       <source dev="/dev/sdc"/>
Aug 15 19:09:40 user nova-compute[73188]:       <target dev="vdb" bus="virtio"/>
Aug 15 19:09:40 user nova-compute[73188]:       <serial>a56bdc00-9527-4777-a55c-7791842e4c65</serial>
Aug 15 19:09:40 user nova-compute[73188]:     </disk>
Aug 15 19:09:40 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:09:40 user nova-compute[73188]:       <mac address="fa:16:3e:10:5e:42"/>
Aug 15 19:09:40 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:09:40 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:09:40 user nova-compute[73188]:       <target dev="tapd5133aa6-a8"/>
Aug 15 19:09:40 user nova-compute[73188]:     </interface>
Aug 15 19:09:40 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:09:40 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/console.log" append="off"/>
Aug 15 19:09:40 user nova-compute[73188]:     </serial>
Aug 15 19:09:40 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:09:40 user nova-compute[73188]:     <video>
Aug 15 19:09:40 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:09:40 user nova-compute[73188]:     </video>
Aug 15 19:09:40 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:09:40 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:09:40 user nova-compute[73188]:     </rng>
Aug 15 19:09:40 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:09:40 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:09:40 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:09:40 user nova-compute[73188]:     </memballoon>
Aug 15 19:09:40 user nova-compute[73188]:   </devices>
Aug 15 19:09:40 user nova-compute[73188]: </domain>
Aug 15 19:09:40 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2075783787',display_name='tempest-ServerActionsTestOtherB-server-2075783787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2075783787',id=2,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGAn2WMlt73NTUykPIA6PkYCDLbBTR2Yho5Rj2kET8coL/tBEtc4GHmcnA5ijjJ1l2hsUy4+ooa5E/SUoQZ5kfWNtXI5i4fVvpa+4mLZw6dteSEtg5YyfVDHt6PHs7vAQ==',key_name='tempest-keypair-93276017',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:05:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='418458ca9ca647788ef8dd45ced52707',ramdisk_id='',reservation_id='r-36kpwfhi',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1641219687',owner_user_name='tempest-ServerActionsTestOtherB-1641219687-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:09:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60be9c6b4c1b4f4b9038a3a6af7c3648',uuid=d1b5f5bf-9672-40a8-83da-3a8f25007e91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1438605342-network", "vif_mac": "fa:16:3e:10:5e:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Converting VIF {"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1438605342-network", "vif_mac": "fa:16:3e:10:5e:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:5e:42,bridge_name='br-int',has_traffic_filtering=True,id=d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a,network=Network(10d6e7cc-813b-43e5-850a-cbdd4bd41525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5133aa6-a8') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG os_vif [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:5e:42,bridge_name='br-int',has_traffic_filtering=True,id=d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a,network=Network(10d6e7cc-813b-43e5-850a-cbdd4bd41525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5133aa6-a8') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5133aa6-a8, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5133aa6-a8, col_values=(('external_ids', {'iface-id': 'd5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:5e:42', 'vm-uuid': 'd1b5f5bf-9672-40a8-83da-3a8f25007e91'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:40 user nova-compute[73188]: INFO os_vif [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:5e:42,bridge_name='br-int',has_traffic_filtering=True,id=d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a,network=Network(10d6e7cc-813b-43e5-850a-cbdd4bd41525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5133aa6-a8')
Aug 15 19:09:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] No VIF found with MAC fa:16:3e:10:5e:42, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:09:40 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692126565.7873385, d1b5f5bf-9672-40a8-83da-3a8f25007e91 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:09:40 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] VM Stopped (Lifecycle Event)
Aug 15 19:09:40 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8efec796-56d7-4649-a00f-e99510632d19 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:09:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:42 user nova-compute[73188]: DEBUG nova.compute.manager [req-e3fce61e-b4ba-4966-a7a2-00acc54ec3e3 req-0252b44d-45f3-4e11-9fcf-042d792f5690 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received event network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:09:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e3fce61e-b4ba-4966-a7a2-00acc54ec3e3 req-0252b44d-45f3-4e11-9fcf-042d792f5690 service nova] Acquiring lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e3fce61e-b4ba-4966-a7a2-00acc54ec3e3 req-0252b44d-45f3-4e11-9fcf-042d792f5690 service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e3fce61e-b4ba-4966-a7a2-00acc54ec3e3 req-0252b44d-45f3-4e11-9fcf-042d792f5690 service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:42 user nova-compute[73188]: DEBUG nova.compute.manager [req-e3fce61e-b4ba-4966-a7a2-00acc54ec3e3 req-0252b44d-45f3-4e11-9fcf-042d792f5690 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] No waiting events found dispatching network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:09:42 user nova-compute[73188]: WARNING nova.compute.manager [req-e3fce61e-b4ba-4966-a7a2-00acc54ec3e3 req-0252b44d-45f3-4e11-9fcf-042d792f5690 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received unexpected event network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a for instance with vm_state active and task_state resize_finish.
Aug 15 19:09:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:43 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126583.7302492, d1b5f5bf-9672-40a8-83da-3a8f25007e91 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:09:43 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] VM Resumed (Lifecycle Event)
Aug 15 19:09:43 user nova-compute[73188]: DEBUG nova.compute.manager [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:09:43 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Instance running successfully.
Aug 15 19:09:43 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Failed to set time: agent not configured {{(pid=73188) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 15 19:09:43 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-19612d8d-6123-4d0f-aa93-ab35897ec49c tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] finish_migration finished successfully. {{(pid=73188) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 15 19:09:43 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:09:43 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:09:43 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 19:09:43 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126583.7336075, d1b5f5bf-9672-40a8-83da-3a8f25007e91 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:09:43 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] VM Started (Lifecycle Event)
Aug 15 19:09:43 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:09:43 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:09:43 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 19:09:44 user nova-compute[73188]: DEBUG nova.compute.manager [req-cf913088-9fb8-48ab-94e9-0bf74db2b49b req-cb33c65c-8fe0-43ac-a5ce-0b080c142ad7 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received event network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:09:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cf913088-9fb8-48ab-94e9-0bf74db2b49b req-cb33c65c-8fe0-43ac-a5ce-0b080c142ad7 service nova] Acquiring lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:09:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cf913088-9fb8-48ab-94e9-0bf74db2b49b req-cb33c65c-8fe0-43ac-a5ce-0b080c142ad7 service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:09:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cf913088-9fb8-48ab-94e9-0bf74db2b49b req-cb33c65c-8fe0-43ac-a5ce-0b080c142ad7 service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:09:44 user nova-compute[73188]: DEBUG nova.compute.manager [req-cf913088-9fb8-48ab-94e9-0bf74db2b49b req-cb33c65c-8fe0-43ac-a5ce-0b080c142ad7 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] No waiting events found dispatching network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:09:44 user nova-compute[73188]: WARNING nova.compute.manager [req-cf913088-9fb8-48ab-94e9-0bf74db2b49b req-cb33c65c-8fe0-43ac-a5ce-0b080c142ad7 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received unexpected event network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a for instance with vm_state resized and task_state None.
Aug 15 19:09:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:09:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Acquiring lock "fd74b385-fcfa-4a38-b869-0f5a8328188c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Acquiring lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:03 user nova-compute[73188]: INFO nova.compute.manager [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Terminating instance
Aug 15 19:10:03 user nova-compute[73188]: DEBUG nova.compute.manager [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:10:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG nova.compute.manager [req-a6eb427c-06ce-4a24-984b-7a9bd33acb99 req-e25375eb-cf5d-4d54-a21f-74720a49d66d service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Received event network-vif-unplugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a6eb427c-06ce-4a24-984b-7a9bd33acb99 req-e25375eb-cf5d-4d54-a21f-74720a49d66d service nova] Acquiring lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a6eb427c-06ce-4a24-984b-7a9bd33acb99 req-e25375eb-cf5d-4d54-a21f-74720a49d66d service nova] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a6eb427c-06ce-4a24-984b-7a9bd33acb99 req-e25375eb-cf5d-4d54-a21f-74720a49d66d service nova] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG nova.compute.manager [req-a6eb427c-06ce-4a24-984b-7a9bd33acb99 req-e25375eb-cf5d-4d54-a21f-74720a49d66d service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] No waiting events found dispatching network-vif-unplugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG nova.compute.manager [req-a6eb427c-06ce-4a24-984b-7a9bd33acb99 req-e25375eb-cf5d-4d54-a21f-74720a49d66d service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Received event network-vif-unplugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:04 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Instance destroyed successfully.
Aug 15 19:10:04 user nova-compute[73188]: DEBUG nova.objects.instance [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lazy-loading 'resources' on Instance uuid fd74b385-fcfa-4a38-b869-0f5a8328188c {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T19:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-177848102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-465202991',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaBGa9KkwqWE1Q78AJMY7JlCjjnEVbtGOA19dY6uOf/g7Nc83Gf5QTFxXyhKxitOoCVD+9s7ju99GRuHp8fE8zuC/kBIVt9HsyWnGOgpWJZiCHV3u4bydMPINjm7GJs7w==',key_name='tempest-keypair-1090329827',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:08:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1509fdfe31e4f26baac3a8be4b8d894',ramdisk_id='',reservation_id='r-fj96x5lg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-893119363',owner_user_name='tempest-ServerActionsV293TestJSON-893119363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f94daba64eb347959248376b01bce161',uuid=fd74b385-fcfa-4a38-b869-0f5a8328188c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "address": "fa:16:3e:f2:d4:61", "network": {"id": "b9a20327-d2f1-4377-943b-0d2cc3a7dbd9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1246109159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1509fdfe31e4f26baac3a8be4b8d894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4790711-6b", "ovs_interfaceid": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Converting VIF {"id": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "address": "fa:16:3e:f2:d4:61", "network": {"id": "b9a20327-d2f1-4377-943b-0d2cc3a7dbd9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1246109159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1509fdfe31e4f26baac3a8be4b8d894", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4790711-6b", "ovs_interfaceid": "e4790711-6bf9-4e86-bacd-c9e822edc6a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:d4:61,bridge_name='br-int',has_traffic_filtering=True,id=e4790711-6bf9-4e86-bacd-c9e822edc6a9,network=Network(b9a20327-d2f1-4377-943b-0d2cc3a7dbd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4790711-6b') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG os_vif [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:d4:61,bridge_name='br-int',has_traffic_filtering=True,id=e4790711-6bf9-4e86-bacd-c9e822edc6a9,network=Network(b9a20327-d2f1-4377-943b-0d2cc3a7dbd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4790711-6b') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4790711-6b, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:10:04 user nova-compute[73188]: INFO os_vif [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:d4:61,bridge_name='br-int',has_traffic_filtering=True,id=e4790711-6bf9-4e86-bacd-c9e822edc6a9,network=Network(b9a20327-d2f1-4377-943b-0d2cc3a7dbd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4790711-6b')
Aug 15 19:10:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwoJimEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:10:04 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:10:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[153001fc-56a7-4fc5-b17a-d1be73993de3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[333c906e-1a65-47d3-a5d0-b207e1d15b42]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:10:04 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:10:04 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:10:04 user nova-compute[73188]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)
Aug 15 19:10:04 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:10:04 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:10:04 user nova-compute[73188]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b (non-flash)
Aug 15 19:10:04 user nova-compute[73188]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)
Aug 15 19:10:04 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281014dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b'): ({'sdj'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Removing single pathed devices sdj {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdb475c-a94f-46aa-b03f-2eaf244ab62f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c38936-37cd-454c-8eb7-8b5455f097a4]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Flushing IO for device /dev/sdj {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae86363-80a8-433d-b966-63bcc39c6824]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.043s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[364b48b0-7897-4899-b600-491bca3c11ee]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] SCSI volumes sdj have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ed348f-e913-4fa5-880d-a0107e23ea20]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ce8c71-900f-4421-98bd-290b9aeeeabb]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b, portal: 172.16.0.220,3260]
Aug 15 19:10:04 user nova-compute[73188]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b, portal: 172.16.0.220,3260] successful.
Aug 15 19:10:04 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f013040-56d6-4ad2-aa09-4346f46f544b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2702aa93-dfcd-409e-a8f5-80194b97add7]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] <== disconnect_volume: return (345ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:10:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:10:04 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Deleting instance files /opt/stack/data/nova/instances/fd74b385-fcfa-4a38-b869-0f5a8328188c_del
Aug 15 19:10:04 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Deletion of /opt/stack/data/nova/instances/fd74b385-fcfa-4a38-b869-0f5a8328188c_del complete
Aug 15 19:10:05 user nova-compute[73188]: INFO nova.compute.manager [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Took 1.31 seconds to destroy the instance on the hypervisor.
Aug 15 19:10:05 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:10:05 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:10:05 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:10:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:06 user nova-compute[73188]: DEBUG nova.compute.manager [req-e5ee048b-183d-4587-bfd1-fa2397c6dd64 req-6f922e5a-2ae5-4d46-bb13-1b35eef099b5 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Received event network-vif-plugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e5ee048b-183d-4587-bfd1-fa2397c6dd64 req-6f922e5a-2ae5-4d46-bb13-1b35eef099b5 service nova] Acquiring lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e5ee048b-183d-4587-bfd1-fa2397c6dd64 req-6f922e5a-2ae5-4d46-bb13-1b35eef099b5 service nova] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e5ee048b-183d-4587-bfd1-fa2397c6dd64 req-6f922e5a-2ae5-4d46-bb13-1b35eef099b5 service nova] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:06 user nova-compute[73188]: DEBUG nova.compute.manager [req-e5ee048b-183d-4587-bfd1-fa2397c6dd64 req-6f922e5a-2ae5-4d46-bb13-1b35eef099b5 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] No waiting events found dispatching network-vif-plugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:10:06 user nova-compute[73188]: WARNING nova.compute.manager [req-e5ee048b-183d-4587-bfd1-fa2397c6dd64 req-6f922e5a-2ae5-4d46-bb13-1b35eef099b5 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Received unexpected event network-vif-plugged-e4790711-6bf9-4e86-bacd-c9e822edc6a9 for instance with vm_state active and task_state deleting.
Aug 15 19:10:06 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:10:06 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Took 1.51 seconds to deallocate network for instance.
Aug 15 19:10:06 user nova-compute[73188]: INFO nova.compute.manager [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Rescuing
Aug 15 19:10:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "refresh_cache-3d713d03-3e60-4dec-a295-a4652ac21842" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:10:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquired lock "refresh_cache-3d713d03-3e60-4dec-a295-a4652ac21842" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:10:06 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:10:07 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Updating instance_info_cache with network_info: [{"id": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "address": "fa:16:3e:b4:8c:fd", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8c4e95-fc", "ovs_interfaceid": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:10:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Releasing lock "refresh_cache-3d713d03-3e60-4dec-a295-a4652ac21842" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:10:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-bdf2208e-9689-43c1-a3a9-b157b3285710 req-8dbd75b4-ac94-489e-a0d2-76e414b99d53 service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Received event network-changed-2d3fdbfd-6453-4c6f-ad40-09561b8a4908 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-bdf2208e-9689-43c1-a3a9-b157b3285710 req-8dbd75b4-ac94-489e-a0d2-76e414b99d53 service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Refreshing instance network info cache due to event network-changed-2d3fdbfd-6453-4c6f-ad40-09561b8a4908. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:10:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-bdf2208e-9689-43c1-a3a9-b157b3285710 req-8dbd75b4-ac94-489e-a0d2-76e414b99d53 service nova] Acquiring lock "refresh_cache-082c19a9-6a4f-4f27-8c77-d37db7d2306a" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:10:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-bdf2208e-9689-43c1-a3a9-b157b3285710 req-8dbd75b4-ac94-489e-a0d2-76e414b99d53 service nova] Acquired lock "refresh_cache-082c19a9-6a4f-4f27-8c77-d37db7d2306a" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:10:07 user nova-compute[73188]: DEBUG nova.network.neutron [req-bdf2208e-9689-43c1-a3a9-b157b3285710 req-8dbd75b4-ac94-489e-a0d2-76e414b99d53 service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Refreshing network info cache for port 2d3fdbfd-6453-4c6f-ad40-09561b8a4908 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:10:07 user nova-compute[73188]: INFO nova.compute.manager [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Took 0.95 seconds to detach 1 volumes for instance.
Aug 15 19:10:07 user nova-compute[73188]: DEBUG nova.compute.manager [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Deleting volume: 5f013040-56d6-4ad2-aa09-4346f46f544b {{(pid=73188) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 19:10:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:07 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Instance destroyed successfully.
Aug 15 19:10:08 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Attempting a stable device rescue
Aug 15 19:10:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73188) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 19:10:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Instance directory exists: not creating {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 19:10:08 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Creating image(s)
Aug 15 19:10:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d713d03-3e60-4dec-a295-a4652ac21842/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "/opt/stack/data/nova/instances/3d713d03-3e60-4dec-a295-a4652ac21842/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "/opt/stack/data/nova/instances/3d713d03-3e60-4dec-a295-a4652ac21842/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:08 user nova-compute[73188]: DEBUG nova.objects.instance [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3d713d03-3e60-4dec-a295-a4652ac21842 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:10:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "b4ad1892a653f1e505cc271f42376fe4f4db3fdf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "b4ad1892a653f1e505cc271f42376fe4f4db3fdf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:08 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:10:08 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:10:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.513s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4ad1892a653f1e505cc271f42376fe4f4db3fdf.part --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:08 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Deleted allocations for instance fd74b385-fcfa-4a38-b869-0f5a8328188c
Aug 15 19:10:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-f07ba501-53c0-4752-b9b5-4730e665bfce req-274f7888-3890-475b-8b43-d2d0dbc9c123 service nova] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Received event network-vif-deleted-e4790711-6bf9-4e86-bacd-c9e822edc6a9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-f07ba501-53c0-4752-b9b5-4730e665bfce req-274f7888-3890-475b-8b43-d2d0dbc9c123 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received event network-vif-unplugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f07ba501-53c0-4752-b9b5-4730e665bfce req-274f7888-3890-475b-8b43-d2d0dbc9c123 service nova] Acquiring lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f07ba501-53c0-4752-b9b5-4730e665bfce req-274f7888-3890-475b-8b43-d2d0dbc9c123 service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f07ba501-53c0-4752-b9b5-4730e665bfce req-274f7888-3890-475b-8b43-d2d0dbc9c123 service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-f07ba501-53c0-4752-b9b5-4730e665bfce req-274f7888-3890-475b-8b43-d2d0dbc9c123 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] No waiting events found dispatching network-vif-unplugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:10:08 user nova-compute[73188]: WARNING nova.compute.manager [req-f07ba501-53c0-4752-b9b5-4730e665bfce req-274f7888-3890-475b-8b43-d2d0dbc9c123 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received unexpected event network-vif-unplugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d for instance with vm_state active and task_state rescuing.
Aug 15 19:10:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-056a1586-323e-40a8-9ce6-aa71dfaba93b tempest-ServerActionsV293TestJSON-893119363 tempest-ServerActionsV293TestJSON-893119363-project-member] Lock "fd74b385-fcfa-4a38-b869-0f5a8328188c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.348s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4ad1892a653f1e505cc271f42376fe4f4db3fdf.part --force-share --output=json" returned: 0 in 0.189s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG nova.virt.images [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] b6ca0fe3-ce9c-4426-9b1e-ba04a273a426 was qcow2, converting to raw {{(pid=73188) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG nova.privsep.utils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73188) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b4ad1892a653f1e505cc271f42376fe4f4db3fdf.part /opt/stack/data/nova/instances/_base/b4ad1892a653f1e505cc271f42376fe4f4db3fdf.converted {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b4ad1892a653f1e505cc271f42376fe4f4db3fdf.part /opt/stack/data/nova/instances/_base/b4ad1892a653f1e505cc271f42376fe4f4db3fdf.converted" returned: 0 in 0.172s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4ad1892a653f1e505cc271f42376fe4f4db3fdf.converted --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4ad1892a653f1e505cc271f42376fe4f4db3fdf.converted --force-share --output=json" returned: 0 in 0.233s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "b4ad1892a653f1e505cc271f42376fe4f4db3fdf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.445s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "b4ad1892a653f1e505cc271f42376fe4f4db3fdf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "b4ad1892a653f1e505cc271f42376fe4f4db3fdf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4ad1892a653f1e505cc271f42376fe4f4db3fdf --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG nova.network.neutron [req-bdf2208e-9689-43c1-a3a9-b157b3285710 req-8dbd75b4-ac94-489e-a0d2-76e414b99d53 service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Updated VIF entry in instance network info cache for port 2d3fdbfd-6453-4c6f-ad40-09561b8a4908. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG nova.network.neutron [req-bdf2208e-9689-43c1-a3a9-b157b3285710 req-8dbd75b4-ac94-489e-a0d2-76e414b99d53 service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Updating instance_info_cache with network_info: [{"id": "2d3fdbfd-6453-4c6f-ad40-09561b8a4908", "address": "fa:16:3e:1f:48:37", "network": {"id": "ebc6093a-4273-43c5-9d01-0abe8a3a37b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1075513938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aeee537b84a4e42b0ef67c309d14c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3fdbfd-64", "ovs_interfaceid": "2d3fdbfd-6453-4c6f-ad40-09561b8a4908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-bdf2208e-9689-43c1-a3a9-b157b3285710 req-8dbd75b4-ac94-489e-a0d2-76e414b99d53 service nova] Releasing lock "refresh_cache-082c19a9-6a4f-4f27-8c77-d37db7d2306a" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4ad1892a653f1e505cc271f42376fe4f4db3fdf --force-share --output=json" returned: 0 in 0.265s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b4ad1892a653f1e505cc271f42376fe4f4db3fdf,backing_fmt=raw /opt/stack/data/nova/instances/3d713d03-3e60-4dec-a295-a4652ac21842/disk.rescue {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b4ad1892a653f1e505cc271f42376fe4f4db3fdf,backing_fmt=raw /opt/stack/data/nova/instances/3d713d03-3e60-4dec-a295-a4652ac21842/disk.rescue" returned: 0 in 0.084s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "b4ad1892a653f1e505cc271f42376fe4f4db3fdf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.364s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG nova.objects.instance [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'migration_context' on Instance uuid 3d713d03-3e60-4dec-a295-a4652ac21842 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Start _get_guest_xml network_info=[{"id": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "address": "fa:16:3e:b4:8c:fd", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "vif_mac": "fa:16:3e:b4:8c:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8c4e95-fc", "ovs_interfaceid": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b6ca0fe3-ce9c-4426-9b1e-ba04a273a426', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELbiNtlV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '3d713d03-3e60-4dec-a295-a4652ac21842', 'attached_at': '', 'detached_at': '', 'volume_id': '8f900015-9127-4c92-b74d-568597372c4c', 'serial': '8f900015-9127-4c92-b74d-568597372c4c'}, 'attachment_id': 'd131b62c-381b-40ce-a996-75fbede5b40b', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG nova.objects.instance [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'resources' on Instance uuid 3d713d03-3e60-4dec-a295-a4652ac21842 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:10:09 user nova-compute[73188]: DEBUG nova.objects.instance [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'numa_topology' on Instance uuid 3d713d03-3e60-4dec-a295-a4652ac21842 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:10:10 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:10:10 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.objects.instance [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3d713d03-3e60-4dec-a295-a4652ac21842 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELbiNtlV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:10:10 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:10:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:10:10 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:10:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:10:10 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd08dd7-f78a-4ee9-a414-3337ef91d7e7]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ELbiNtlV\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 19:10:10 user nova-compute[73188]: node.name = iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c
Aug 15 19:10:10 user nova-compute[73188]: node.tpgt = -1
Aug 15 19:10:10 user nova-compute[73188]: node.startup = automatic
Aug 15 19:10:10 user nova-compute[73188]: node.leading_login = No
Aug 15 19:10:10 user nova-compute[73188]: iface.iscsi_ifacename = default
Aug 15 19:10:10 user nova-compute[73188]: iface.net_ifacename = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.ipaddress = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.prefix_len = 0
Aug 15 19:10:10 user nova-compute[73188]: iface.hwaddress = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.transport_name = tcp
Aug 15 19:10:10 user nova-compute[73188]: iface.initiatorname = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.state = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.vlan_id = 0
Aug 15 19:10:10 user nova-compute[73188]: iface.vlan_priority = 0
Aug 15 19:10:10 user nova-compute[73188]: iface.vlan_state = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.iface_num = 0
Aug 15 19:10:10 user nova-compute[73188]: iface.mtu = 0
Aug 15 19:10:10 user nova-compute[73188]: iface.port = 0
Aug 15 19:10:10 user nova-compute[73188]: iface.bootproto = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.subnet_mask = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.gateway = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.dhcp_alt_client_id = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.dhcp_dns = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.dhcp_learn_iqn = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.dhcp_vendor_id_state = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.dhcp_vendor_id = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.dhcp_slp_da = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.fragmentation = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.gratuitous_arp = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.incoming_forwarding = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.tos_state = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.tos = 0
Aug 15 19:10:10 user nova-compute[73188]: iface.ttl = 0
Aug 15 19:10:10 user nova-compute[73188]: iface.delayed_ack = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.tcp_nagle = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.tcp_wsf_state = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.tcp_wsf = 0
Aug 15 19:10:10 user nova-compute[73188]: iface.tcp_timer_scale = 0
Aug 15 19:10:10 user nova-compute[73188]: iface.tcp_timestamp = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.redirect = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.def_task_mgmt_timeout = 0
Aug 15 19:10:10 user nova-compute[73188]: iface.header_digest = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.data_digest = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.immediate_data = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.initial_r2t = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.data_seq_inorder = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.data_pdu_inorder = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.erl = 0
Aug 15 19:10:10 user nova-compute[73188]: iface.max_receive_data_len = 0
Aug 15 19:10:10 user nova-compute[73188]: iface.first_burst_len = 0
Aug 15 19:10:10 user nova-compute[73188]: iface.max_outstanding_r2t = 0
Aug 15 19:10:10 user nova-compute[73188]: iface.max_burst_len = 0
Aug 15 19:10:10 user nova-compute[73188]: iface.chap_auth = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.bidi_chap = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.strict_login_compliance = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.discovery_auth = <empty>
Aug 15 19:10:10 user nova-compute[73188]: iface.discovery_logout = <empty>
Aug 15 19:10:10 user nova-compute[73188]: node.discovery_address = <empty>
Aug 15 19:10:10 user nova-compute[73188]: node.discovery_port = 0
Aug 15 19:10:10 user nova-compute[73188]: node.discovery_type = static
Aug 15 19:10:10 user nova-compute[73188]: node.session.initial_cmdsn = 0
Aug 15 19:10:10 user nova-compute[73188]: node.session.initial_login_retry_max = 8
Aug 15 19:10:10 user nova-compute[73188]: node.session.xmit_thread_priority = -20
Aug 15 19:10:10 user nova-compute[73188]: node.session.cmds_max = 128
Aug 15 19:10:10 user nova-compute[73188]: node.session.queue_depth = 32
Aug 15 19:10:10 user nova-compute[73188]: node.session.nr_sessions = 1
Aug 15 19:10:10 user nova-compute[73188]: node.session.auth.authmethod = CHAP
Aug 15 19:10:10 user nova-compute[73188]: node.session.auth.username = ELbiNtlV
Aug 15 19:10:10 user nova-compute[73188]: node.session.auth.password = ***
Aug 15 19:10:10 user nova-compute[73188]: node.session.auth.username_in = <empty>
Aug 15 19:10:10 user nova-compute[73188]: node.session.auth.password_in = <empty>
Aug 15 19:10:10 user nova-compute[73188]: node.session.auth.chap_algs = MD5
Aug 15 19:10:10 user nova-compute[73188]: node.session.timeo.replacement_timeout = 120
Aug 15 19:10:10 user nova-compute[73188]: node.session.err_timeo.abort_timeout = 15
Aug 15 19:10:10 user nova-compute[73188]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 19:10:10 user nova-compute[73188]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 19:10:10 user nova-compute[73188]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 19:10:10 user nova-compute[73188]: node.session.iscsi.FastAbort = Yes
Aug 15 19:10:10 user nova-compute[73188]: node.session.iscsi.InitialR2T = No
Aug 15 19:10:10 user nova-compute[73188]: node.session.iscsi.ImmediateData = Yes
Aug 15 19:10:10 user nova-compute[73188]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 19:10:10 user nova-compute[73188]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 19:10:10 user nova-compute[73188]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 19:10:10 user nova-compute[73188]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 19:10:10 user nova-compute[73188]: node.session.iscsi.MaxConnections = 1
Aug 15 19:10:10 user nova-compute[73188]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 19:10:10 user nova-compute[73188]: node.session.iscsi.ERL = 0
Aug 15 19:10:10 user nova-compute[73188]: node.session.scan = manual
Aug 15 19:10:10 user nova-compute[73188]: node.session.reopen_max = 0
Aug 15 19:10:10 user nova-compute[73188]: node.conn[0].address = 172.16.0.220
Aug 15 19:10:10 user nova-compute[73188]: node.conn[0].port = 3260
Aug 15 19:10:10 user nova-compute[73188]: node.conn[0].startup = manual
Aug 15 19:10:10 user nova-compute[73188]: node.conn[0].tcp.window_size = 524288
Aug 15 19:10:10 user nova-compute[73188]: node.conn[0].tcp.type_of_service = 0
Aug 15 19:10:10 user nova-compute[73188]: node.conn[0].timeo.logout_timeout = 15
Aug 15 19:10:10 user nova-compute[73188]: node.conn[0].timeo.login_timeout = 15
Aug 15 19:10:10 user nova-compute[73188]: node.conn[0].timeo.auth_timeout = 45
Aug 15 19:10:10 user nova-compute[73188]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 19:10:10 user nova-compute[73188]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 19:10:10 user nova-compute[73188]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 19:10:10 user nova-compute[73188]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 19:10:10 user nova-compute[73188]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 19:10:10 user nova-compute[73188]: node.conn[0].iscsi.DataDigest = None
Aug 15 19:10:10 user nova-compute[73188]: node.conn[0].iscsi.IFMarker = No
Aug 15 19:10:10 user nova-compute[73188]: node.conn[0].iscsi.OFMarker = No
Aug 15 19:10:10 user nova-compute[73188]: # END RECORD
Aug 15 19:10:10 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbc0cf5-2c7e-4d59-ac9b-a821abaeb8df]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cacace-ffb3-4f01-9296-ca1f6a687c41]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELbiNtlV {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELbiNtlV" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9ff221-66a1-4694-a7af-4b83bed05cde]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ELbiNtlV'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[823ed423-c0f1-404d-9ddb-549858980c81]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9894ee4b-fba9-4bef-ac38-780333ead92c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:10:10 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:10:10 user nova-compute[73188]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)
Aug 15 19:10:10 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:10:10 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:10:10 user nova-compute[73188]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)
Aug 15 19:10:10 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.194s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] HCTL ('33', '0', '0', 0) found on session 15 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[721a334a-4c25-4e23-81b6-2ae1af3ce858]: (4, ('0 0 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Searching for a device in session 15 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELbiNtlV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.224s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] <== connect_volume: return (226ms) {'type': 'block', 'scsi_wwn': '23965353562323366', 'path': '/dev/sdb'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965353562323366', 'path': '/dev/sdb'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1431736966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1431736966',id=13,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:08:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ab4e1cccd434f6c83f2f9e4687d274e',ramdisk_id='',reservation_id='r-kff5lb5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:08:39Z,user_data=None,user_id='bad952eceaec400396fd0a28c438c761',uuid=3d713d03-3e60-4dec-a295-a4652ac21842,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "address": "fa:16:3e:b4:8c:fd", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "vif_mac": "fa:16:3e:b4:8c:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8c4e95-fc", "ovs_interfaceid": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converting VIF {"id": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "address": "fa:16:3e:b4:8c:fd", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "vif_mac": "fa:16:3e:b4:8c:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8c4e95-fc", "ovs_interfaceid": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:8c:fd,bridge_name='br-int',has_traffic_filtering=True,id=3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8c4e95-fc') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.objects.instance [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d713d03-3e60-4dec-a295-a4652ac21842 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:10:10 user nova-compute[73188]:   <uuid>3d713d03-3e60-4dec-a295-a4652ac21842</uuid>
Aug 15 19:10:10 user nova-compute[73188]:   <name>instance-0000000d</name>
Aug 15 19:10:10 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:10:10 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:10:10 user nova-compute[73188]:   <metadata>
Aug 15 19:10:10 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:10:10 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:10:10 user nova-compute[73188]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1431736966</nova:name>
Aug 15 19:10:10 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:10:10</nova:creationTime>
Aug 15 19:10:10 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:10:10 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:10:10 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:10:10 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:10:10 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:10:10 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:10:10 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:10:10 user nova-compute[73188]:       <nova:owner>
Aug 15 19:10:10 user nova-compute[73188]:         <nova:user uuid="bad952eceaec400396fd0a28c438c761">tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member</nova:user>
Aug 15 19:10:10 user nova-compute[73188]:         <nova:project uuid="0ab4e1cccd434f6c83f2f9e4687d274e">tempest-ServerBootFromVolumeStableRescueTest-1886926549</nova:project>
Aug 15 19:10:10 user nova-compute[73188]:       </nova:owner>
Aug 15 19:10:10 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:10:10 user nova-compute[73188]:       <nova:ports>
Aug 15 19:10:10 user nova-compute[73188]:         <nova:port uuid="3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d">
Aug 15 19:10:10 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 19:10:10 user nova-compute[73188]:         </nova:port>
Aug 15 19:10:10 user nova-compute[73188]:       </nova:ports>
Aug 15 19:10:10 user nova-compute[73188]:     </nova:instance>
Aug 15 19:10:10 user nova-compute[73188]:   </metadata>
Aug 15 19:10:10 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:10:10 user nova-compute[73188]:     <system>
Aug 15 19:10:10 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:10:10 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:10:10 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:10:10 user nova-compute[73188]:       <entry name="serial">3d713d03-3e60-4dec-a295-a4652ac21842</entry>
Aug 15 19:10:10 user nova-compute[73188]:       <entry name="uuid">3d713d03-3e60-4dec-a295-a4652ac21842</entry>
Aug 15 19:10:10 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:10:10 user nova-compute[73188]:     </system>
Aug 15 19:10:10 user nova-compute[73188]:   </sysinfo>
Aug 15 19:10:10 user nova-compute[73188]:   <os>
Aug 15 19:10:10 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:10:10 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:10:10 user nova-compute[73188]:   </os>
Aug 15 19:10:10 user nova-compute[73188]:   <features>
Aug 15 19:10:10 user nova-compute[73188]:     <acpi/>
Aug 15 19:10:10 user nova-compute[73188]:     <apic/>
Aug 15 19:10:10 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:10:10 user nova-compute[73188]:   </features>
Aug 15 19:10:10 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:10:10 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:10:10 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:10:10 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:10:10 user nova-compute[73188]:   </clock>
Aug 15 19:10:10 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:10:10 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:10:10 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:10:10 user nova-compute[73188]:   </cpu>
Aug 15 19:10:10 user nova-compute[73188]:   <devices>
Aug 15 19:10:10 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:10:10 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:10:10 user nova-compute[73188]:       <source dev="/dev/sdb"/>
Aug 15 19:10:10 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:10:10 user nova-compute[73188]:       <serial>8f900015-9127-4c92-b74d-568597372c4c</serial>
Aug 15 19:10:10 user nova-compute[73188]:     </disk>
Aug 15 19:10:10 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:10:10 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:10:10 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/3d713d03-3e60-4dec-a295-a4652ac21842/disk.rescue"/>
Aug 15 19:10:10 user nova-compute[73188]:       <target dev="vdb" bus="virtio"/>
Aug 15 19:10:10 user nova-compute[73188]:       <boot order="1"/>
Aug 15 19:10:10 user nova-compute[73188]:     </disk>
Aug 15 19:10:10 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:10:10 user nova-compute[73188]:       <mac address="fa:16:3e:b4:8c:fd"/>
Aug 15 19:10:10 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:10:10 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:10:10 user nova-compute[73188]:       <target dev="tap3a8c4e95-fc"/>
Aug 15 19:10:10 user nova-compute[73188]:     </interface>
Aug 15 19:10:10 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:10:10 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/3d713d03-3e60-4dec-a295-a4652ac21842/console.log" append="off"/>
Aug 15 19:10:10 user nova-compute[73188]:     </serial>
Aug 15 19:10:10 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:10:10 user nova-compute[73188]:     <video>
Aug 15 19:10:10 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:10:10 user nova-compute[73188]:     </video>
Aug 15 19:10:10 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:10:10 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:10:10 user nova-compute[73188]:     </rng>
Aug 15 19:10:10 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:10:10 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:10:10 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:10:10 user nova-compute[73188]:     </memballoon>
Aug 15 19:10:10 user nova-compute[73188]:   </devices>
Aug 15 19:10:10 user nova-compute[73188]: </domain>
Aug 15 19:10:10 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:10:10 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Instance destroyed successfully.
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.compute.manager [req-2bfa1f73-8174-4a02-9baf-90dca224ba05 req-391ee81d-7f1f-456e-ad34-6de1d7afd6ce service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received event network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2bfa1f73-8174-4a02-9baf-90dca224ba05 req-391ee81d-7f1f-456e-ad34-6de1d7afd6ce service nova] Acquiring lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2bfa1f73-8174-4a02-9baf-90dca224ba05 req-391ee81d-7f1f-456e-ad34-6de1d7afd6ce service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2bfa1f73-8174-4a02-9baf-90dca224ba05 req-391ee81d-7f1f-456e-ad34-6de1d7afd6ce service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.compute.manager [req-2bfa1f73-8174-4a02-9baf-90dca224ba05 req-391ee81d-7f1f-456e-ad34-6de1d7afd6ce service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] No waiting events found dispatching network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:10:10 user nova-compute[73188]: WARNING nova.compute.manager [req-2bfa1f73-8174-4a02-9baf-90dca224ba05 req-391ee81d-7f1f-456e-ad34-6de1d7afd6ce service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received unexpected event network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d for instance with vm_state active and task_state rescuing.
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] No VIF found with MAC fa:16:3e:b4:8c:fd, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:10:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:11 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:10:11 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:10:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-0d5df01f-2a14-423a-9872-69132a3874ce" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:10:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-0d5df01f-2a14-423a-9872-69132a3874ce" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:10:11 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:10:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:12 user nova-compute[73188]: DEBUG nova.compute.manager [req-bccd6343-c1c2-4a0f-a74c-73d9ec8705e1 req-3b8b2d08-0f48-4add-b3b0-ae8ef022de16 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received event network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-bccd6343-c1c2-4a0f-a74c-73d9ec8705e1 req-3b8b2d08-0f48-4add-b3b0-ae8ef022de16 service nova] Acquiring lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-bccd6343-c1c2-4a0f-a74c-73d9ec8705e1 req-3b8b2d08-0f48-4add-b3b0-ae8ef022de16 service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-bccd6343-c1c2-4a0f-a74c-73d9ec8705e1 req-3b8b2d08-0f48-4add-b3b0-ae8ef022de16 service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:12 user nova-compute[73188]: DEBUG nova.compute.manager [req-bccd6343-c1c2-4a0f-a74c-73d9ec8705e1 req-3b8b2d08-0f48-4add-b3b0-ae8ef022de16 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] No waiting events found dispatching network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:10:12 user nova-compute[73188]: WARNING nova.compute.manager [req-bccd6343-c1c2-4a0f-a74c-73d9ec8705e1 req-3b8b2d08-0f48-4add-b3b0-ae8ef022de16 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received unexpected event network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d for instance with vm_state active and task_state rescuing.
Aug 15 19:10:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:13 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Updating instance_info_cache with network_info: [{"id": "21d69054-1e25-44d3-bd72-c036ff3f1498", "address": "fa:16:3e:22:74:a1", "network": {"id": "80270e7b-f136-47b6-8ff6-be6ff6bc6381", "bridge": "br-int", "label": "tempest-TestVolumeSwap-984990596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84ad86ad70c74685904ae5ef488e84f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d69054-1e", "ovs_interfaceid": "21d69054-1e25-44d3-bd72-c036ff3f1498", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:10:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-0d5df01f-2a14-423a-9872-69132a3874ce" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:10:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:10:13 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:10:13 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:10:13 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:10:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:10:13 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:10:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:13 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:10:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquiring lock "de6929cd-c95d-4964-b81c-96872a137f90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "de6929cd-c95d-4964-b81c-96872a137f90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Removed pending event for 3d713d03-3e60-4dec-a295-a4652ac21842 due to event {{(pid=73188) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126614.613944, 3d713d03-3e60-4dec-a295-a4652ac21842 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:10:14 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] VM Resumed (Lifecycle Event)
Aug 15 19:10:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8be7df39-1dd4-4739-9fb9-074234328bfe tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:10:14 user nova-compute[73188]: INFO nova.compute.claims [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Claim successful on node user
Aug 15 19:10:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:10:14 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 19:10:14 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126614.619562, 3d713d03-3e60-4dec-a295-a4652ac21842 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:10:14 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] VM Started (Lifecycle Event)
Aug 15 19:10:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG nova.compute.manager [req-6ea2767d-08af-41ac-8a68-bf3a6dab67dd req-f0224297-ed83-4a16-8ce9-befece17c709 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received event network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6ea2767d-08af-41ac-8a68-bf3a6dab67dd req-f0224297-ed83-4a16-8ce9-befece17c709 service nova] Acquiring lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6ea2767d-08af-41ac-8a68-bf3a6dab67dd req-f0224297-ed83-4a16-8ce9-befece17c709 service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6ea2767d-08af-41ac-8a68-bf3a6dab67dd req-f0224297-ed83-4a16-8ce9-befece17c709 service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG nova.compute.manager [req-6ea2767d-08af-41ac-8a68-bf3a6dab67dd req-f0224297-ed83-4a16-8ce9-befece17c709 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] No waiting events found dispatching network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:10:14 user nova-compute[73188]: WARNING nova.compute.manager [req-6ea2767d-08af-41ac-8a68-bf3a6dab67dd req-f0224297-ed83-4a16-8ce9-befece17c709 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received unexpected event network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d for instance with vm_state rescued and task_state None.
Aug 15 19:10:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d713d03-3e60-4dec-a295-a4652ac21842/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.826s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:10:15 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:10:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d713d03-3e60-4dec-a295-a4652ac21842/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d713d03-3e60-4dec-a295-a4652ac21842/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:10:15 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Creating image(s)
Aug 15 19:10:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquiring lock "/opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "/opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "/opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d713d03-3e60-4dec-a295-a4652ac21842/disk.rescue --force-share --output=json" returned: 0 in 0.251s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:15 user nova-compute[73188]: DEBUG nova.policy [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47716a2e151a44c0a09e8bc538a8316f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b47c13ca2b84149926b814a26148366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.222s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Acquiring lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG nova.objects.instance [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lazy-loading 'flavor' on Instance uuid 082c19a9-6a4f-4f27-8c77-d37db7d2306a {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.130s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.293s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk 1073741824" returned: 0 in 0.090s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.387s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Acquiring lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:16 user nova-compute[73188]: INFO nova.compute.manager [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Attaching volume 9ec026f7-8bad-4750-ab37-a7b3153ed3d2 to /dev/vdb
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG os_brick.utils [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.201s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ba6dd3-46a6-401d-af50-c0868b40cf0c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c8f75c-9931-4cce-a343-7ace44f052d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8936ad-f82d-4bba-a9df-b804445e8ad7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01edee5-a400-44bd-9c07-d0a3ef6b4eb0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:10:16 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3346c20a-74b7-496b-9220-1d51f4fdf87d]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG os_brick.utils [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] <== get_connector_properties: return (205ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Updating existing volume attachment record: c76f7104-cbc8-4785-8eb2-13c5b1c4ce74 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Cannot resize image /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG nova.objects.instance [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lazy-loading 'migration_context' on Instance uuid de6929cd-c95d-4964-b81c-96872a137f90 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Ensure instance console log exists: /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:16 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Successfully created port: f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:10:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:10:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Successfully updated port: f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.compute.manager [req-d0444e39-1ffe-41c7-960a-f943cc0a801c req-bcac67f0-ee18-40e1-9d35-2754d01a72f7 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received event network-changed-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.compute.manager [req-d0444e39-1ffe-41c7-960a-f943cc0a801c req-bcac67f0-ee18-40e1-9d35-2754d01a72f7 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Refreshing instance network info cache due to event network-changed-f07c7de0-8264-42c8-aa30-1a8c7405379a. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d0444e39-1ffe-41c7-960a-f943cc0a801c req-bcac67f0-ee18-40e1-9d35-2754d01a72f7 service nova] Acquiring lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d0444e39-1ffe-41c7-960a-f943cc0a801c req-bcac67f0-ee18-40e1-9d35-2754d01a72f7 service nova] Acquired lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.network.neutron [req-d0444e39-1ffe-41c7-960a-f943cc0a801c req-bcac67f0-ee18-40e1-9d35-2754d01a72f7 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Refreshing network info cache for port f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquiring lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:10:19 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:10:19 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=7367MB free_disk=25.45471954345703GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Applying migration context for instance d1b5f5bf-9672-40a8-83da-3a8f25007e91 as it has an incoming, in-progress migration a18c76a8-2919-4104-9914-c7a6c3903ca4. Migration status is finished {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 19:10:19 user nova-compute[73188]: INFO nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Updating resource usage from migration a18c76a8-2919-4104-9914-c7a6c3903ca4
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 7caf434b-1484-4832-afee-0e2454bb5089 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance c3ca002b-c535-4b87-8d39-861ce6847f12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 0d5df01f-2a14-423a-9872-69132a3874ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3d713d03-3e60-4dec-a295-a4652ac21842 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 082c19a9-6a4f-4f27-8c77-d37db7d2306a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Migration a18c76a8-2919-4104-9914-c7a6c3903ca4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance d1b5f5bf-9672-40a8-83da-3a8f25007e91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e00adf53-085f-436d-a09f-e97e92ca79cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance de6929cd-c95d-4964-b81c-96872a137f90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692126604.5031161, fd74b385-fcfa-4a38-b869-0f5a8328188c => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:10:19 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] VM Stopped (Lifecycle Event)
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8de0636a-d1c9-4e16-a04d-c052aa997499 None None] [instance: fd74b385-fcfa-4a38-b869-0f5a8328188c] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.697s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:19 user nova-compute[73188]: DEBUG nova.network.neutron [req-d0444e39-1ffe-41c7-960a-f943cc0a801c req-bcac67f0-ee18-40e1-9d35-2754d01a72f7 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.network.neutron [req-d0444e39-1ffe-41c7-960a-f943cc0a801c req-bcac67f0-ee18-40e1-9d35-2754d01a72f7 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d0444e39-1ffe-41c7-960a-f943cc0a801c req-bcac67f0-ee18-40e1-9d35-2754d01a72f7 service nova] Releasing lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquired lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Updating instance_info_cache with network_info: [{"id": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "address": "fa:16:3e:06:3e:cd", "network": {"id": "72ad2e88-4c2b-4cba-bfa5-801725bc0041", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824390140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b47c13ca2b84149926b814a26148366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf07c7de0-82", "ovs_interfaceid": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Releasing lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Instance network_info: |[{"id": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "address": "fa:16:3e:06:3e:cd", "network": {"id": "72ad2e88-4c2b-4cba-bfa5-801725bc0041", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824390140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b47c13ca2b84149926b814a26148366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf07c7de0-82", "ovs_interfaceid": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Start _get_guest_xml network_info=[{"id": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "address": "fa:16:3e:06:3e:cd", "network": {"id": "72ad2e88-4c2b-4cba-bfa5-801725bc0041", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824390140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b47c13ca2b84149926b814a26148366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf07c7de0-82", "ovs_interfaceid": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:10:20 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:10:20 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:10:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1685172374',display_name='tempest-ServerStableDeviceRescueTest-server-1685172374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1685172374',id=17,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZV2ZZ1PcyzXMuO4AObOOzlp+MD17bBbGreeYVcVHD8T7QwHW/JFWvZsik8+8K9lMujg7+2eVXXA7EFfclfRtmg+u/m1UQSUhNeDCmDVQ3LSOmEpIIFi4mYV6zZe1VY4Q==',key_name='tempest-keypair-313035603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b47c13ca2b84149926b814a26148366',ramdisk_id='',reservation_id='r-06ruxa0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1845666905',owner_user_name='tempest-ServerStableDeviceRescueTest-1845666905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:10:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47716a2e151a44c0a09e8bc538a8316f',uuid=de6929cd-c95d-4964-b81c-96872a137f90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "address": "fa:16:3e:06:3e:cd", "network": {"id": "72ad2e88-4c2b-4cba-bfa5-801725bc0041", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824390140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b47c13ca2b84149926b814a26148366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf07c7de0-82", "ovs_interfaceid": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Converting VIF {"id": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "address": "fa:16:3e:06:3e:cd", "network": {"id": "72ad2e88-4c2b-4cba-bfa5-801725bc0041", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824390140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b47c13ca2b84149926b814a26148366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf07c7de0-82", "ovs_interfaceid": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:3e:cd,bridge_name='br-int',has_traffic_filtering=True,id=f07c7de0-8264-42c8-aa30-1a8c7405379a,network=Network(72ad2e88-4c2b-4cba-bfa5-801725bc0041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf07c7de0-82') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.objects.instance [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lazy-loading 'pci_devices' on Instance uuid de6929cd-c95d-4964-b81c-96872a137f90 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:10:20 user nova-compute[73188]:   <uuid>de6929cd-c95d-4964-b81c-96872a137f90</uuid>
Aug 15 19:10:20 user nova-compute[73188]:   <name>instance-00000011</name>
Aug 15 19:10:20 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:10:20 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:10:20 user nova-compute[73188]:   <metadata>
Aug 15 19:10:20 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:10:20 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:10:20 user nova-compute[73188]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1685172374</nova:name>
Aug 15 19:10:20 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:10:20</nova:creationTime>
Aug 15 19:10:20 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:10:20 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:10:20 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:10:20 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:10:20 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:10:20 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:10:20 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:10:20 user nova-compute[73188]:       <nova:owner>
Aug 15 19:10:20 user nova-compute[73188]:         <nova:user uuid="47716a2e151a44c0a09e8bc538a8316f">tempest-ServerStableDeviceRescueTest-1845666905-project-member</nova:user>
Aug 15 19:10:20 user nova-compute[73188]:         <nova:project uuid="3b47c13ca2b84149926b814a26148366">tempest-ServerStableDeviceRescueTest-1845666905</nova:project>
Aug 15 19:10:20 user nova-compute[73188]:       </nova:owner>
Aug 15 19:10:20 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:10:20 user nova-compute[73188]:       <nova:ports>
Aug 15 19:10:20 user nova-compute[73188]:         <nova:port uuid="f07c7de0-8264-42c8-aa30-1a8c7405379a">
Aug 15 19:10:20 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 19:10:20 user nova-compute[73188]:         </nova:port>
Aug 15 19:10:20 user nova-compute[73188]:       </nova:ports>
Aug 15 19:10:20 user nova-compute[73188]:     </nova:instance>
Aug 15 19:10:20 user nova-compute[73188]:   </metadata>
Aug 15 19:10:20 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:10:20 user nova-compute[73188]:     <system>
Aug 15 19:10:20 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:10:20 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:10:20 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:10:20 user nova-compute[73188]:       <entry name="serial">de6929cd-c95d-4964-b81c-96872a137f90</entry>
Aug 15 19:10:20 user nova-compute[73188]:       <entry name="uuid">de6929cd-c95d-4964-b81c-96872a137f90</entry>
Aug 15 19:10:20 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:10:20 user nova-compute[73188]:     </system>
Aug 15 19:10:20 user nova-compute[73188]:   </sysinfo>
Aug 15 19:10:20 user nova-compute[73188]:   <os>
Aug 15 19:10:20 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:10:20 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:10:20 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:10:20 user nova-compute[73188]:   </os>
Aug 15 19:10:20 user nova-compute[73188]:   <features>
Aug 15 19:10:20 user nova-compute[73188]:     <acpi/>
Aug 15 19:10:20 user nova-compute[73188]:     <apic/>
Aug 15 19:10:20 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:10:20 user nova-compute[73188]:   </features>
Aug 15 19:10:20 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:10:20 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:10:20 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:10:20 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:10:20 user nova-compute[73188]:   </clock>
Aug 15 19:10:20 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:10:20 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:10:20 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:10:20 user nova-compute[73188]:   </cpu>
Aug 15 19:10:20 user nova-compute[73188]:   <devices>
Aug 15 19:10:20 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:10:20 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:10:20 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk"/>
Aug 15 19:10:20 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:10:20 user nova-compute[73188]:     </disk>
Aug 15 19:10:20 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:10:20 user nova-compute[73188]:       <mac address="fa:16:3e:06:3e:cd"/>
Aug 15 19:10:20 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:10:20 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:10:20 user nova-compute[73188]:       <target dev="tapf07c7de0-82"/>
Aug 15 19:10:20 user nova-compute[73188]:     </interface>
Aug 15 19:10:20 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:10:20 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/console.log" append="off"/>
Aug 15 19:10:20 user nova-compute[73188]:     </serial>
Aug 15 19:10:20 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:10:20 user nova-compute[73188]:     <video>
Aug 15 19:10:20 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:10:20 user nova-compute[73188]:     </video>
Aug 15 19:10:20 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:10:20 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:10:20 user nova-compute[73188]:     </rng>
Aug 15 19:10:20 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:10:20 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:10:20 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:10:20 user nova-compute[73188]:     </memballoon>
Aug 15 19:10:20 user nova-compute[73188]:   </devices>
Aug 15 19:10:20 user nova-compute[73188]: </domain>
Aug 15 19:10:20 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:10:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1685172374',display_name='tempest-ServerStableDeviceRescueTest-server-1685172374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1685172374',id=17,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZV2ZZ1PcyzXMuO4AObOOzlp+MD17bBbGreeYVcVHD8T7QwHW/JFWvZsik8+8K9lMujg7+2eVXXA7EFfclfRtmg+u/m1UQSUhNeDCmDVQ3LSOmEpIIFi4mYV6zZe1VY4Q==',key_name='tempest-keypair-313035603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b47c13ca2b84149926b814a26148366',ramdisk_id='',reservation_id='r-06ruxa0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1845666905',owner_user_name='tempest-ServerStableDeviceRescueTest-1845666905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:10:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47716a2e151a44c0a09e8bc538a8316f',uuid=de6929cd-c95d-4964-b81c-96872a137f90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "address": "fa:16:3e:06:3e:cd", "network": {"id": "72ad2e88-4c2b-4cba-bfa5-801725bc0041", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824390140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b47c13ca2b84149926b814a26148366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf07c7de0-82", "ovs_interfaceid": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Converting VIF {"id": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "address": "fa:16:3e:06:3e:cd", "network": {"id": "72ad2e88-4c2b-4cba-bfa5-801725bc0041", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824390140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b47c13ca2b84149926b814a26148366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf07c7de0-82", "ovs_interfaceid": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:3e:cd,bridge_name='br-int',has_traffic_filtering=True,id=f07c7de0-8264-42c8-aa30-1a8c7405379a,network=Network(72ad2e88-4c2b-4cba-bfa5-801725bc0041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf07c7de0-82') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG os_vif [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:3e:cd,bridge_name='br-int',has_traffic_filtering=True,id=f07c7de0-8264-42c8-aa30-1a8c7405379a,network=Network(72ad2e88-4c2b-4cba-bfa5-801725bc0041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf07c7de0-82') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf07c7de0-82, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf07c7de0-82, col_values=(('external_ids', {'iface-id': 'f07c7de0-8264-42c8-aa30-1a8c7405379a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:3e:cd', 'vm-uuid': 'de6929cd-c95d-4964-b81c-96872a137f90'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:20 user nova-compute[73188]: INFO os_vif [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:3e:cd,bridge_name='br-int',has_traffic_filtering=True,id=f07c7de0-8264-42c8-aa30-1a8c7405379a,network=Network(72ad2e88-4c2b-4cba-bfa5-801725bc0041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf07c7de0-82')
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] No VIF found with MAC fa:16:3e:06:3e:cd, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:10:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-8fe15078-ae3b-4b17-abb3-c8820e943bc5 req-6c289fe2-423e-458d-a05e-c10db9dfa16f service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received event network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8fe15078-ae3b-4b17-abb3-c8820e943bc5 req-6c289fe2-423e-458d-a05e-c10db9dfa16f service nova] Acquiring lock "de6929cd-c95d-4964-b81c-96872a137f90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8fe15078-ae3b-4b17-abb3-c8820e943bc5 req-6c289fe2-423e-458d-a05e-c10db9dfa16f service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8fe15078-ae3b-4b17-abb3-c8820e943bc5 req-6c289fe2-423e-458d-a05e-c10db9dfa16f service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-8fe15078-ae3b-4b17-abb3-c8820e943bc5 req-6c289fe2-423e-458d-a05e-c10db9dfa16f service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] No waiting events found dispatching network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:10:22 user nova-compute[73188]: WARNING nova.compute.manager [req-8fe15078-ae3b-4b17-abb3-c8820e943bc5 req-6c289fe2-423e-458d-a05e-c10db9dfa16f service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received unexpected event network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a for instance with vm_state building and task_state spawning.
Aug 15 19:10:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:24 user nova-compute[73188]: DEBUG nova.compute.manager [req-954243a4-4bbc-4465-ac28-4dab10886569 req-e76f3211-a0b4-4fff-974f-1f6b1553f88d service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received event network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-954243a4-4bbc-4465-ac28-4dab10886569 req-e76f3211-a0b4-4fff-974f-1f6b1553f88d service nova] Acquiring lock "de6929cd-c95d-4964-b81c-96872a137f90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-954243a4-4bbc-4465-ac28-4dab10886569 req-e76f3211-a0b4-4fff-974f-1f6b1553f88d service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-954243a4-4bbc-4465-ac28-4dab10886569 req-e76f3211-a0b4-4fff-974f-1f6b1553f88d service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:24 user nova-compute[73188]: DEBUG nova.compute.manager [req-954243a4-4bbc-4465-ac28-4dab10886569 req-e76f3211-a0b4-4fff-974f-1f6b1553f88d service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] No waiting events found dispatching network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:10:24 user nova-compute[73188]: WARNING nova.compute.manager [req-954243a4-4bbc-4465-ac28-4dab10886569 req-e76f3211-a0b4-4fff-974f-1f6b1553f88d service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received unexpected event network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a for instance with vm_state building and task_state spawning.
Aug 15 19:10:24 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:10:24 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:10:24 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126624.9735525, de6929cd-c95d-4964-b81c-96872a137f90 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:10:24 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] VM Resumed (Lifecycle Event)
Aug 15 19:10:24 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Instance spawned successfully.
Aug 15 19:10:24 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:10:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:10:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:10:25 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:10:25 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126624.9742248, de6929cd-c95d-4964-b81c-96872a137f90 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:10:25 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] VM Started (Lifecycle Event)
Aug 15 19:10:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:10:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:10:25 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:10:25 user nova-compute[73188]: INFO nova.compute.manager [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Took 9.39 seconds to spawn the instance on the hypervisor.
Aug 15 19:10:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:10:25 user nova-compute[73188]: INFO nova.compute.manager [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Took 10.76 seconds to build instance.
Aug 15 19:10:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b7724d6c-32d5-4d70-8974-a117ed03fc58 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "de6929cd-c95d-4964-b81c-96872a137f90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.020s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "139ccf1c-4792-4653-9475-c61b1f9c4846" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:26 user nova-compute[73188]: DEBUG nova.compute.manager [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:10:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:26 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:10:26 user nova-compute[73188]: INFO nova.compute.claims [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Claim successful on node user
Aug 15 19:10:27 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:10:27 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:10:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.910s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:10:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:10:27 user nova-compute[73188]: DEBUG nova.network.neutron [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:10:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "215077af-60a1-4a82-b24e-1545349363d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "215077af-60a1-4a82-b24e-1545349363d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:27 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:10:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:10:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG nova.policy [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88c0edd2a58744da9497d7c5164f22a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb950591a3349908b17b33c0ebca302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:10:28 user nova-compute[73188]: INFO nova.compute.claims [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Claim successful on node user
Aug 15 19:10:28 user nova-compute[73188]: DEBUG nova.compute.manager [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:10:28 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Creating image(s)
Aug 15 19:10:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "/opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "/opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "/opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.297s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.194s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk 1073741824" returned: 0 in 0.079s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfzbJWDS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:10:28 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:10:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:10:28 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:10:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:10:28 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:10:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.242s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Checking if we can resize image /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fd961f-a5bd-44c0-81ba-b4e241ba53fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:10:28 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:10:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7a3542-65ba-47b9-a638-0354d19d5144]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2] added
Aug 15 19:10:29 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.120s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ae3987-b1e4-4691-b7af-9251657dbf54]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8414d938-2e23-4faa-91d3-5672e43b3f6e]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IfzbJWDS {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG nova.network.neutron [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Successfully created port: b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Cannot resize image /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG nova.objects.instance [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'migration_context' on Instance uuid 139ccf1c-4792-4653-9475-c61b1f9c4846 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IfzbJWDS" returned: 0 in 0.038s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[de59cca2-754f-45f0-afbb-2cd14a485b16]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IfzbJWDS'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Ensure instance console log exists: /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.235s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG nova.compute.manager [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48c3534-d22b-4f04-8a2a-7261423320bb]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4363a4-7db1-455c-be33-cdfee915f02b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:10:29 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:10:29 user nova-compute[73188]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)
Aug 15 19:10:29 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:10:29 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:10:29 user nova-compute[73188]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)
Aug 15 19:10:29 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG nova.compute.manager [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG nova.network.neutron [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:10:29 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5920c7-9db7-4b1b-9a3a-f58f2405098d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2, portal: 172.16.0.220,3260]
Aug 15 19:10:29 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2, portal: 172.16.0.220,3260] successful.
Aug 15 19:10:29 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG nova.compute.manager [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a17c697-edc1-4355-9ca5-b2142303fe6f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3c4d48-5875-4467-8466-8f7ebb0b28ef]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:10:29 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:10:29 user nova-compute[73188]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)
Aug 15 19:10:29 user nova-compute[73188]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 (non-flash)
Aug 15 19:10:29 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:10:29 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:10:29 user nova-compute[73188]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)
Aug 15 19:10:29 user nova-compute[73188]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 (non-flash)
Aug 15 19:10:29 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.586s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG nova.policy [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88c0edd2a58744da9497d7c5164f22a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb950591a3349908b17b33c0ebca302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbef664-a325-4176-ad1c-5386c952b14e]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfzbJWDS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG nova.compute.manager [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:10:29 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Creating image(s)
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "/opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "/opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "/opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.229s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.283s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG nova.network.neutron [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Successfully updated port: b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk 1073741824" returned: 0 in 0.060s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.349s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG nova.compute.manager [req-a4cc9f82-45f2-479b-9875-29649a99b024 req-7a28dc6c-64b4-44ad-9bb7-80feb8a884ea service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received event network-changed-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG nova.compute.manager [req-a4cc9f82-45f2-479b-9875-29649a99b024 req-7a28dc6c-64b4-44ad-9bb7-80feb8a884ea service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Refreshing instance network info cache due to event network-changed-b2485f75-d3d0-4b58-9246-8e8f9fd60d49. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a4cc9f82-45f2-479b-9875-29649a99b024 req-7a28dc6c-64b4-44ad-9bb7-80feb8a884ea service nova] Acquiring lock "refresh_cache-139ccf1c-4792-4653-9475-c61b1f9c4846" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a4cc9f82-45f2-479b-9875-29649a99b024 req-7a28dc6c-64b4-44ad-9bb7-80feb8a884ea service nova] Acquired lock "refresh_cache-139ccf1c-4792-4653-9475-c61b1f9c4846" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG nova.network.neutron [req-a4cc9f82-45f2-479b-9875-29649a99b024 req-7a28dc6c-64b4-44ad-9bb7-80feb8a884ea service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Refreshing network info cache for port b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "refresh_cache-139ccf1c-4792-4653-9475-c61b1f9c4846" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG nova.network.neutron [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Successfully created port: 38266cdc-3cf0-422f-b63b-4cec2cbc3eaf {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG nova.network.neutron [req-a4cc9f82-45f2-479b-9875-29649a99b024 req-7a28dc6c-64b4-44ad-9bb7-80feb8a884ea service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.226s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Checking if we can resize image /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.663s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] <== connect_volume: return (1668ms) {'type': 'block', 'scsi_wwn': '23237653133313334', 'path': '/dev/sdd'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237653133313334', 'path': '/dev/sdd'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG nova.objects.instance [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lazy-loading 'flavor' on Instance uuid 082c19a9-6a4f-4f27-8c77-d37db7d2306a {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:10:30 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:10:30 user nova-compute[73188]:   <source dev="/dev/sdd"/>
Aug 15 19:10:30 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:10:30 user nova-compute[73188]:   <serial>9ec026f7-8bad-4750-ab37-a7b3153ed3d2</serial>
Aug 15 19:10:30 user nova-compute[73188]: </disk>
Aug 15 19:10:30 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Cannot resize image /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG nova.objects.instance [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'migration_context' on Instance uuid 215077af-60a1-4a82-b24e-1545349363d0 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG nova.network.neutron [req-a4cc9f82-45f2-479b-9875-29649a99b024 req-7a28dc6c-64b4-44ad-9bb7-80feb8a884ea service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Ensure instance console log exists: /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a4cc9f82-45f2-479b-9875-29649a99b024 req-7a28dc6c-64b4-44ad-9bb7-80feb8a884ea service nova] Releasing lock "refresh_cache-139ccf1c-4792-4653-9475-c61b1f9c4846" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquired lock "refresh_cache-139ccf1c-4792-4653-9475-c61b1f9c4846" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG nova.network.neutron [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG nova.network.neutron [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] No VIF found with MAC fa:16:3e:1f:48:37, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.network.neutron [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Updating instance_info_cache with network_info: [{"id": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "address": "fa:16:3e:49:14:b8", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2485f75-d3", "ovs_interfaceid": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Releasing lock "refresh_cache-139ccf1c-4792-4653-9475-c61b1f9c4846" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.compute.manager [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Instance network_info: |[{"id": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "address": "fa:16:3e:49:14:b8", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2485f75-d3", "ovs_interfaceid": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Start _get_guest_xml network_info=[{"id": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "address": "fa:16:3e:49:14:b8", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2485f75-d3", "ovs_interfaceid": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:10:31 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:10:31 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-800852989',display_name='tempest-ServerRescueNegativeTestJSON-server-800852989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-800852989',id=18,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeb950591a3349908b17b33c0ebca302',ramdisk_id='',reservation_id='r-p4zf3894',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-990996828',owner_user_name='tempest-ServerRescueNegativeTestJSON-990996828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:10:28Z,user_data=None,user_id='88c0edd2a58744da9497d7c5164f22a2',uuid=139ccf1c-4792-4653-9475-c61b1f9c4846,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "address": "fa:16:3e:49:14:b8", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2485f75-d3", "ovs_interfaceid": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converting VIF {"id": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "address": "fa:16:3e:49:14:b8", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2485f75-d3", "ovs_interfaceid": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:14:b8,bridge_name='br-int',has_traffic_filtering=True,id=b2485f75-d3d0-4b58-9246-8e8f9fd60d49,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2485f75-d3') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.objects.instance [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'pci_devices' on Instance uuid 139ccf1c-4792-4653-9475-c61b1f9c4846 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:10:31 user nova-compute[73188]:   <uuid>139ccf1c-4792-4653-9475-c61b1f9c4846</uuid>
Aug 15 19:10:31 user nova-compute[73188]:   <name>instance-00000012</name>
Aug 15 19:10:31 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:10:31 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:10:31 user nova-compute[73188]:   <metadata>
Aug 15 19:10:31 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:10:31 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:10:31 user nova-compute[73188]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-800852989</nova:name>
Aug 15 19:10:31 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:10:31</nova:creationTime>
Aug 15 19:10:31 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:10:31 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:10:31 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:10:31 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:10:31 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:10:31 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:10:31 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:10:31 user nova-compute[73188]:       <nova:owner>
Aug 15 19:10:31 user nova-compute[73188]:         <nova:user uuid="88c0edd2a58744da9497d7c5164f22a2">tempest-ServerRescueNegativeTestJSON-990996828-project-member</nova:user>
Aug 15 19:10:31 user nova-compute[73188]:         <nova:project uuid="eeb950591a3349908b17b33c0ebca302">tempest-ServerRescueNegativeTestJSON-990996828</nova:project>
Aug 15 19:10:31 user nova-compute[73188]:       </nova:owner>
Aug 15 19:10:31 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:10:31 user nova-compute[73188]:       <nova:ports>
Aug 15 19:10:31 user nova-compute[73188]:         <nova:port uuid="b2485f75-d3d0-4b58-9246-8e8f9fd60d49">
Aug 15 19:10:31 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 19:10:31 user nova-compute[73188]:         </nova:port>
Aug 15 19:10:31 user nova-compute[73188]:       </nova:ports>
Aug 15 19:10:31 user nova-compute[73188]:     </nova:instance>
Aug 15 19:10:31 user nova-compute[73188]:   </metadata>
Aug 15 19:10:31 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:10:31 user nova-compute[73188]:     <system>
Aug 15 19:10:31 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:10:31 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:10:31 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:10:31 user nova-compute[73188]:       <entry name="serial">139ccf1c-4792-4653-9475-c61b1f9c4846</entry>
Aug 15 19:10:31 user nova-compute[73188]:       <entry name="uuid">139ccf1c-4792-4653-9475-c61b1f9c4846</entry>
Aug 15 19:10:31 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:10:31 user nova-compute[73188]:     </system>
Aug 15 19:10:31 user nova-compute[73188]:   </sysinfo>
Aug 15 19:10:31 user nova-compute[73188]:   <os>
Aug 15 19:10:31 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:10:31 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:10:31 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:10:31 user nova-compute[73188]:   </os>
Aug 15 19:10:31 user nova-compute[73188]:   <features>
Aug 15 19:10:31 user nova-compute[73188]:     <acpi/>
Aug 15 19:10:31 user nova-compute[73188]:     <apic/>
Aug 15 19:10:31 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:10:31 user nova-compute[73188]:   </features>
Aug 15 19:10:31 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:10:31 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:10:31 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:10:31 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:10:31 user nova-compute[73188]:   </clock>
Aug 15 19:10:31 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:10:31 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:10:31 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:10:31 user nova-compute[73188]:   </cpu>
Aug 15 19:10:31 user nova-compute[73188]:   <devices>
Aug 15 19:10:31 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:10:31 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:10:31 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk"/>
Aug 15 19:10:31 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:10:31 user nova-compute[73188]:     </disk>
Aug 15 19:10:31 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:10:31 user nova-compute[73188]:       <mac address="fa:16:3e:49:14:b8"/>
Aug 15 19:10:31 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:10:31 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:10:31 user nova-compute[73188]:       <target dev="tapb2485f75-d3"/>
Aug 15 19:10:31 user nova-compute[73188]:     </interface>
Aug 15 19:10:31 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:10:31 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/console.log" append="off"/>
Aug 15 19:10:31 user nova-compute[73188]:     </serial>
Aug 15 19:10:31 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:10:31 user nova-compute[73188]:     <video>
Aug 15 19:10:31 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:10:31 user nova-compute[73188]:     </video>
Aug 15 19:10:31 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:10:31 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:10:31 user nova-compute[73188]:     </rng>
Aug 15 19:10:31 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:10:31 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:10:31 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:10:31 user nova-compute[73188]:     </memballoon>
Aug 15 19:10:31 user nova-compute[73188]:   </devices>
Aug 15 19:10:31 user nova-compute[73188]: </domain>
Aug 15 19:10:31 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-800852989',display_name='tempest-ServerRescueNegativeTestJSON-server-800852989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-800852989',id=18,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeb950591a3349908b17b33c0ebca302',ramdisk_id='',reservation_id='r-p4zf3894',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-990996828',owner_user_name='tempest-ServerRescueNegativeTestJSON-990996828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:10:28Z,user_data=None,user_id='88c0edd2a58744da9497d7c5164f22a2',uuid=139ccf1c-4792-4653-9475-c61b1f9c4846,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "address": "fa:16:3e:49:14:b8", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2485f75-d3", "ovs_interfaceid": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converting VIF {"id": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "address": "fa:16:3e:49:14:b8", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2485f75-d3", "ovs_interfaceid": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:14:b8,bridge_name='br-int',has_traffic_filtering=True,id=b2485f75-d3d0-4b58-9246-8e8f9fd60d49,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2485f75-d3') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG os_vif [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:14:b8,bridge_name='br-int',has_traffic_filtering=True,id=b2485f75-d3d0-4b58-9246-8e8f9fd60d49,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2485f75-d3') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2485f75-d3, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb2485f75-d3, col_values=(('external_ids', {'iface-id': 'b2485f75-d3d0-4b58-9246-8e8f9fd60d49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:14:b8', 'vm-uuid': '139ccf1c-4792-4653-9475-c61b1f9c4846'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0057ac35-e0c6-4fe6-942f-26eed015e222 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.884s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:31 user nova-compute[73188]: INFO os_vif [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:14:b8,bridge_name='br-int',has_traffic_filtering=True,id=b2485f75-d3d0-4b58-9246-8e8f9fd60d49,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2485f75-d3')
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] No VIF found with MAC fa:16:3e:49:14:b8, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.network.neutron [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Successfully updated port: 38266cdc-3cf0-422f-b63b-4cec2cbc3eaf {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "refresh_cache-215077af-60a1-4a82-b24e-1545349363d0" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquired lock "refresh_cache-215077af-60a1-4a82-b24e-1545349363d0" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.network.neutron [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.network.neutron [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.compute.manager [req-cdc4f645-8400-4ecd-a924-ebd08be94c36 req-ca5c2aa4-b242-4b5f-b29c-cbce697ecb4a service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Received event network-changed-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG nova.compute.manager [req-cdc4f645-8400-4ecd-a924-ebd08be94c36 req-ca5c2aa4-b242-4b5f-b29c-cbce697ecb4a service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Refreshing instance network info cache due to event network-changed-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:10:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cdc4f645-8400-4ecd-a924-ebd08be94c36 req-ca5c2aa4-b242-4b5f-b29c-cbce697ecb4a service nova] Acquiring lock "refresh_cache-215077af-60a1-4a82-b24e-1545349363d0" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.network.neutron [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Updating instance_info_cache with network_info: [{"id": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "address": "fa:16:3e:d0:70:59", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38266cdc-3c", "ovs_interfaceid": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Releasing lock "refresh_cache-215077af-60a1-4a82-b24e-1545349363d0" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Instance network_info: |[{"id": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "address": "fa:16:3e:d0:70:59", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38266cdc-3c", "ovs_interfaceid": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cdc4f645-8400-4ecd-a924-ebd08be94c36 req-ca5c2aa4-b242-4b5f-b29c-cbce697ecb4a service nova] Acquired lock "refresh_cache-215077af-60a1-4a82-b24e-1545349363d0" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.network.neutron [req-cdc4f645-8400-4ecd-a924-ebd08be94c36 req-ca5c2aa4-b242-4b5f-b29c-cbce697ecb4a service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Refreshing network info cache for port 38266cdc-3cf0-422f-b63b-4cec2cbc3eaf {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Start _get_guest_xml network_info=[{"id": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "address": "fa:16:3e:d0:70:59", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38266cdc-3c", "ovs_interfaceid": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:10:32 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:10:32 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-151802008',display_name='tempest-ServerRescueNegativeTestJSON-server-151802008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-151802008',id=19,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeb950591a3349908b17b33c0ebca302',ramdisk_id='',reservation_id='r-j4tpbmap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-990996828',owner_user_name='tempest-ServerRescueNegativeTestJSON-990996828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:10:30Z,user_data=None,user_id='88c0edd2a58744da9497d7c5164f22a2',uuid=215077af-60a1-4a82-b24e-1545349363d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "address": "fa:16:3e:d0:70:59", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38266cdc-3c", "ovs_interfaceid": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converting VIF {"id": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "address": "fa:16:3e:d0:70:59", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38266cdc-3c", "ovs_interfaceid": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:70:59,bridge_name='br-int',has_traffic_filtering=True,id=38266cdc-3cf0-422f-b63b-4cec2cbc3eaf,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38266cdc-3c') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.objects.instance [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'pci_devices' on Instance uuid 215077af-60a1-4a82-b24e-1545349363d0 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:10:32 user nova-compute[73188]:   <uuid>215077af-60a1-4a82-b24e-1545349363d0</uuid>
Aug 15 19:10:32 user nova-compute[73188]:   <name>instance-00000013</name>
Aug 15 19:10:32 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:10:32 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:10:32 user nova-compute[73188]:   <metadata>
Aug 15 19:10:32 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:10:32 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:10:32 user nova-compute[73188]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-151802008</nova:name>
Aug 15 19:10:32 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:10:32</nova:creationTime>
Aug 15 19:10:32 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:10:32 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:10:32 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:10:32 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:10:32 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:10:32 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:10:32 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:10:32 user nova-compute[73188]:       <nova:owner>
Aug 15 19:10:32 user nova-compute[73188]:         <nova:user uuid="88c0edd2a58744da9497d7c5164f22a2">tempest-ServerRescueNegativeTestJSON-990996828-project-member</nova:user>
Aug 15 19:10:32 user nova-compute[73188]:         <nova:project uuid="eeb950591a3349908b17b33c0ebca302">tempest-ServerRescueNegativeTestJSON-990996828</nova:project>
Aug 15 19:10:32 user nova-compute[73188]:       </nova:owner>
Aug 15 19:10:32 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:10:32 user nova-compute[73188]:       <nova:ports>
Aug 15 19:10:32 user nova-compute[73188]:         <nova:port uuid="38266cdc-3cf0-422f-b63b-4cec2cbc3eaf">
Aug 15 19:10:32 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 19:10:32 user nova-compute[73188]:         </nova:port>
Aug 15 19:10:32 user nova-compute[73188]:       </nova:ports>
Aug 15 19:10:32 user nova-compute[73188]:     </nova:instance>
Aug 15 19:10:32 user nova-compute[73188]:   </metadata>
Aug 15 19:10:32 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:10:32 user nova-compute[73188]:     <system>
Aug 15 19:10:32 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:10:32 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:10:32 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:10:32 user nova-compute[73188]:       <entry name="serial">215077af-60a1-4a82-b24e-1545349363d0</entry>
Aug 15 19:10:32 user nova-compute[73188]:       <entry name="uuid">215077af-60a1-4a82-b24e-1545349363d0</entry>
Aug 15 19:10:32 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:10:32 user nova-compute[73188]:     </system>
Aug 15 19:10:32 user nova-compute[73188]:   </sysinfo>
Aug 15 19:10:32 user nova-compute[73188]:   <os>
Aug 15 19:10:32 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:10:32 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:10:32 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:10:32 user nova-compute[73188]:   </os>
Aug 15 19:10:32 user nova-compute[73188]:   <features>
Aug 15 19:10:32 user nova-compute[73188]:     <acpi/>
Aug 15 19:10:32 user nova-compute[73188]:     <apic/>
Aug 15 19:10:32 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:10:32 user nova-compute[73188]:   </features>
Aug 15 19:10:32 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:10:32 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:10:32 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:10:32 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:10:32 user nova-compute[73188]:   </clock>
Aug 15 19:10:32 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:10:32 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:10:32 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:10:32 user nova-compute[73188]:   </cpu>
Aug 15 19:10:32 user nova-compute[73188]:   <devices>
Aug 15 19:10:32 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:10:32 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:10:32 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk"/>
Aug 15 19:10:32 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:10:32 user nova-compute[73188]:     </disk>
Aug 15 19:10:32 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:10:32 user nova-compute[73188]:       <mac address="fa:16:3e:d0:70:59"/>
Aug 15 19:10:32 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:10:32 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:10:32 user nova-compute[73188]:       <target dev="tap38266cdc-3c"/>
Aug 15 19:10:32 user nova-compute[73188]:     </interface>
Aug 15 19:10:32 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:10:32 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/console.log" append="off"/>
Aug 15 19:10:32 user nova-compute[73188]:     </serial>
Aug 15 19:10:32 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:10:32 user nova-compute[73188]:     <video>
Aug 15 19:10:32 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:10:32 user nova-compute[73188]:     </video>
Aug 15 19:10:32 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:10:32 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:10:32 user nova-compute[73188]:     </rng>
Aug 15 19:10:32 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:10:32 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:10:32 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:10:32 user nova-compute[73188]:     </memballoon>
Aug 15 19:10:32 user nova-compute[73188]:   </devices>
Aug 15 19:10:32 user nova-compute[73188]: </domain>
Aug 15 19:10:32 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-151802008',display_name='tempest-ServerRescueNegativeTestJSON-server-151802008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-151802008',id=19,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeb950591a3349908b17b33c0ebca302',ramdisk_id='',reservation_id='r-j4tpbmap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-990996828',owner_user_name='tempest-ServerRescueNegativeTestJSON-990996828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:10:30Z,user_data=None,user_id='88c0edd2a58744da9497d7c5164f22a2',uuid=215077af-60a1-4a82-b24e-1545349363d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "address": "fa:16:3e:d0:70:59", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38266cdc-3c", "ovs_interfaceid": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converting VIF {"id": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "address": "fa:16:3e:d0:70:59", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38266cdc-3c", "ovs_interfaceid": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:70:59,bridge_name='br-int',has_traffic_filtering=True,id=38266cdc-3cf0-422f-b63b-4cec2cbc3eaf,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38266cdc-3c') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG os_vif [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:70:59,bridge_name='br-int',has_traffic_filtering=True,id=38266cdc-3cf0-422f-b63b-4cec2cbc3eaf,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38266cdc-3c') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38266cdc-3c, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap38266cdc-3c, col_values=(('external_ids', {'iface-id': '38266cdc-3cf0-422f-b63b-4cec2cbc3eaf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:70:59', 'vm-uuid': '215077af-60a1-4a82-b24e-1545349363d0'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:32 user nova-compute[73188]: INFO os_vif [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:70:59,bridge_name='br-int',has_traffic_filtering=True,id=38266cdc-3cf0-422f-b63b-4cec2cbc3eaf,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38266cdc-3c')
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] No VIF found with MAC fa:16:3e:d0:70:59, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.network.neutron [req-cdc4f645-8400-4ecd-a924-ebd08be94c36 req-ca5c2aa4-b242-4b5f-b29c-cbce697ecb4a service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Updated VIF entry in instance network info cache for port 38266cdc-3cf0-422f-b63b-4cec2cbc3eaf. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG nova.network.neutron [req-cdc4f645-8400-4ecd-a924-ebd08be94c36 req-ca5c2aa4-b242-4b5f-b29c-cbce697ecb4a service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Updating instance_info_cache with network_info: [{"id": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "address": "fa:16:3e:d0:70:59", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38266cdc-3c", "ovs_interfaceid": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:10:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cdc4f645-8400-4ecd-a924-ebd08be94c36 req-ca5c2aa4-b242-4b5f-b29c-cbce697ecb4a service nova] Releasing lock "refresh_cache-215077af-60a1-4a82-b24e-1545349363d0" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:10:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Acquiring lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:33 user nova-compute[73188]: INFO nova.compute.manager [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Detaching volume 9ec026f7-8bad-4750-ab37-a7b3153ed3d2
Aug 15 19:10:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:33 user nova-compute[73188]: INFO nova.virt.block_device [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Attempting to driver detach volume 9ec026f7-8bad-4750-ab37-a7b3153ed3d2 from mountpoint /dev/vdb
Aug 15 19:10:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Attempting to detach device vdb from instance 082c19a9-6a4f-4f27-8c77-d37db7d2306a from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:10:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:10:33 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:10:33 user nova-compute[73188]:   <source dev="/dev/sdd"/>
Aug 15 19:10:33 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:10:33 user nova-compute[73188]:   <serial>9ec026f7-8bad-4750-ab37-a7b3153ed3d2</serial>
Aug 15 19:10:33 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:10:33 user nova-compute[73188]: </disk>
Aug 15 19:10:33 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:10:33 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Successfully detached device vdb from instance 082c19a9-6a4f-4f27-8c77-d37db7d2306a from the persistent domain config.
Aug 15 19:10:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 082c19a9-6a4f-4f27-8c77-d37db7d2306a from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:10:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:10:33 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:10:33 user nova-compute[73188]:   <source dev="/dev/sdd"/>
Aug 15 19:10:33 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:10:33 user nova-compute[73188]:   <serial>9ec026f7-8bad-4750-ab37-a7b3153ed3d2</serial>
Aug 15 19:10:33 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:10:33 user nova-compute[73188]: </disk>
Aug 15 19:10:33 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG nova.compute.manager [req-8d259526-ed88-4fad-89da-9769b39f64c3 req-bcd24c92-b5d0-4cad-b443-e7f17b16e66c service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received event network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8d259526-ed88-4fad-89da-9769b39f64c3 req-bcd24c92-b5d0-4cad-b443-e7f17b16e66c service nova] Acquiring lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8d259526-ed88-4fad-89da-9769b39f64c3 req-bcd24c92-b5d0-4cad-b443-e7f17b16e66c service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8d259526-ed88-4fad-89da-9769b39f64c3 req-bcd24c92-b5d0-4cad-b443-e7f17b16e66c service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG nova.compute.manager [req-8d259526-ed88-4fad-89da-9769b39f64c3 req-bcd24c92-b5d0-4cad-b443-e7f17b16e66c service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] No waiting events found dispatching network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:10:34 user nova-compute[73188]: WARNING nova.compute.manager [req-8d259526-ed88-4fad-89da-9769b39f64c3 req-bcd24c92-b5d0-4cad-b443-e7f17b16e66c service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received unexpected event network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 for instance with vm_state building and task_state spawning.
Aug 15 19:10:34 user nova-compute[73188]: DEBUG nova.compute.manager [req-8d259526-ed88-4fad-89da-9769b39f64c3 req-bcd24c92-b5d0-4cad-b443-e7f17b16e66c service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received event network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8d259526-ed88-4fad-89da-9769b39f64c3 req-bcd24c92-b5d0-4cad-b443-e7f17b16e66c service nova] Acquiring lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8d259526-ed88-4fad-89da-9769b39f64c3 req-bcd24c92-b5d0-4cad-b443-e7f17b16e66c service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8d259526-ed88-4fad-89da-9769b39f64c3 req-bcd24c92-b5d0-4cad-b443-e7f17b16e66c service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG nova.compute.manager [req-8d259526-ed88-4fad-89da-9769b39f64c3 req-bcd24c92-b5d0-4cad-b443-e7f17b16e66c service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] No waiting events found dispatching network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:10:34 user nova-compute[73188]: WARNING nova.compute.manager [req-8d259526-ed88-4fad-89da-9769b39f64c3 req-bcd24c92-b5d0-4cad-b443-e7f17b16e66c service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received unexpected event network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 for instance with vm_state building and task_state spawning.
Aug 15 19:10:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692126634.2576032, 082c19a9-6a4f-4f27-8c77-d37db7d2306a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 082c19a9-6a4f-4f27-8c77-d37db7d2306a {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:10:34 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Successfully detached device vdb from instance 082c19a9-6a4f-4f27-8c77-d37db7d2306a from the live domain config.
Aug 15 19:10:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfzbJWDS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:10:34 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:10:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39fb690-608c-4593-a79d-a154891de4da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5826a089-613c-4a84-8d5a-222e3b514bf3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:10:34 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:10:34 user nova-compute[73188]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)
Aug 15 19:10:34 user nova-compute[73188]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 (non-flash)
Aug 15 19:10:34 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:10:34 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:10:34 user nova-compute[73188]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)
Aug 15 19:10:34 user nova-compute[73188]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 (non-flash)
Aug 15 19:10:34 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28082bfac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2'): ({'sdd'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Removing single pathed devices sdd {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7230638-7afc-4697-a96c-af0fdf290362]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92985f7-8012-4c1a-bdde-272c772653fa]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Flushing IO for device /dev/sdd {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b55fab-d197-4d98-9a46-2805bb20d058]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e32ac5-af11-4395-9f2b-092f1538642d]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] SCSI volumes sdd have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b643fc8-3803-4e5c-9fac-8e919422bdb7]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e93661-0767-4f16-a234-a9e3a4a35fcd]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2, portal: 172.16.0.220,3260]
Aug 15 19:10:34 user nova-compute[73188]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2, portal: 172.16.0.220,3260] successful.
Aug 15 19:10:34 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ec026f7-8bad-4750-ab37-a7b3153ed3d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a05fe8-2fe6-4597-9c46-55e618a05fcd]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] <== disconnect_volume: return (290ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:10:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:10:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:35 user nova-compute[73188]: DEBUG nova.objects.instance [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lazy-loading 'flavor' on Instance uuid 082c19a9-6a4f-4f27-8c77-d37db7d2306a {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:10:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-25be0fe8-d274-4836-8333-acc1010cc329 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.211s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-89297a37-d831-4dc9-8752-8b491680ca00 req-3345fed2-29a0-4d95-b2ee-d7f483d82bf8 service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Received event network-vif-plugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-89297a37-d831-4dc9-8752-8b491680ca00 req-3345fed2-29a0-4d95-b2ee-d7f483d82bf8 service nova] Acquiring lock "215077af-60a1-4a82-b24e-1545349363d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-89297a37-d831-4dc9-8752-8b491680ca00 req-3345fed2-29a0-4d95-b2ee-d7f483d82bf8 service nova] Lock "215077af-60a1-4a82-b24e-1545349363d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-89297a37-d831-4dc9-8752-8b491680ca00 req-3345fed2-29a0-4d95-b2ee-d7f483d82bf8 service nova] Lock "215077af-60a1-4a82-b24e-1545349363d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-89297a37-d831-4dc9-8752-8b491680ca00 req-3345fed2-29a0-4d95-b2ee-d7f483d82bf8 service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] No waiting events found dispatching network-vif-plugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:10:35 user nova-compute[73188]: WARNING nova.compute.manager [req-89297a37-d831-4dc9-8752-8b491680ca00 req-3345fed2-29a0-4d95-b2ee-d7f483d82bf8 service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Received unexpected event network-vif-plugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf for instance with vm_state building and task_state spawning.
Aug 15 19:10:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:36 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126636.946496, 139ccf1c-4792-4653-9475-c61b1f9c4846 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:10:36 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] VM Resumed (Lifecycle Event)
Aug 15 19:10:36 user nova-compute[73188]: DEBUG nova.compute.manager [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:10:36 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:10:36 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Instance spawned successfully.
Aug 15 19:10:36 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:10:36 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:10:36 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:10:36 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:36 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:36 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:36 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:36 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:37 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126636.9481332, 139ccf1c-4792-4653-9475-c61b1f9c4846 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:10:37 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] VM Started (Lifecycle Event)
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:10:37 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:10:37 user nova-compute[73188]: INFO nova.compute.manager [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Took 9.00 seconds to spawn the instance on the hypervisor.
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.compute.manager [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:10:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:37 user nova-compute[73188]: INFO nova.compute.manager [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Took 10.44 seconds to build instance.
Aug 15 19:10:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-898c7bc2-9b5b-4281-bbc2-7d66cc4730f5 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.582s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126637.3658578, 215077af-60a1-4a82-b24e-1545349363d0 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:10:37 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 215077af-60a1-4a82-b24e-1545349363d0] VM Resumed (Lifecycle Event)
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.compute.manager [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:10:37 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Instance spawned successfully.
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:37 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 215077af-60a1-4a82-b24e-1545349363d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126637.3672328, 215077af-60a1-4a82-b24e-1545349363d0 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:10:37 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 215077af-60a1-4a82-b24e-1545349363d0] VM Started (Lifecycle Event)
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:10:37 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 215077af-60a1-4a82-b24e-1545349363d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:10:37 user nova-compute[73188]: INFO nova.compute.manager [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Took 7.82 seconds to spawn the instance on the hypervisor.
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.compute.manager [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:10:37 user nova-compute[73188]: INFO nova.compute.manager [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Took 9.63 seconds to build instance.
Aug 15 19:10:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a18aab04-9ded-4258-9768-e02e5427bfc0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "215077af-60a1-4a82-b24e-1545349363d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.801s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.compute.manager [req-b764b352-7182-441f-8117-c5c88f1ff679 req-c1d7e87b-8274-45b2-ace0-e693513c72fc service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Received event network-vif-plugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b764b352-7182-441f-8117-c5c88f1ff679 req-c1d7e87b-8274-45b2-ace0-e693513c72fc service nova] Acquiring lock "215077af-60a1-4a82-b24e-1545349363d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b764b352-7182-441f-8117-c5c88f1ff679 req-c1d7e87b-8274-45b2-ace0-e693513c72fc service nova] Lock "215077af-60a1-4a82-b24e-1545349363d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b764b352-7182-441f-8117-c5c88f1ff679 req-c1d7e87b-8274-45b2-ace0-e693513c72fc service nova] Lock "215077af-60a1-4a82-b24e-1545349363d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:37 user nova-compute[73188]: DEBUG nova.compute.manager [req-b764b352-7182-441f-8117-c5c88f1ff679 req-c1d7e87b-8274-45b2-ace0-e693513c72fc service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] No waiting events found dispatching network-vif-plugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:10:37 user nova-compute[73188]: WARNING nova.compute.manager [req-b764b352-7182-441f-8117-c5c88f1ff679 req-c1d7e87b-8274-45b2-ace0-e693513c72fc service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Received unexpected event network-vif-plugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf for instance with vm_state active and task_state None.
Aug 15 19:10:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Acquiring lock "38af35a8-ea67-4871-8de9-57b04614faa3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Lock "38af35a8-ea67-4871-8de9-57b04614faa3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:10:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:38 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:10:38 user nova-compute[73188]: INFO nova.compute.claims [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Claim successful on node user
Aug 15 19:10:39 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:10:39 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:10:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.608s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:10:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:10:39 user nova-compute[73188]: DEBUG nova.network.neutron [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:10:39 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:10:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:10:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:10:39 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:10:39 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Creating image(s)
Aug 15 19:10:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Acquiring lock "/opt/stack/data/nova/instances/38af35a8-ea67-4871-8de9-57b04614faa3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Lock "/opt/stack/data/nova/instances/38af35a8-ea67-4871-8de9-57b04614faa3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Lock "/opt/stack/data/nova/instances/38af35a8-ea67-4871-8de9-57b04614faa3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:39 user nova-compute[73188]: DEBUG nova.policy [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51512b550684412da17492201f62282c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0bf776d30d44cfbb8134ee25e1b5ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:10:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.220s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.218s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/38af35a8-ea67-4871-8de9-57b04614faa3/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/38af35a8-ea67-4871-8de9-57b04614faa3/disk 1073741824" returned: 0 in 0.057s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.223s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:40 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38af35a8-ea67-4871-8de9-57b04614faa3/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:10:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38af35a8-ea67-4871-8de9-57b04614faa3/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:10:40 user nova-compute[73188]: DEBUG nova.network.neutron [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Successfully created port: 7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:10:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38af35a8-ea67-4871-8de9-57b04614faa3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:10:40 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Cannot resize image /opt/stack/data/nova/instances/38af35a8-ea67-4871-8de9-57b04614faa3/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:10:40 user nova-compute[73188]: DEBUG nova.objects.instance [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Lazy-loading 'migration_context' on Instance uuid 38af35a8-ea67-4871-8de9-57b04614faa3 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:10:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:10:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Ensure instance console log exists: /opt/stack/data/nova/instances/38af35a8-ea67-4871-8de9-57b04614faa3/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:10:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.network.neutron [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Successfully updated port: 7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Acquiring lock "refresh_cache-38af35a8-ea67-4871-8de9-57b04614faa3" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Acquired lock "refresh_cache-38af35a8-ea67-4871-8de9-57b04614faa3" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.network.neutron [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-bf74df29-3563-473c-ba62-fb8e958c19ad req-2cf0885c-1501-45ad-83b5-b1bb3ffaccfb service nova] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Received event network-changed-7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-bf74df29-3563-473c-ba62-fb8e958c19ad req-2cf0885c-1501-45ad-83b5-b1bb3ffaccfb service nova] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Refreshing instance network info cache due to event network-changed-7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-bf74df29-3563-473c-ba62-fb8e958c19ad req-2cf0885c-1501-45ad-83b5-b1bb3ffaccfb service nova] Acquiring lock "refresh_cache-38af35a8-ea67-4871-8de9-57b04614faa3" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.network.neutron [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.network.neutron [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Updating instance_info_cache with network_info: [{"id": "7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa", "address": "fa:16:3e:00:f9:cc", "network": {"id": "07572d5d-8c74-428e-b234-b8f5f902c82f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "955614a7fb044176adad07bac93ae638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee6b62-7d", "ovs_interfaceid": "7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Releasing lock "refresh_cache-38af35a8-ea67-4871-8de9-57b04614faa3" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.compute.manager [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Instance network_info: |[{"id": "7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa", "address": "fa:16:3e:00:f9:cc", "network": {"id": "07572d5d-8c74-428e-b234-b8f5f902c82f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "955614a7fb044176adad07bac93ae638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee6b62-7d", "ovs_interfaceid": "7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-bf74df29-3563-473c-ba62-fb8e958c19ad req-2cf0885c-1501-45ad-83b5-b1bb3ffaccfb service nova] Acquired lock "refresh_cache-38af35a8-ea67-4871-8de9-57b04614faa3" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.network.neutron [req-bf74df29-3563-473c-ba62-fb8e958c19ad req-2cf0885c-1501-45ad-83b5-b1bb3ffaccfb service nova] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Refreshing network info cache for port 7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Start _get_guest_xml network_info=[{"id": "7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa", "address": "fa:16:3e:00:f9:cc", "network": {"id": "07572d5d-8c74-428e-b234-b8f5f902c82f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "955614a7fb044176adad07bac93ae638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee6b62-7d", "ovs_interfaceid": "7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:10:41 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:10:41 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1973142812',display_name='tempest-VolumesNegativeTest-instance-1973142812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1973142812',id=20,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba0bf776d30d44cfbb8134ee25e1b5ff',ramdisk_id='',reservation_id='r-l2yhi98l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1659730329',owner_user_name='tempest-VolumesNegativeTest-1659730329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:10:40Z,user_data=None,user_id='51512b550684412da17492201f62282c',uuid=38af35a8-ea67-4871-8de9-57b04614faa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa", "address": "fa:16:3e:00:f9:cc", "network": {"id": "07572d5d-8c74-428e-b234-b8f5f902c82f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "955614a7fb044176adad07bac93ae638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee6b62-7d", "ovs_interfaceid": "7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Converting VIF {"id": "7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa", "address": "fa:16:3e:00:f9:cc", "network": {"id": "07572d5d-8c74-428e-b234-b8f5f902c82f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "955614a7fb044176adad07bac93ae638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee6b62-7d", "ovs_interfaceid": "7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:f9:cc,bridge_name='br-int',has_traffic_filtering=True,id=7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa,network=Network(07572d5d-8c74-428e-b234-b8f5f902c82f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cee6b62-7d') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.objects.instance [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Lazy-loading 'pci_devices' on Instance uuid 38af35a8-ea67-4871-8de9-57b04614faa3 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:10:41 user nova-compute[73188]:   <uuid>38af35a8-ea67-4871-8de9-57b04614faa3</uuid>
Aug 15 19:10:41 user nova-compute[73188]:   <name>instance-00000014</name>
Aug 15 19:10:41 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:10:41 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:10:41 user nova-compute[73188]:   <metadata>
Aug 15 19:10:41 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:10:41 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:10:41 user nova-compute[73188]:       <nova:name>tempest-VolumesNegativeTest-instance-1973142812</nova:name>
Aug 15 19:10:41 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:10:41</nova:creationTime>
Aug 15 19:10:41 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:10:41 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:10:41 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:10:41 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:10:41 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:10:41 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:10:41 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:10:41 user nova-compute[73188]:       <nova:owner>
Aug 15 19:10:41 user nova-compute[73188]:         <nova:user uuid="51512b550684412da17492201f62282c">tempest-VolumesNegativeTest-1659730329-project-member</nova:user>
Aug 15 19:10:41 user nova-compute[73188]:         <nova:project uuid="ba0bf776d30d44cfbb8134ee25e1b5ff">tempest-VolumesNegativeTest-1659730329</nova:project>
Aug 15 19:10:41 user nova-compute[73188]:       </nova:owner>
Aug 15 19:10:41 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:10:41 user nova-compute[73188]:       <nova:ports>
Aug 15 19:10:41 user nova-compute[73188]:         <nova:port uuid="7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa">
Aug 15 19:10:41 user nova-compute[73188]:           <nova:ip type="fixed" address="192.168.233.231" ipVersion="4"/>
Aug 15 19:10:41 user nova-compute[73188]:         </nova:port>
Aug 15 19:10:41 user nova-compute[73188]:       </nova:ports>
Aug 15 19:10:41 user nova-compute[73188]:     </nova:instance>
Aug 15 19:10:41 user nova-compute[73188]:   </metadata>
Aug 15 19:10:41 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:10:41 user nova-compute[73188]:     <system>
Aug 15 19:10:41 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:10:41 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:10:41 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:10:41 user nova-compute[73188]:       <entry name="serial">38af35a8-ea67-4871-8de9-57b04614faa3</entry>
Aug 15 19:10:41 user nova-compute[73188]:       <entry name="uuid">38af35a8-ea67-4871-8de9-57b04614faa3</entry>
Aug 15 19:10:41 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:10:41 user nova-compute[73188]:     </system>
Aug 15 19:10:41 user nova-compute[73188]:   </sysinfo>
Aug 15 19:10:41 user nova-compute[73188]:   <os>
Aug 15 19:10:41 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:10:41 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:10:41 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:10:41 user nova-compute[73188]:   </os>
Aug 15 19:10:41 user nova-compute[73188]:   <features>
Aug 15 19:10:41 user nova-compute[73188]:     <acpi/>
Aug 15 19:10:41 user nova-compute[73188]:     <apic/>
Aug 15 19:10:41 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:10:41 user nova-compute[73188]:   </features>
Aug 15 19:10:41 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:10:41 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:10:41 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:10:41 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:10:41 user nova-compute[73188]:   </clock>
Aug 15 19:10:41 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:10:41 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:10:41 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:10:41 user nova-compute[73188]:   </cpu>
Aug 15 19:10:41 user nova-compute[73188]:   <devices>
Aug 15 19:10:41 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:10:41 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:10:41 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/38af35a8-ea67-4871-8de9-57b04614faa3/disk"/>
Aug 15 19:10:41 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:10:41 user nova-compute[73188]:     </disk>
Aug 15 19:10:41 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:10:41 user nova-compute[73188]:       <mac address="fa:16:3e:00:f9:cc"/>
Aug 15 19:10:41 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:10:41 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:10:41 user nova-compute[73188]:       <target dev="tap7cee6b62-7d"/>
Aug 15 19:10:41 user nova-compute[73188]:     </interface>
Aug 15 19:10:41 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:10:41 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/38af35a8-ea67-4871-8de9-57b04614faa3/console.log" append="off"/>
Aug 15 19:10:41 user nova-compute[73188]:     </serial>
Aug 15 19:10:41 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:10:41 user nova-compute[73188]:     <video>
Aug 15 19:10:41 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:10:41 user nova-compute[73188]:     </video>
Aug 15 19:10:41 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:10:41 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:10:41 user nova-compute[73188]:     </rng>
Aug 15 19:10:41 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:10:41 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:10:41 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:10:41 user nova-compute[73188]:     </memballoon>
Aug 15 19:10:41 user nova-compute[73188]:   </devices>
Aug 15 19:10:41 user nova-compute[73188]: </domain>
Aug 15 19:10:41 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1973142812',display_name='tempest-VolumesNegativeTest-instance-1973142812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1973142812',id=20,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba0bf776d30d44cfbb8134ee25e1b5ff',ramdisk_id='',reservation_id='r-l2yhi98l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1659730329',owner_user_name='tempest-VolumesNegativeTest-1659730329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:10:40Z,user_data=None,user_id='51512b550684412da17492201f62282c',uuid=38af35a8-ea67-4871-8de9-57b04614faa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa", "address": "fa:16:3e:00:f9:cc", "network": {"id": "07572d5d-8c74-428e-b234-b8f5f902c82f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "955614a7fb044176adad07bac93ae638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee6b62-7d", "ovs_interfaceid": "7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Converting VIF {"id": "7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa", "address": "fa:16:3e:00:f9:cc", "network": {"id": "07572d5d-8c74-428e-b234-b8f5f902c82f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "955614a7fb044176adad07bac93ae638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee6b62-7d", "ovs_interfaceid": "7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:f9:cc,bridge_name='br-int',has_traffic_filtering=True,id=7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa,network=Network(07572d5d-8c74-428e-b234-b8f5f902c82f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cee6b62-7d') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG os_vif [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:f9:cc,bridge_name='br-int',has_traffic_filtering=True,id=7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa,network=Network(07572d5d-8c74-428e-b234-b8f5f902c82f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cee6b62-7d') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cee6b62-7d, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7cee6b62-7d, col_values=(('external_ids', {'iface-id': '7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:f9:cc', 'vm-uuid': '38af35a8-ea67-4871-8de9-57b04614faa3'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:41 user nova-compute[73188]: INFO os_vif [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:f9:cc,bridge_name='br-int',has_traffic_filtering=True,id=7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa,network=Network(07572d5d-8c74-428e-b234-b8f5f902c82f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cee6b62-7d')
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:10:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] No VIF found with MAC fa:16:3e:00:f9:cc, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:10:42 user nova-compute[73188]: DEBUG nova.network.neutron [req-bf74df29-3563-473c-ba62-fb8e958c19ad req-2cf0885c-1501-45ad-83b5-b1bb3ffaccfb service nova] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Updated VIF entry in instance network info cache for port 7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:10:42 user nova-compute[73188]: DEBUG nova.network.neutron [req-bf74df29-3563-473c-ba62-fb8e958c19ad req-2cf0885c-1501-45ad-83b5-b1bb3ffaccfb service nova] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Updating instance_info_cache with network_info: [{"id": "7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa", "address": "fa:16:3e:00:f9:cc", "network": {"id": "07572d5d-8c74-428e-b234-b8f5f902c82f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "955614a7fb044176adad07bac93ae638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee6b62-7d", "ovs_interfaceid": "7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:10:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-bf74df29-3563-473c-ba62-fb8e958c19ad req-2cf0885c-1501-45ad-83b5-b1bb3ffaccfb service nova] Releasing lock "refresh_cache-38af35a8-ea67-4871-8de9-57b04614faa3" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:10:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:43 user nova-compute[73188]: DEBUG nova.compute.manager [req-1bbcc1e6-a5b5-4eda-8fd3-34e533a30e55 req-2aaf57e6-750a-4783-ba9e-76eb63dc7e0f service nova] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Received event network-vif-plugged-7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1bbcc1e6-a5b5-4eda-8fd3-34e533a30e55 req-2aaf57e6-750a-4783-ba9e-76eb63dc7e0f service nova] Acquiring lock "38af35a8-ea67-4871-8de9-57b04614faa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1bbcc1e6-a5b5-4eda-8fd3-34e533a30e55 req-2aaf57e6-750a-4783-ba9e-76eb63dc7e0f service nova] Lock "38af35a8-ea67-4871-8de9-57b04614faa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1bbcc1e6-a5b5-4eda-8fd3-34e533a30e55 req-2aaf57e6-750a-4783-ba9e-76eb63dc7e0f service nova] Lock "38af35a8-ea67-4871-8de9-57b04614faa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:43 user nova-compute[73188]: DEBUG nova.compute.manager [req-1bbcc1e6-a5b5-4eda-8fd3-34e533a30e55 req-2aaf57e6-750a-4783-ba9e-76eb63dc7e0f service nova] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] No waiting events found dispatching network-vif-plugged-7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:10:43 user nova-compute[73188]: WARNING nova.compute.manager [req-1bbcc1e6-a5b5-4eda-8fd3-34e533a30e55 req-2aaf57e6-750a-4783-ba9e-76eb63dc7e0f service nova] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Received unexpected event network-vif-plugged-7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa for instance with vm_state building and task_state spawning.
Aug 15 19:10:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:45 user nova-compute[73188]: DEBUG nova.compute.manager [req-ff1919fe-ee18-4a3a-af9a-e253bbf406af req-c5244705-54b6-49a5-9a21-6caf0340bc40 service nova] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Received event network-vif-plugged-7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ff1919fe-ee18-4a3a-af9a-e253bbf406af req-c5244705-54b6-49a5-9a21-6caf0340bc40 service nova] Acquiring lock "38af35a8-ea67-4871-8de9-57b04614faa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ff1919fe-ee18-4a3a-af9a-e253bbf406af req-c5244705-54b6-49a5-9a21-6caf0340bc40 service nova] Lock "38af35a8-ea67-4871-8de9-57b04614faa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ff1919fe-ee18-4a3a-af9a-e253bbf406af req-c5244705-54b6-49a5-9a21-6caf0340bc40 service nova] Lock "38af35a8-ea67-4871-8de9-57b04614faa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:45 user nova-compute[73188]: DEBUG nova.compute.manager [req-ff1919fe-ee18-4a3a-af9a-e253bbf406af req-c5244705-54b6-49a5-9a21-6caf0340bc40 service nova] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] No waiting events found dispatching network-vif-plugged-7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:10:45 user nova-compute[73188]: WARNING nova.compute.manager [req-ff1919fe-ee18-4a3a-af9a-e253bbf406af req-c5244705-54b6-49a5-9a21-6caf0340bc40 service nova] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Received unexpected event network-vif-plugged-7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa for instance with vm_state building and task_state spawning.
Aug 15 19:10:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:46 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126646.032894, 38af35a8-ea67-4871-8de9-57b04614faa3 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:10:46 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] VM Resumed (Lifecycle Event)
Aug 15 19:10:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:10:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:10:46 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Instance spawned successfully.
Aug 15 19:10:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:10:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:10:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:10:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:10:46 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:10:46 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126646.0379162, 38af35a8-ea67-4871-8de9-57b04614faa3 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:10:46 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] VM Started (Lifecycle Event)
Aug 15 19:10:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:10:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:10:46 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:10:46 user nova-compute[73188]: INFO nova.compute.manager [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Took 6.55 seconds to spawn the instance on the hypervisor.
Aug 15 19:10:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:10:46 user nova-compute[73188]: INFO nova.compute.manager [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Took 7.56 seconds to build instance.
Aug 15 19:10:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-528779c7-b377-4787-828e-1ccd4a6fc346 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Lock "38af35a8-ea67-4871-8de9-57b04614faa3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.671s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:53 user nova-compute[73188]: INFO nova.compute.manager [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Terminating instance
Aug 15 19:10:53 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:10:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:53 user nova-compute[73188]: DEBUG nova.compute.manager [req-747fca86-6f31-4996-8af6-5d27a6ddb820 req-a347e110-b116-4d5b-ad8a-18ff264d4fd2 service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Received event network-vif-unplugged-484e78f1-880c-43ec-ac83-983201fdc835 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-747fca86-6f31-4996-8af6-5d27a6ddb820 req-a347e110-b116-4d5b-ad8a-18ff264d4fd2 service nova] Acquiring lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-747fca86-6f31-4996-8af6-5d27a6ddb820 req-a347e110-b116-4d5b-ad8a-18ff264d4fd2 service nova] Lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-747fca86-6f31-4996-8af6-5d27a6ddb820 req-a347e110-b116-4d5b-ad8a-18ff264d4fd2 service nova] Lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:53 user nova-compute[73188]: DEBUG nova.compute.manager [req-747fca86-6f31-4996-8af6-5d27a6ddb820 req-a347e110-b116-4d5b-ad8a-18ff264d4fd2 service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] No waiting events found dispatching network-vif-unplugged-484e78f1-880c-43ec-ac83-983201fdc835 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:10:53 user nova-compute[73188]: DEBUG nova.compute.manager [req-747fca86-6f31-4996-8af6-5d27a6ddb820 req-a347e110-b116-4d5b-ad8a-18ff264d4fd2 service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Received event network-vif-unplugged-484e78f1-880c-43ec-ac83-983201fdc835 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:10:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:54 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Instance destroyed successfully.
Aug 15 19:10:54 user nova-compute[73188]: DEBUG nova.objects.instance [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lazy-loading 'resources' on Instance uuid 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:10:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:08:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-337236358',display_name='tempest-VolumesAdminNegativeTest-server-337236358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-337236358',id=15,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:08:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4761b15a8dae4f7cab8c13ace5b42ddd',ramdisk_id='',reservation_id='r-bj59es47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1347354909',owner_user_name='tempest-VolumesAdminNegativeTest-1347354909-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:09:00Z,user_data=None,user_id='a55d8274ea6d4970921dcbc36d8a00b3',uuid=9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "484e78f1-880c-43ec-ac83-983201fdc835", "address": "fa:16:3e:49:eb:35", "network": {"id": "574343fe-52ff-4be4-9622-e61a33db8396", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-946260414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4761b15a8dae4f7cab8c13ace5b42ddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484e78f1-88", "ovs_interfaceid": "484e78f1-880c-43ec-ac83-983201fdc835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:10:54 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Converting VIF {"id": "484e78f1-880c-43ec-ac83-983201fdc835", "address": "fa:16:3e:49:eb:35", "network": {"id": "574343fe-52ff-4be4-9622-e61a33db8396", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-946260414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4761b15a8dae4f7cab8c13ace5b42ddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484e78f1-88", "ovs_interfaceid": "484e78f1-880c-43ec-ac83-983201fdc835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:10:54 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:eb:35,bridge_name='br-int',has_traffic_filtering=True,id=484e78f1-880c-43ec-ac83-983201fdc835,network=Network(574343fe-52ff-4be4-9622-e61a33db8396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484e78f1-88') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:10:54 user nova-compute[73188]: DEBUG os_vif [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:eb:35,bridge_name='br-int',has_traffic_filtering=True,id=484e78f1-880c-43ec-ac83-983201fdc835,network=Network(574343fe-52ff-4be4-9622-e61a33db8396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484e78f1-88') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:10:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap484e78f1-88, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:10:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:10:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:54 user nova-compute[73188]: INFO os_vif [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:eb:35,bridge_name='br-int',has_traffic_filtering=True,id=484e78f1-880c-43ec-ac83-983201fdc835,network=Network(574343fe-52ff-4be4-9622-e61a33db8396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484e78f1-88')
Aug 15 19:10:54 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Deleting instance files /opt/stack/data/nova/instances/9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7_del
Aug 15 19:10:54 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Deletion of /opt/stack/data/nova/instances/9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7_del complete
Aug 15 19:10:54 user nova-compute[73188]: INFO nova.compute.manager [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 15 19:10:54 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:10:54 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:10:54 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:10:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:55 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:10:55 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Took 1.27 seconds to deallocate network for instance.
Aug 15 19:10:55 user nova-compute[73188]: DEBUG nova.compute.manager [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Received event network-vif-plugged-484e78f1-880c-43ec-ac83-983201fdc835 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] Acquiring lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] Lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] Lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:55 user nova-compute[73188]: DEBUG nova.compute.manager [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] No waiting events found dispatching network-vif-plugged-484e78f1-880c-43ec-ac83-983201fdc835 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:10:55 user nova-compute[73188]: WARNING nova.compute.manager [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Received unexpected event network-vif-plugged-484e78f1-880c-43ec-ac83-983201fdc835 for instance with vm_state active and task_state deleting.
Aug 15 19:10:55 user nova-compute[73188]: DEBUG nova.compute.manager [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Received event network-vif-plugged-484e78f1-880c-43ec-ac83-983201fdc835 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] Acquiring lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] Lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] Lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:55 user nova-compute[73188]: DEBUG nova.compute.manager [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] No waiting events found dispatching network-vif-plugged-484e78f1-880c-43ec-ac83-983201fdc835 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:10:55 user nova-compute[73188]: WARNING nova.compute.manager [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Received unexpected event network-vif-plugged-484e78f1-880c-43ec-ac83-983201fdc835 for instance with vm_state active and task_state deleting.
Aug 15 19:10:55 user nova-compute[73188]: DEBUG nova.compute.manager [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Received event network-vif-plugged-484e78f1-880c-43ec-ac83-983201fdc835 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] Acquiring lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] Lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] Lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:55 user nova-compute[73188]: DEBUG nova.compute.manager [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] No waiting events found dispatching network-vif-plugged-484e78f1-880c-43ec-ac83-983201fdc835 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:10:55 user nova-compute[73188]: WARNING nova.compute.manager [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Received unexpected event network-vif-plugged-484e78f1-880c-43ec-ac83-983201fdc835 for instance with vm_state active and task_state deleting.
Aug 15 19:10:55 user nova-compute[73188]: DEBUG nova.compute.manager [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Received event network-vif-plugged-484e78f1-880c-43ec-ac83-983201fdc835 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] Acquiring lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] Lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] Lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:55 user nova-compute[73188]: DEBUG nova.compute.manager [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] No waiting events found dispatching network-vif-plugged-484e78f1-880c-43ec-ac83-983201fdc835 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:10:55 user nova-compute[73188]: WARNING nova.compute.manager [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Received unexpected event network-vif-plugged-484e78f1-880c-43ec-ac83-983201fdc835 for instance with vm_state active and task_state deleting.
Aug 15 19:10:55 user nova-compute[73188]: DEBUG nova.compute.manager [req-5ab843a6-769b-4a02-8292-b0ec30bc2910 req-6c636401-2ad9-4ae6-9b99-170e8df2bb0e service nova] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Received event network-vif-deleted-484e78f1-880c-43ec-ac83-983201fdc835 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:10:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:10:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:10:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:56 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:10:56 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:10:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.524s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:56 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Deleted allocations for instance 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7
Aug 15 19:10:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3ee0fce9-c035-4d2c-add9-0f0ec1dc19a5 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.103s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:10:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:10:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:09 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692126654.1586156, 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:11:09 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] VM Stopped (Lifecycle Event)
Aug 15 19:11:09 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3fb9b927-9bb5-4f84-b6a2-7ee087ac485a None None] [instance: 9d8e132c-ebbf-4ae7-b4f8-bab769aed0c7] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:11:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:09 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:11:10 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:11:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:11 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:11:11 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:11:11 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:11:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:11:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:11:11 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:11:11 user nova-compute[73188]: DEBUG nova.objects.instance [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lazy-loading 'info_cache' on Instance uuid ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:11:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:12 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Updating instance_info_cache with network_info: [{"id": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "address": "fa:16:3e:df:71:ad", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85966f51-bc", "ovs_interfaceid": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:11:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:11:12 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:11:12 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:11:12 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Cleaning up deleted instances {{(pid=73188) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 19:11:12 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] There are 0 instances to clean {{(pid=73188) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 19:11:13 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:11:13 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:11:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:14 user nova-compute[73188]: DEBUG nova.network.neutron [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Port d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a binding to destination host user is already ACTIVE {{(pid=73188) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 19:11:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:11:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquired lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:11:14 user nova-compute[73188]: DEBUG nova.network.neutron [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:11:14 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:11:14 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:11:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:11:14 user nova-compute[73188]: DEBUG nova.network.neutron [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Updating instance_info_cache with network_info: [{"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:11:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Releasing lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:11:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Creating tmpfile /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/tmpd_x5v41b to verify with other compute node that the instance is on the same shared storage. {{(pid=73188) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 15 19:11:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:11:15 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Instance destroyed successfully.
Aug 15 19:11:15 user nova-compute[73188]: DEBUG nova.objects.instance [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lazy-loading 'resources' on Instance uuid d1b5f5bf-9672-40a8-83da-3a8f25007e91 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2075783787',display_name='tempest-ServerActionsTestOtherB-server-2075783787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2075783787',id=2,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGAn2WMlt73NTUykPIA6PkYCDLbBTR2Yho5Rj2kET8coL/tBEtc4GHmcnA5ijjJ1l2hsUy4+ooa5E/SUoQZ5kfWNtXI5i4fVvpa+4mLZw6dteSEtg5YyfVDHt6PHs7vAQ==',key_name='tempest-keypair-93276017',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:09:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='418458ca9ca647788ef8dd45ced52707',ramdisk_id='',reservation_id='r-36kpwfhi',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1641219687',owner_user_name='tempest-ServerActionsTestOtherB-1641219687-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:09:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60be9c6b4c1b4f4b9038a3a6af7c3648',uuid=d1b5f5bf-9672-40a8-83da-3a8f25007e91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Converting VIF {"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:5e:42,bridge_name='br-int',has_traffic_filtering=True,id=d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a,network=Network(10d6e7cc-813b-43e5-850a-cbdd4bd41525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5133aa6-a8') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG os_vif [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:5e:42,bridge_name='br-int',has_traffic_filtering=True,id=d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a,network=Network(10d6e7cc-813b-43e5-850a-cbdd4bd41525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5133aa6-a8') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5133aa6-a8, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:15 user nova-compute[73188]: INFO os_vif [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:5e:42,bridge_name='br-int',has_traffic_filtering=True,id=d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a,network=Network(10d6e7cc-813b-43e5-850a-cbdd4bd41525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5133aa6-a8')
Aug 15 19:11:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUBLTriK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:11:15 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:11:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66d1bd4-7873-498b-9652-7e9e4aeb18bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[258b750e-24ad-4c0f-a0ec-58dad0160dd0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:11:15 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:11:15 user nova-compute[73188]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)
Aug 15 19:11:15 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:11:15 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:11:15 user nova-compute[73188]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)
Aug 15 19:11:15 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e47dea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65'): ({'sdc'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Removing single pathed devices sdc {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c291ed22-d0ea-43be-b5ca-c3c3cfb80200]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9f20dd-43cc-4629-960f-ae382414f203]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Flushing IO for device /dev/sdc {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4712eee8-16f4-4f97-a207-a77d932ab894]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:11:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dba3266-3ae5-4309-bd90-ec283ef812cb]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] SCSI volumes sdc have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fad8a6-b246-45cf-8ea0-7122a4304e6f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e5d6ad-81ff-48fa-8ec2-e5beee14b791]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260]
Aug 15 19:11:16 user nova-compute[73188]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260] successful.
Aug 15 19:11:16 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c13a71-f7be-43ba-9530-e05ec92c293c]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] <== disconnect_volume: return (334ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG nova.compute.manager [req-29ecf6be-7522-4872-9952-3b51f60ce95a req-e27e48fc-e136-457d-85fe-4ef7a7442974 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Received event network-changed-4646dbfd-e829-4653-9e76-e34901f8ad33 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG nova.compute.manager [req-29ecf6be-7522-4872-9952-3b51f60ce95a req-e27e48fc-e136-457d-85fe-4ef7a7442974 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Refreshing instance network info cache due to event network-changed-4646dbfd-e829-4653-9e76-e34901f8ad33. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-29ecf6be-7522-4872-9952-3b51f60ce95a req-e27e48fc-e136-457d-85fe-4ef7a7442974 service nova] Acquiring lock "refresh_cache-e00adf53-085f-436d-a09f-e97e92ca79cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-29ecf6be-7522-4872-9952-3b51f60ce95a req-e27e48fc-e136-457d-85fe-4ef7a7442974 service nova] Acquired lock "refresh_cache-e00adf53-085f-436d-a09f-e97e92ca79cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG nova.network.neutron [req-29ecf6be-7522-4872-9952-3b51f60ce95a req-e27e48fc-e136-457d-85fe-4ef7a7442974 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Refreshing network info cache for port 4646dbfd-e829-4653-9e76-e34901f8ad33 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.003s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:17 user nova-compute[73188]: DEBUG nova.objects.instance [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lazy-loading 'migration_context' on Instance uuid d1b5f5bf-9672-40a8-83da-3a8f25007e91 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:11:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:17 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Error from libvirt while getting description of instance-00000002: [Error Code 42] Domain not found: no domain with matching uuid 'd1b5f5bf-9672-40a8-83da-3a8f25007e91' (instance-00000002): libvirt.libvirtError: Domain not found: no domain with matching uuid 'd1b5f5bf-9672-40a8-83da-3a8f25007e91' (instance-00000002)
Aug 15 19:11:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:17 user nova-compute[73188]: DEBUG nova.network.neutron [req-29ecf6be-7522-4872-9952-3b51f60ce95a req-e27e48fc-e136-457d-85fe-4ef7a7442974 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Updated VIF entry in instance network info cache for port 4646dbfd-e829-4653-9e76-e34901f8ad33. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:11:17 user nova-compute[73188]: DEBUG nova.network.neutron [req-29ecf6be-7522-4872-9952-3b51f60ce95a req-e27e48fc-e136-457d-85fe-4ef7a7442974 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Updating instance_info_cache with network_info: [{"id": "4646dbfd-e829-4653-9e76-e34901f8ad33", "address": "fa:16:3e:db:be:12", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4646dbfd-e8", "ovs_interfaceid": "4646dbfd-e829-4653-9e76-e34901f8ad33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:11:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-29ecf6be-7522-4872-9952-3b51f60ce95a req-e27e48fc-e136-457d-85fe-4ef7a7442974 service nova] Releasing lock "refresh_cache-e00adf53-085f-436d-a09f-e97e92ca79cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:11:17 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Refreshing inventories for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 19:11:17 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Updating ProviderTree inventory for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 19:11:17 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Updating inventory in ProviderTree for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 19:11:17 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Refreshing aggregate associations for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5, aggregates: None {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 19:11:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:17 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Refreshing trait associations for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 19:11:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38af35a8-ea67-4871-8de9-57b04614faa3/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38af35a8-ea67-4871-8de9-57b04614faa3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38af35a8-ea67-4871-8de9-57b04614faa3/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:18 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:11:18 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:11:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38af35a8-ea67-4871-8de9-57b04614faa3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.978s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:18 user nova-compute[73188]: INFO nova.compute.manager [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Swapping old allocation on dict_keys(['63d71eac-d5e2-446b-a323-b32b3e9557e5']) held by migration a18c76a8-2919-4104-9914-c7a6c3903ca4 for instance
Aug 15 19:11:18 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Overwriting current allocation {'allocations': {'63d71eac-d5e2-446b-a323-b32b3e9557e5': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 24}}, 'project_id': '418458ca9ca647788ef8dd45ced52707', 'user_id': '60be9c6b4c1b4f4b9038a3a6af7c3648', 'consumer_generation': 1} on consumer d1b5f5bf-9672-40a8-83da-3a8f25007e91 {{(pid=73188) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 15 19:11:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:11:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d713d03-3e60-4dec-a295-a4652ac21842/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:11:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquired lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:11:18 user nova-compute[73188]: DEBUG nova.network.neutron [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:11:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d713d03-3e60-4dec-a295-a4652ac21842/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d713d03-3e60-4dec-a295-a4652ac21842/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d713d03-3e60-4dec-a295-a4652ac21842/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG nova.network.neutron [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Updating instance_info_cache with network_info: [{"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Releasing lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG os_brick.utils [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef2162b-e4d0-4d65-a9a1-0e86a8b52aed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44c16da-98bc-4079-b872-ef5a29b2bad5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9af743-64d1-4f59-a5d1-b14720fcec9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b526b64d-f086-40d7-8bd3-420fb38cc4dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:11:19 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[616e8474-34b3-44f5-94e1-743b947c3237]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG os_brick.utils [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:20 user nova-compute[73188]: DEBUG nova.compute.manager [req-c2e9e449-df0b-4f11-a77b-219aabf3f5b3 req-24d81108-322f-4ebd-82e3-05f7ab3e6294 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received event network-vif-unplugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:11:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c2e9e449-df0b-4f11-a77b-219aabf3f5b3 req-24d81108-322f-4ebd-82e3-05f7ab3e6294 service nova] Acquiring lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c2e9e449-df0b-4f11-a77b-219aabf3f5b3 req-24d81108-322f-4ebd-82e3-05f7ab3e6294 service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c2e9e449-df0b-4f11-a77b-219aabf3f5b3 req-24d81108-322f-4ebd-82e3-05f7ab3e6294 service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:20 user nova-compute[73188]: DEBUG nova.compute.manager [req-c2e9e449-df0b-4f11-a77b-219aabf3f5b3 req-24d81108-322f-4ebd-82e3-05f7ab3e6294 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] No waiting events found dispatching network-vif-unplugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:11:20 user nova-compute[73188]: WARNING nova.compute.manager [req-c2e9e449-df0b-4f11-a77b-219aabf3f5b3 req-24d81108-322f-4ebd-82e3-05f7ab3e6294 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received unexpected event network-vif-unplugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a for instance with vm_state resized and task_state resize_reverting.
Aug 15 19:11:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.503s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:21 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:11:21 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:11:21 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=6877MB free_disk=25.351139068603516GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 7caf434b-1484-4832-afee-0e2454bb5089 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance c3ca002b-c535-4b87-8d39-861ce6847f12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 0d5df01f-2a14-423a-9872-69132a3874ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3d713d03-3e60-4dec-a295-a4652ac21842 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 082c19a9-6a4f-4f27-8c77-d37db7d2306a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance d1b5f5bf-9672-40a8-83da-3a8f25007e91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e00adf53-085f-436d-a09f-e97e92ca79cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance de6929cd-c95d-4964-b81c-96872a137f90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 139ccf1c-4792-4653-9475-c61b1f9c4846 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 215077af-60a1-4a82-b24e-1545349363d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 38af35a8-ea67-4871-8de9-57b04614faa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.587s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:11:21 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=73188) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 19:11:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-00773555-3a32-483a-be6f-0835ca9f0661 req-a9f34583-2a4a-4540-a09b-52b850f4c585 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received event network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:11:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-00773555-3a32-483a-be6f-0835ca9f0661 req-a9f34583-2a4a-4540-a09b-52b850f4c585 service nova] Acquiring lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-00773555-3a32-483a-be6f-0835ca9f0661 req-a9f34583-2a4a-4540-a09b-52b850f4c585 service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-00773555-3a32-483a-be6f-0835ca9f0661 req-a9f34583-2a4a-4540-a09b-52b850f4c585 service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-00773555-3a32-483a-be6f-0835ca9f0661 req-a9f34583-2a4a-4540-a09b-52b850f4c585 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] No waiting events found dispatching network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:11:22 user nova-compute[73188]: WARNING nova.compute.manager [req-00773555-3a32-483a-be6f-0835ca9f0661 req-a9f34583-2a4a-4540-a09b-52b850f4c585 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received unexpected event network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a for instance with vm_state resized and task_state resize_reverting.
Aug 15 19:11:23 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:11:23 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:11:23 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:11:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Acquiring lock "514c4115-057d-4cd2-8869-daf3d38fa5de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:11:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:25 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:11:25 user nova-compute[73188]: INFO nova.compute.claims [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Claim successful on node user
Aug 15 19:11:25 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:11:25 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:11:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:11:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:11:25 user nova-compute[73188]: DEBUG nova.network.neutron [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:11:25 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:11:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:11:25 user nova-compute[73188]: DEBUG nova.policy [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0af9d72e3404f7f8d1657b11116656e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508c36eff4c347438cd7a3d0c035c479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:11:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:11:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:11:25 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Creating image(s)
Aug 15 19:11:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Acquiring lock "/opt/stack/data/nova/instances/514c4115-057d-4cd2-8869-daf3d38fa5de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Lock "/opt/stack/data/nova/instances/514c4115-057d-4cd2-8869-daf3d38fa5de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Lock "/opt/stack/data/nova/instances/514c4115-057d-4cd2-8869-daf3d38fa5de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.195s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Acquiring lock "0d5df01f-2a14-423a-9872-69132a3874ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "0d5df01f-2a14-423a-9872-69132a3874ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:26 user nova-compute[73188]: INFO nova.compute.manager [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Detaching volume 0ebdb52c-10ca-4922-aeb0-2cd724546178
Aug 15 19:11:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.238s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/514c4115-057d-4cd2-8869-daf3d38fa5de/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:26 user nova-compute[73188]: INFO nova.virt.block_device [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Attempting to driver detach volume 0ebdb52c-10ca-4922-aeb0-2cd724546178 from mountpoint /dev/vdb
Aug 15 19:11:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/514c4115-057d-4cd2-8869-daf3d38fa5de/disk 1073741824" returned: 0 in 0.053s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Attempting to detach device vdb from instance 0d5df01f-2a14-423a-9872-69132a3874ce from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:11:26 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:11:26 user nova-compute[73188]:   <source dev="/dev/sdi"/>
Aug 15 19:11:26 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:11:26 user nova-compute[73188]:   <serial>0ebdb52c-10ca-4922-aeb0-2cd724546178</serial>
Aug 15 19:11:26 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:11:26 user nova-compute[73188]: </disk>
Aug 15 19:11:26 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:11:26 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Successfully detached device vdb from instance 0d5df01f-2a14-423a-9872-69132a3874ce from the persistent domain config.
Aug 15 19:11:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0d5df01f-2a14-423a-9872-69132a3874ce from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:11:26 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:11:26 user nova-compute[73188]:   <source dev="/dev/sdi"/>
Aug 15 19:11:26 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:11:26 user nova-compute[73188]:   <serial>0ebdb52c-10ca-4922-aeb0-2cd724546178</serial>
Aug 15 19:11:26 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:11:26 user nova-compute[73188]: </disk>
Aug 15 19:11:26 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG nova.network.neutron [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Successfully created port: d5f8bc4e-22d5-457f-9eca-81ccf5442e8b {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.183s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Checking if we can resize image /opt/stack/data/nova/instances/514c4115-057d-4cd2-8869-daf3d38fa5de/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514c4115-057d-4cd2-8869-daf3d38fa5de/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_power_states {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514c4115-057d-4cd2-8869-daf3d38fa5de/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Cannot resize image /opt/stack/data/nova/instances/514c4115-057d-4cd2-8869-daf3d38fa5de/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG nova.objects.instance [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Lazy-loading 'migration_context' on Instance uuid 514c4115-057d-4cd2-8869-daf3d38fa5de {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Ensure instance console log exists: /opt/stack/data/nova/instances/514c4115-057d-4cd2-8869-daf3d38fa5de/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.004s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692126687.0623055, 0d5df01f-2a14-423a-9872-69132a3874ce => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0d5df01f-2a14-423a-9872-69132a3874ce {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:11:27 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Successfully detached device vdb from instance 0d5df01f-2a14-423a-9872-69132a3874ce from the live domain config.
Aug 15 19:11:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ayEVGZPN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:11:27 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:11:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:27 user nova-compute[73188]: WARNING nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] While synchronizing instance power states, found 13 instances in the database and 11 instances on the hypervisor.
Aug 15 19:11:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid d1b5f5bf-9672-40a8-83da-3a8f25007e91 {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid 7caf434b-1484-4832-afee-0e2454bb5089 {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid c3ca002b-c535-4b87-8d39-861ce6847f12 {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid 0d5df01f-2a14-423a-9872-69132a3874ce {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid 3d713d03-3e60-4dec-a295-a4652ac21842 {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid 082c19a9-6a4f-4f27-8c77-d37db7d2306a {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid e00adf53-085f-436d-a09f-e97e92ca79cd {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid de6929cd-c95d-4964-b81c-96872a137f90 {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid 139ccf1c-4792-4653-9475-c61b1f9c4846 {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid 215077af-60a1-4a82-b24e-1545349363d0 {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid 38af35a8-ea67-4871-8de9-57b04614faa3 {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid 514c4115-057d-4cd2-8869-daf3d38fa5de {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:27 user nova-compute[73188]: INFO nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "7caf434b-1484-4832-afee-0e2454bb5089" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "7caf434b-1484-4832-afee-0e2454bb5089" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "c3ca002b-c535-4b87-8d39-861ce6847f12" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "c3ca002b-c535-4b87-8d39-861ce6847f12" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "0d5df01f-2a14-423a-9872-69132a3874ce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "3d713d03-3e60-4dec-a295-a4652ac21842" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "3d713d03-3e60-4dec-a295-a4652ac21842" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "e00adf53-085f-436d-a09f-e97e92ca79cd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "e00adf53-085f-436d-a09f-e97e92ca79cd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "de6929cd-c95d-4964-b81c-96872a137f90" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "de6929cd-c95d-4964-b81c-96872a137f90" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "139ccf1c-4792-4653-9475-c61b1f9c4846" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "215077af-60a1-4a82-b24e-1545349363d0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "215077af-60a1-4a82-b24e-1545349363d0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "38af35a8-ea67-4871-8de9-57b04614faa3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "38af35a8-ea67-4871-8de9-57b04614faa3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "514c4115-057d-4cd2-8869-daf3d38fa5de" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5568f8-ae9e-4fdc-ab5f-422ae8dfab36]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4d6dcd-0b6a-4559-bb65-de14a2c2b672]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:11:27 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:11:27 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 (non-flash)
Aug 15 19:11:27 user nova-compute[73188]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:11:27 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28082c6050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178'): ({'sdi'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Removing single pathed devices sdi {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27df385-5210-41e8-a7b9-37645c3d2b4e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "7caf434b-1484-4832-afee-0e2454bb5089" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "3d713d03-3e60-4dec-a295-a4652ac21842" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "c3ca002b-c535-4b87-8d39-861ce6847f12" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[639f387c-ca1e-4b85-bb3f-1a366d17c879]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Flushing IO for device /dev/sdi {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "e00adf53-085f-436d-a09f-e97e92ca79cd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "de6929cd-c95d-4964-b81c-96872a137f90" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "38af35a8-ea67-4871-8de9-57b04614faa3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbb1114-e923-4f8a-bd4c-6e20b8c50061]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "215077af-60a1-4a82-b24e-1545349363d0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.047s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adc9cd0-a157-43ef-8302-1dc516bff592]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] SCSI volumes sdi have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ce4a78-b8f6-48d7-b3f5-9daf3bd95630]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae60d06-ae99-4cef-8f0b-660b5e44ea5d]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178, portal: 172.16.0.220,3260]
Aug 15 19:11:27 user nova-compute[73188]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178, portal: 172.16.0.220,3260] successful.
Aug 15 19:11:27 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdb52c-10ca-4922-aeb0-2cd724546178 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd41fa9-473a-4754-beae-1c95f5e4aad6]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] <== disconnect_volume: return (322ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG nova.network.neutron [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Successfully updated port: d5f8bc4e-22d5-457f-9eca-81ccf5442e8b {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Acquiring lock "refresh_cache-514c4115-057d-4cd2-8869-daf3d38fa5de" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Acquired lock "refresh_cache-514c4115-057d-4cd2-8869-daf3d38fa5de" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG nova.network.neutron [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG nova.compute.manager [req-cf26f946-6688-4288-a401-07a986c3bf13 req-9c4a9e1e-55e8-4b7d-8ef5-5ee51fe2da09 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Received event network-changed-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG nova.compute.manager [req-cf26f946-6688-4288-a401-07a986c3bf13 req-9c4a9e1e-55e8-4b7d-8ef5-5ee51fe2da09 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Refreshing instance network info cache due to event network-changed-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cf26f946-6688-4288-a401-07a986c3bf13 req-9c4a9e1e-55e8-4b7d-8ef5-5ee51fe2da09 service nova] Acquiring lock "refresh_cache-514c4115-057d-4cd2-8869-daf3d38fa5de" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:11:27 user nova-compute[73188]: DEBUG nova.network.neutron [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.network.neutron [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Updating instance_info_cache with network_info: [{"id": "d5f8bc4e-22d5-457f-9eca-81ccf5442e8b", "address": "fa:16:3e:0d:a6:aa", "network": {"id": "d238bdf0-2605-488f-b339-ad066bb65e0a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-404711833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508c36eff4c347438cd7a3d0c035c479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f8bc4e-22", "ovs_interfaceid": "d5f8bc4e-22d5-457f-9eca-81ccf5442e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.objects.instance [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lazy-loading 'flavor' on Instance uuid 0d5df01f-2a14-423a-9872-69132a3874ce {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Releasing lock "refresh_cache-514c4115-057d-4cd2-8869-daf3d38fa5de" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.compute.manager [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Instance network_info: |[{"id": "d5f8bc4e-22d5-457f-9eca-81ccf5442e8b", "address": "fa:16:3e:0d:a6:aa", "network": {"id": "d238bdf0-2605-488f-b339-ad066bb65e0a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-404711833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508c36eff4c347438cd7a3d0c035c479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f8bc4e-22", "ovs_interfaceid": "d5f8bc4e-22d5-457f-9eca-81ccf5442e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cf26f946-6688-4288-a401-07a986c3bf13 req-9c4a9e1e-55e8-4b7d-8ef5-5ee51fe2da09 service nova] Acquired lock "refresh_cache-514c4115-057d-4cd2-8869-daf3d38fa5de" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.network.neutron [req-cf26f946-6688-4288-a401-07a986c3bf13 req-9c4a9e1e-55e8-4b7d-8ef5-5ee51fe2da09 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Refreshing network info cache for port d5f8bc4e-22d5-457f-9eca-81ccf5442e8b {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Start _get_guest_xml network_info=[{"id": "d5f8bc4e-22d5-457f-9eca-81ccf5442e8b", "address": "fa:16:3e:0d:a6:aa", "network": {"id": "d238bdf0-2605-488f-b339-ad066bb65e0a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-404711833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508c36eff4c347438cd7a3d0c035c479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f8bc4e-22", "ovs_interfaceid": "d5f8bc4e-22d5-457f-9eca-81ccf5442e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:11:28 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:11:28 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:11:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-577b42f2-9d21-4ed3-988a-c90d32add70d tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "0d5df01f-2a14-423a-9872-69132a3874ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.909s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "0d5df01f-2a14-423a-9872-69132a3874ce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.145s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-320628993',display_name='tempest-VolumesActionsTest-instance-320628993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-320628993',id=21,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='508c36eff4c347438cd7a3d0c035c479',ramdisk_id='',reservation_id='r-44i6k9qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1096761073',owner_user_name='tempest-VolumesActionsTest-1096761073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:11:26Z,user_data=None,user_id='f0af9d72e3404f7f8d1657b11116656e',uuid=514c4115-057d-4cd2-8869-daf3d38fa5de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5f8bc4e-22d5-457f-9eca-81ccf5442e8b", "address": "fa:16:3e:0d:a6:aa", "network": {"id": "d238bdf0-2605-488f-b339-ad066bb65e0a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-404711833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508c36eff4c347438cd7a3d0c035c479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f8bc4e-22", "ovs_interfaceid": "d5f8bc4e-22d5-457f-9eca-81ccf5442e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Converting VIF {"id": "d5f8bc4e-22d5-457f-9eca-81ccf5442e8b", "address": "fa:16:3e:0d:a6:aa", "network": {"id": "d238bdf0-2605-488f-b339-ad066bb65e0a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-404711833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508c36eff4c347438cd7a3d0c035c479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f8bc4e-22", "ovs_interfaceid": "d5f8bc4e-22d5-457f-9eca-81ccf5442e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:a6:aa,bridge_name='br-int',has_traffic_filtering=True,id=d5f8bc4e-22d5-457f-9eca-81ccf5442e8b,network=Network(d238bdf0-2605-488f-b339-ad066bb65e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f8bc4e-22') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.objects.instance [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Lazy-loading 'pci_devices' on Instance uuid 514c4115-057d-4cd2-8869-daf3d38fa5de {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "0d5df01f-2a14-423a-9872-69132a3874ce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:11:28 user nova-compute[73188]:   <uuid>514c4115-057d-4cd2-8869-daf3d38fa5de</uuid>
Aug 15 19:11:28 user nova-compute[73188]:   <name>instance-00000015</name>
Aug 15 19:11:28 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:11:28 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:11:28 user nova-compute[73188]:   <metadata>
Aug 15 19:11:28 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:11:28 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:11:28 user nova-compute[73188]:       <nova:name>tempest-VolumesActionsTest-instance-320628993</nova:name>
Aug 15 19:11:28 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:11:28</nova:creationTime>
Aug 15 19:11:28 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:11:28 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:11:28 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:11:28 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:11:28 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:11:28 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:11:28 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:11:28 user nova-compute[73188]:       <nova:owner>
Aug 15 19:11:28 user nova-compute[73188]:         <nova:user uuid="f0af9d72e3404f7f8d1657b11116656e">tempest-VolumesActionsTest-1096761073-project-member</nova:user>
Aug 15 19:11:28 user nova-compute[73188]:         <nova:project uuid="508c36eff4c347438cd7a3d0c035c479">tempest-VolumesActionsTest-1096761073</nova:project>
Aug 15 19:11:28 user nova-compute[73188]:       </nova:owner>
Aug 15 19:11:28 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:11:28 user nova-compute[73188]:       <nova:ports>
Aug 15 19:11:28 user nova-compute[73188]:         <nova:port uuid="d5f8bc4e-22d5-457f-9eca-81ccf5442e8b">
Aug 15 19:11:28 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 19:11:28 user nova-compute[73188]:         </nova:port>
Aug 15 19:11:28 user nova-compute[73188]:       </nova:ports>
Aug 15 19:11:28 user nova-compute[73188]:     </nova:instance>
Aug 15 19:11:28 user nova-compute[73188]:   </metadata>
Aug 15 19:11:28 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:11:28 user nova-compute[73188]:     <system>
Aug 15 19:11:28 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:11:28 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:11:28 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:11:28 user nova-compute[73188]:       <entry name="serial">514c4115-057d-4cd2-8869-daf3d38fa5de</entry>
Aug 15 19:11:28 user nova-compute[73188]:       <entry name="uuid">514c4115-057d-4cd2-8869-daf3d38fa5de</entry>
Aug 15 19:11:28 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:11:28 user nova-compute[73188]:     </system>
Aug 15 19:11:28 user nova-compute[73188]:   </sysinfo>
Aug 15 19:11:28 user nova-compute[73188]:   <os>
Aug 15 19:11:28 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:11:28 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:11:28 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:11:28 user nova-compute[73188]:   </os>
Aug 15 19:11:28 user nova-compute[73188]:   <features>
Aug 15 19:11:28 user nova-compute[73188]:     <acpi/>
Aug 15 19:11:28 user nova-compute[73188]:     <apic/>
Aug 15 19:11:28 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:11:28 user nova-compute[73188]:   </features>
Aug 15 19:11:28 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:11:28 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:11:28 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:11:28 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:11:28 user nova-compute[73188]:   </clock>
Aug 15 19:11:28 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:11:28 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:11:28 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:11:28 user nova-compute[73188]:   </cpu>
Aug 15 19:11:28 user nova-compute[73188]:   <devices>
Aug 15 19:11:28 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:11:28 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:11:28 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/514c4115-057d-4cd2-8869-daf3d38fa5de/disk"/>
Aug 15 19:11:28 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:11:28 user nova-compute[73188]:     </disk>
Aug 15 19:11:28 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:11:28 user nova-compute[73188]:       <mac address="fa:16:3e:0d:a6:aa"/>
Aug 15 19:11:28 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:11:28 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:11:28 user nova-compute[73188]:       <target dev="tapd5f8bc4e-22"/>
Aug 15 19:11:28 user nova-compute[73188]:     </interface>
Aug 15 19:11:28 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:11:28 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/514c4115-057d-4cd2-8869-daf3d38fa5de/console.log" append="off"/>
Aug 15 19:11:28 user nova-compute[73188]:     </serial>
Aug 15 19:11:28 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:11:28 user nova-compute[73188]:     <video>
Aug 15 19:11:28 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:11:28 user nova-compute[73188]:     </video>
Aug 15 19:11:28 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:11:28 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:11:28 user nova-compute[73188]:     </rng>
Aug 15 19:11:28 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:11:28 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:11:28 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:11:28 user nova-compute[73188]:     </memballoon>
Aug 15 19:11:28 user nova-compute[73188]:   </devices>
Aug 15 19:11:28 user nova-compute[73188]: </domain>
Aug 15 19:11:28 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-320628993',display_name='tempest-VolumesActionsTest-instance-320628993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-320628993',id=21,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='508c36eff4c347438cd7a3d0c035c479',ramdisk_id='',reservation_id='r-44i6k9qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1096761073',owner_user_name='tempest-VolumesActionsTest-1096761073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:11:26Z,user_data=None,user_id='f0af9d72e3404f7f8d1657b11116656e',uuid=514c4115-057d-4cd2-8869-daf3d38fa5de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5f8bc4e-22d5-457f-9eca-81ccf5442e8b", "address": "fa:16:3e:0d:a6:aa", "network": {"id": "d238bdf0-2605-488f-b339-ad066bb65e0a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-404711833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508c36eff4c347438cd7a3d0c035c479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f8bc4e-22", "ovs_interfaceid": "d5f8bc4e-22d5-457f-9eca-81ccf5442e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Converting VIF {"id": "d5f8bc4e-22d5-457f-9eca-81ccf5442e8b", "address": "fa:16:3e:0d:a6:aa", "network": {"id": "d238bdf0-2605-488f-b339-ad066bb65e0a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-404711833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508c36eff4c347438cd7a3d0c035c479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f8bc4e-22", "ovs_interfaceid": "d5f8bc4e-22d5-457f-9eca-81ccf5442e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:a6:aa,bridge_name='br-int',has_traffic_filtering=True,id=d5f8bc4e-22d5-457f-9eca-81ccf5442e8b,network=Network(d238bdf0-2605-488f-b339-ad066bb65e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f8bc4e-22') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG os_vif [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:a6:aa,bridge_name='br-int',has_traffic_filtering=True,id=d5f8bc4e-22d5-457f-9eca-81ccf5442e8b,network=Network(d238bdf0-2605-488f-b339-ad066bb65e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f8bc4e-22') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5f8bc4e-22, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5f8bc4e-22, col_values=(('external_ids', {'iface-id': 'd5f8bc4e-22d5-457f-9eca-81ccf5442e8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:a6:aa', 'vm-uuid': '514c4115-057d-4cd2-8869-daf3d38fa5de'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:28 user nova-compute[73188]: INFO os_vif [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:a6:aa,bridge_name='br-int',has_traffic_filtering=True,id=d5f8bc4e-22d5-457f-9eca-81ccf5442e8b,network=Network(d238bdf0-2605-488f-b339-ad066bb65e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f8bc4e-22')
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] No VIF found with MAC fa:16:3e:0d:a6:aa, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.network.neutron [req-cf26f946-6688-4288-a401-07a986c3bf13 req-9c4a9e1e-55e8-4b7d-8ef5-5ee51fe2da09 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Updated VIF entry in instance network info cache for port d5f8bc4e-22d5-457f-9eca-81ccf5442e8b. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG nova.network.neutron [req-cf26f946-6688-4288-a401-07a986c3bf13 req-9c4a9e1e-55e8-4b7d-8ef5-5ee51fe2da09 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Updating instance_info_cache with network_info: [{"id": "d5f8bc4e-22d5-457f-9eca-81ccf5442e8b", "address": "fa:16:3e:0d:a6:aa", "network": {"id": "d238bdf0-2605-488f-b339-ad066bb65e0a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-404711833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508c36eff4c347438cd7a3d0c035c479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f8bc4e-22", "ovs_interfaceid": "d5f8bc4e-22d5-457f-9eca-81ccf5442e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:11:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cf26f946-6688-4288-a401-07a986c3bf13 req-9c4a9e1e-55e8-4b7d-8ef5-5ee51fe2da09 service nova] Releasing lock "refresh_cache-514c4115-057d-4cd2-8869-daf3d38fa5de" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Starting finish_revert_migration {{(pid=73188) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Start _get_guest_xml network_info=[{"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUBLTriK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd1b5f5bf-9672-40a8-83da-3a8f25007e91', 'attached_at': '2023-08-15T19:11:29.000000', 'detached_at': '', 'volume_id': 'a56bdc00-9527-4777-a55c-7791842e4c65', 'serial': 'a56bdc00-9527-4777-a55c-7791842e4c65'}, 'attachment_id': 'ac37d95b-4ba8-4d7f-8b1c-f90747f6f055', 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:11:29 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:11:29 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:11:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG nova.objects.instance [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lazy-loading 'vcpu_model' on Instance uuid d1b5f5bf-9672-40a8-83da-3a8f25007e91 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUBLTriK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:11:29 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:11:29 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:11:29 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb2aca3-e803-4f61-925c-8ddb2ad20bb2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:11:29 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafc922d-67ca-4da9-8579-65adeff5ef9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65] added
Aug 15 19:11:29 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a64399-4b3d-4d4b-9c1c-92382f548358]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dce2b48-79cb-42b4-9aef-740922ea3385]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUBLTriK {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUBLTriK" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abad3c0-19e0-4760-83af-adabfd850727]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cUBLTriK'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[387d2d69-cccf-4753-ac1b-2f2aa23fa6dd]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1755fa5d-0b06-422b-92ec-1f935b712f79]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:11:29 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:11:29 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1e1ed1-92a8-48f3-9491-c9e05a6d6143]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260]
Aug 15 19:11:29 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260] successful.
Aug 15 19:11:29 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee368d3d-35e0-44c4-adb4-67133e21524a]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6b68de-5a17-4115-9b8c-250087578225]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:11:29 user nova-compute[73188]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)
Aug 15 19:11:29 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:11:29 user nova-compute[73188]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)
Aug 15 19:11:29 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c257a15-c257-4e64-937d-68dacbba782e]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUBLTriK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG nova.compute.manager [req-be2fd5be-857a-4a48-bc52-853e5afab41a req-e81a2003-8b04-47e2-bda1-970401ae91a8 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Received event network-vif-plugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-be2fd5be-857a-4a48-bc52-853e5afab41a req-e81a2003-8b04-47e2-bda1-970401ae91a8 service nova] Acquiring lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-be2fd5be-857a-4a48-bc52-853e5afab41a req-e81a2003-8b04-47e2-bda1-970401ae91a8 service nova] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-be2fd5be-857a-4a48-bc52-853e5afab41a req-e81a2003-8b04-47e2-bda1-970401ae91a8 service nova] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:29 user nova-compute[73188]: DEBUG nova.compute.manager [req-be2fd5be-857a-4a48-bc52-853e5afab41a req-e81a2003-8b04-47e2-bda1-970401ae91a8 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] No waiting events found dispatching network-vif-plugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:11:30 user nova-compute[73188]: WARNING nova.compute.manager [req-be2fd5be-857a-4a48-bc52-853e5afab41a req-e81a2003-8b04-47e2-bda1-970401ae91a8 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Received unexpected event network-vif-plugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b for instance with vm_state building and task_state spawning.
Aug 15 19:11:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23833613130326337', 'path': '/dev/sdc'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833613130326337', 'path': '/dev/sdc'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2075783787',display_name='tempest-ServerActionsTestOtherB-server-2075783787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2075783787',id=2,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGAn2WMlt73NTUykPIA6PkYCDLbBTR2Yho5Rj2kET8coL/tBEtc4GHmcnA5ijjJ1l2hsUy4+ooa5E/SUoQZ5kfWNtXI5i4fVvpa+4mLZw6dteSEtg5YyfVDHt6PHs7vAQ==',key_name='tempest-keypair-93276017',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:09:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='418458ca9ca647788ef8dd45ced52707',ramdisk_id='',reservation_id='r-36kpwfhi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1641219687',owner_user_name='tempest-ServerActionsTestOtherB-1641219687-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:11:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60be9c6b4c1b4f4b9038a3a6af7c3648',uuid=d1b5f5bf-9672-40a8-83da-3a8f25007e91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Converting VIF {"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:5e:42,bridge_name='br-int',has_traffic_filtering=True,id=d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a,network=Network(10d6e7cc-813b-43e5-850a-cbdd4bd41525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5133aa6-a8') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:11:30 user nova-compute[73188]:   <uuid>d1b5f5bf-9672-40a8-83da-3a8f25007e91</uuid>
Aug 15 19:11:30 user nova-compute[73188]:   <name>instance-00000002</name>
Aug 15 19:11:30 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:11:30 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:11:30 user nova-compute[73188]:   <metadata>
Aug 15 19:11:30 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:11:30 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:11:30 user nova-compute[73188]:       <nova:name>tempest-ServerActionsTestOtherB-server-2075783787</nova:name>
Aug 15 19:11:30 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:11:29</nova:creationTime>
Aug 15 19:11:30 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:11:30 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:11:30 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:11:30 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:11:30 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:11:30 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:11:30 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:11:30 user nova-compute[73188]:       <nova:owner>
Aug 15 19:11:30 user nova-compute[73188]:         <nova:user uuid="60be9c6b4c1b4f4b9038a3a6af7c3648">tempest-ServerActionsTestOtherB-1641219687-project-member</nova:user>
Aug 15 19:11:30 user nova-compute[73188]:         <nova:project uuid="418458ca9ca647788ef8dd45ced52707">tempest-ServerActionsTestOtherB-1641219687</nova:project>
Aug 15 19:11:30 user nova-compute[73188]:       </nova:owner>
Aug 15 19:11:30 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:11:30 user nova-compute[73188]:       <nova:ports>
Aug 15 19:11:30 user nova-compute[73188]:         <nova:port uuid="d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a">
Aug 15 19:11:30 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 19:11:30 user nova-compute[73188]:         </nova:port>
Aug 15 19:11:30 user nova-compute[73188]:       </nova:ports>
Aug 15 19:11:30 user nova-compute[73188]:     </nova:instance>
Aug 15 19:11:30 user nova-compute[73188]:   </metadata>
Aug 15 19:11:30 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:11:30 user nova-compute[73188]:     <system>
Aug 15 19:11:30 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:11:30 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:11:30 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:11:30 user nova-compute[73188]:       <entry name="serial">d1b5f5bf-9672-40a8-83da-3a8f25007e91</entry>
Aug 15 19:11:30 user nova-compute[73188]:       <entry name="uuid">d1b5f5bf-9672-40a8-83da-3a8f25007e91</entry>
Aug 15 19:11:30 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:11:30 user nova-compute[73188]:     </system>
Aug 15 19:11:30 user nova-compute[73188]:   </sysinfo>
Aug 15 19:11:30 user nova-compute[73188]:   <os>
Aug 15 19:11:30 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:11:30 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:11:30 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:11:30 user nova-compute[73188]:   </os>
Aug 15 19:11:30 user nova-compute[73188]:   <features>
Aug 15 19:11:30 user nova-compute[73188]:     <acpi/>
Aug 15 19:11:30 user nova-compute[73188]:     <apic/>
Aug 15 19:11:30 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:11:30 user nova-compute[73188]:   </features>
Aug 15 19:11:30 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:11:30 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:11:30 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:11:30 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:11:30 user nova-compute[73188]:   </clock>
Aug 15 19:11:30 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:11:30 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:11:30 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:11:30 user nova-compute[73188]:   </cpu>
Aug 15 19:11:30 user nova-compute[73188]:   <devices>
Aug 15 19:11:30 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:11:30 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:11:30 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk"/>
Aug 15 19:11:30 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:11:30 user nova-compute[73188]:     </disk>
Aug 15 19:11:30 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:11:30 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:11:30 user nova-compute[73188]:       <source dev="/dev/sdc"/>
Aug 15 19:11:30 user nova-compute[73188]:       <target dev="vdb" bus="virtio"/>
Aug 15 19:11:30 user nova-compute[73188]:       <serial>a56bdc00-9527-4777-a55c-7791842e4c65</serial>
Aug 15 19:11:30 user nova-compute[73188]:     </disk>
Aug 15 19:11:30 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:11:30 user nova-compute[73188]:       <mac address="fa:16:3e:10:5e:42"/>
Aug 15 19:11:30 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:11:30 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:11:30 user nova-compute[73188]:       <target dev="tapd5133aa6-a8"/>
Aug 15 19:11:30 user nova-compute[73188]:     </interface>
Aug 15 19:11:30 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:11:30 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/console.log" append="off"/>
Aug 15 19:11:30 user nova-compute[73188]:     </serial>
Aug 15 19:11:30 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:11:30 user nova-compute[73188]:     <video>
Aug 15 19:11:30 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:11:30 user nova-compute[73188]:     </video>
Aug 15 19:11:30 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:11:30 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:11:30 user nova-compute[73188]:     </rng>
Aug 15 19:11:30 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:11:30 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:11:30 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:11:30 user nova-compute[73188]:     </memballoon>
Aug 15 19:11:30 user nova-compute[73188]:   </devices>
Aug 15 19:11:30 user nova-compute[73188]: </domain>
Aug 15 19:11:30 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2075783787',display_name='tempest-ServerActionsTestOtherB-server-2075783787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2075783787',id=2,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGAn2WMlt73NTUykPIA6PkYCDLbBTR2Yho5Rj2kET8coL/tBEtc4GHmcnA5ijjJ1l2hsUy4+ooa5E/SUoQZ5kfWNtXI5i4fVvpa+4mLZw6dteSEtg5YyfVDHt6PHs7vAQ==',key_name='tempest-keypair-93276017',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:09:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='418458ca9ca647788ef8dd45ced52707',ramdisk_id='',reservation_id='r-36kpwfhi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1641219687',owner_user_name='tempest-ServerActionsTestOtherB-1641219687-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:11:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60be9c6b4c1b4f4b9038a3a6af7c3648',uuid=d1b5f5bf-9672-40a8-83da-3a8f25007e91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Converting VIF {"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:5e:42,bridge_name='br-int',has_traffic_filtering=True,id=d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a,network=Network(10d6e7cc-813b-43e5-850a-cbdd4bd41525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5133aa6-a8') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG os_vif [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:5e:42,bridge_name='br-int',has_traffic_filtering=True,id=d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a,network=Network(10d6e7cc-813b-43e5-850a-cbdd4bd41525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5133aa6-a8') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5133aa6-a8, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5133aa6-a8, col_values=(('external_ids', {'iface-id': 'd5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:5e:42', 'vm-uuid': 'd1b5f5bf-9672-40a8-83da-3a8f25007e91'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:11:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:30 user nova-compute[73188]: INFO os_vif [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:5e:42,bridge_name='br-int',has_traffic_filtering=True,id=d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a,network=Network(10d6e7cc-813b-43e5-850a-cbdd4bd41525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5133aa6-a8')
Aug 15 19:11:30 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692126675.7591457, d1b5f5bf-9672-40a8-83da-3a8f25007e91 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:11:30 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] VM Stopped (Lifecycle Event)
Aug 15 19:11:30 user nova-compute[73188]: DEBUG nova.compute.manager [None req-199dedc8-7337-41d4-8bf8-2c23ef00fe81 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:11:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:32 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126692.0327697, 514c4115-057d-4cd2-8869-daf3d38fa5de => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:11:32 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] VM Resumed (Lifecycle Event)
Aug 15 19:11:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:11:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:11:32 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Instance spawned successfully.
Aug 15 19:11:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:11:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:11:32 user nova-compute[73188]: DEBUG nova.compute.manager [req-6b2511f0-5e1e-43a5-ba5d-230e7ba10e52 req-6fe09284-624c-4946-9274-6009ee372f25 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Received event network-vif-plugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:11:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6b2511f0-5e1e-43a5-ba5d-230e7ba10e52 req-6fe09284-624c-4946-9274-6009ee372f25 service nova] Acquiring lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6b2511f0-5e1e-43a5-ba5d-230e7ba10e52 req-6fe09284-624c-4946-9274-6009ee372f25 service nova] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6b2511f0-5e1e-43a5-ba5d-230e7ba10e52 req-6fe09284-624c-4946-9274-6009ee372f25 service nova] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:32 user nova-compute[73188]: DEBUG nova.compute.manager [req-6b2511f0-5e1e-43a5-ba5d-230e7ba10e52 req-6fe09284-624c-4946-9274-6009ee372f25 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] No waiting events found dispatching network-vif-plugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:11:32 user nova-compute[73188]: WARNING nova.compute.manager [req-6b2511f0-5e1e-43a5-ba5d-230e7ba10e52 req-6fe09284-624c-4946-9274-6009ee372f25 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Received unexpected event network-vif-plugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b for instance with vm_state building and task_state spawning.
Aug 15 19:11:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:11:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:11:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:11:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:11:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:11:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:11:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:11:32 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:11:32 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126692.0340948, 514c4115-057d-4cd2-8869-daf3d38fa5de => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:11:32 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] VM Started (Lifecycle Event)
Aug 15 19:11:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:11:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:11:32 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:11:32 user nova-compute[73188]: INFO nova.compute.manager [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Took 6.23 seconds to spawn the instance on the hypervisor.
Aug 15 19:11:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:11:32 user nova-compute[73188]: INFO nova.compute.manager [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Took 7.12 seconds to build instance.
Aug 15 19:11:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9a316754-0c69-4f56-a776-3d14d262ff1f tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.220s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.186s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:32 user nova-compute[73188]: INFO nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:11:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:34 user nova-compute[73188]: DEBUG nova.compute.manager [req-296002e9-408a-4aa9-923a-037d91ae1942 req-e1a24ea8-a5b5-4f6b-8abb-330ef8ff7424 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received event network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:11:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-296002e9-408a-4aa9-923a-037d91ae1942 req-e1a24ea8-a5b5-4f6b-8abb-330ef8ff7424 service nova] Acquiring lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-296002e9-408a-4aa9-923a-037d91ae1942 req-e1a24ea8-a5b5-4f6b-8abb-330ef8ff7424 service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-296002e9-408a-4aa9-923a-037d91ae1942 req-e1a24ea8-a5b5-4f6b-8abb-330ef8ff7424 service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:34 user nova-compute[73188]: DEBUG nova.compute.manager [req-296002e9-408a-4aa9-923a-037d91ae1942 req-e1a24ea8-a5b5-4f6b-8abb-330ef8ff7424 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] No waiting events found dispatching network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:11:34 user nova-compute[73188]: WARNING nova.compute.manager [req-296002e9-408a-4aa9-923a-037d91ae1942 req-e1a24ea8-a5b5-4f6b-8abb-330ef8ff7424 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received unexpected event network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a for instance with vm_state resized and task_state resize_reverting.
Aug 15 19:11:34 user nova-compute[73188]: DEBUG nova.compute.manager [req-296002e9-408a-4aa9-923a-037d91ae1942 req-e1a24ea8-a5b5-4f6b-8abb-330ef8ff7424 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received event network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:11:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-296002e9-408a-4aa9-923a-037d91ae1942 req-e1a24ea8-a5b5-4f6b-8abb-330ef8ff7424 service nova] Acquiring lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-296002e9-408a-4aa9-923a-037d91ae1942 req-e1a24ea8-a5b5-4f6b-8abb-330ef8ff7424 service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-296002e9-408a-4aa9-923a-037d91ae1942 req-e1a24ea8-a5b5-4f6b-8abb-330ef8ff7424 service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:34 user nova-compute[73188]: DEBUG nova.compute.manager [req-296002e9-408a-4aa9-923a-037d91ae1942 req-e1a24ea8-a5b5-4f6b-8abb-330ef8ff7424 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] No waiting events found dispatching network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:11:34 user nova-compute[73188]: WARNING nova.compute.manager [req-296002e9-408a-4aa9-923a-037d91ae1942 req-e1a24ea8-a5b5-4f6b-8abb-330ef8ff7424 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received unexpected event network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a for instance with vm_state resized and task_state resize_reverting.
Aug 15 19:11:34 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126694.1343405, d1b5f5bf-9672-40a8-83da-3a8f25007e91 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:11:34 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] VM Resumed (Lifecycle Event)
Aug 15 19:11:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:11:34 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Instance running successfully.
Aug 15 19:11:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] finish_revert_migration finished successfully. {{(pid=73188) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 15 19:11:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:11:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:11:34 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 15 19:11:34 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126694.1360476, d1b5f5bf-9672-40a8-83da-3a8f25007e91 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:11:34 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] VM Started (Lifecycle Event)
Aug 15 19:11:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:11:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:11:34 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 15 19:11:34 user nova-compute[73188]: INFO nova.compute.manager [None req-4313a514-ba0f-4c6c-9f94-5257eec8ace6 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Updating instance to original state: 'active'
Aug 15 19:11:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Acquiring lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Acquiring lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:36 user nova-compute[73188]: INFO nova.compute.manager [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Terminating instance
Aug 15 19:11:36 user nova-compute[73188]: DEBUG nova.compute.manager [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:11:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:37 user nova-compute[73188]: DEBUG nova.compute.manager [req-c78bccb1-5c7c-451a-822e-2550fe4e3dcc req-4e4f5aa4-1616-4e33-a4b0-74ca079809d9 service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Received event network-vif-unplugged-2d3fdbfd-6453-4c6f-ad40-09561b8a4908 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:11:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c78bccb1-5c7c-451a-822e-2550fe4e3dcc req-4e4f5aa4-1616-4e33-a4b0-74ca079809d9 service nova] Acquiring lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c78bccb1-5c7c-451a-822e-2550fe4e3dcc req-4e4f5aa4-1616-4e33-a4b0-74ca079809d9 service nova] Lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c78bccb1-5c7c-451a-822e-2550fe4e3dcc req-4e4f5aa4-1616-4e33-a4b0-74ca079809d9 service nova] Lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:37 user nova-compute[73188]: DEBUG nova.compute.manager [req-c78bccb1-5c7c-451a-822e-2550fe4e3dcc req-4e4f5aa4-1616-4e33-a4b0-74ca079809d9 service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] No waiting events found dispatching network-vif-unplugged-2d3fdbfd-6453-4c6f-ad40-09561b8a4908 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:11:37 user nova-compute[73188]: DEBUG nova.compute.manager [req-c78bccb1-5c7c-451a-822e-2550fe4e3dcc req-4e4f5aa4-1616-4e33-a4b0-74ca079809d9 service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Received event network-vif-unplugged-2d3fdbfd-6453-4c6f-ad40-09561b8a4908 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:11:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:37 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Instance destroyed successfully.
Aug 15 19:11:37 user nova-compute[73188]: DEBUG nova.objects.instance [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lazy-loading 'resources' on Instance uuid 082c19a9-6a4f-4f27-8c77-d37db7d2306a {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:11:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-866054589',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-866054589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8660545',id=14,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKwC0o4tZJseST53mAbAZ+7raLurbyWxbskPrRQOXyUtQ9/DTpcZAJgCfh2OzxRkzxPl+m9Rr47U+9+4qmQVJ1CX7WsNekWpwVABeXfHRnFWaxq9VQe2LrAq62Oa/+Kyw==',key_name='tempest-keypair-1211840095',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:08:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7aeee537b84a4e42b0ef67c309d14c1c',ramdisk_id='',reservation_id='r-u5n7aif3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1844885147',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:08:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8f043ccdccd47cbac54339585154dc4',uuid=082c19a9-6a4f-4f27-8c77-d37db7d2306a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d3fdbfd-6453-4c6f-ad40-09561b8a4908", "address": "fa:16:3e:1f:48:37", "network": {"id": "ebc6093a-4273-43c5-9d01-0abe8a3a37b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1075513938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aeee537b84a4e42b0ef67c309d14c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3fdbfd-64", "ovs_interfaceid": "2d3fdbfd-6453-4c6f-ad40-09561b8a4908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:11:37 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Converting VIF {"id": "2d3fdbfd-6453-4c6f-ad40-09561b8a4908", "address": "fa:16:3e:1f:48:37", "network": {"id": "ebc6093a-4273-43c5-9d01-0abe8a3a37b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1075513938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aeee537b84a4e42b0ef67c309d14c1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3fdbfd-64", "ovs_interfaceid": "2d3fdbfd-6453-4c6f-ad40-09561b8a4908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:11:37 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:48:37,bridge_name='br-int',has_traffic_filtering=True,id=2d3fdbfd-6453-4c6f-ad40-09561b8a4908,network=Network(ebc6093a-4273-43c5-9d01-0abe8a3a37b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3fdbfd-64') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:11:37 user nova-compute[73188]: DEBUG os_vif [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:48:37,bridge_name='br-int',has_traffic_filtering=True,id=2d3fdbfd-6453-4c6f-ad40-09561b8a4908,network=Network(ebc6093a-4273-43c5-9d01-0abe8a3a37b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3fdbfd-64') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:11:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d3fdbfd-64, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:11:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:11:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:37 user nova-compute[73188]: INFO os_vif [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:48:37,bridge_name='br-int',has_traffic_filtering=True,id=2d3fdbfd-6453-4c6f-ad40-09561b8a4908,network=Network(ebc6093a-4273-43c5-9d01-0abe8a3a37b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3fdbfd-64')
Aug 15 19:11:37 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Deleting instance files /opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a_del
Aug 15 19:11:37 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Deletion of /opt/stack/data/nova/instances/082c19a9-6a4f-4f27-8c77-d37db7d2306a_del complete
Aug 15 19:11:37 user nova-compute[73188]: INFO nova.compute.manager [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 15 19:11:37 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:11:37 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:11:37 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:11:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:38 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:11:38 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Took 0.94 seconds to deallocate network for instance.
Aug 15 19:11:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-53c9c28e-457d-400d-b8b7-3ed74d36fdd9 req-2e31d20c-aa5a-4994-9a9b-98dcb94b05e2 service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Received event network-vif-deleted-2d3fdbfd-6453-4c6f-ad40-09561b8a4908 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:11:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:38 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:11:38 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:11:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:39 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Deleted allocations for instance 082c19a9-6a4f-4f27-8c77-d37db7d2306a
Aug 15 19:11:39 user nova-compute[73188]: DEBUG nova.compute.manager [req-2c2da64d-3549-42df-b6c2-810a374e8f6c req-c7787898-ba18-49e0-b9a5-e24aea40957e service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Received event network-vif-plugged-2d3fdbfd-6453-4c6f-ad40-09561b8a4908 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:11:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2c2da64d-3549-42df-b6c2-810a374e8f6c req-c7787898-ba18-49e0-b9a5-e24aea40957e service nova] Acquiring lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2c2da64d-3549-42df-b6c2-810a374e8f6c req-c7787898-ba18-49e0-b9a5-e24aea40957e service nova] Lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2c2da64d-3549-42df-b6c2-810a374e8f6c req-c7787898-ba18-49e0-b9a5-e24aea40957e service nova] Lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:39 user nova-compute[73188]: DEBUG nova.compute.manager [req-2c2da64d-3549-42df-b6c2-810a374e8f6c req-c7787898-ba18-49e0-b9a5-e24aea40957e service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] No waiting events found dispatching network-vif-plugged-2d3fdbfd-6453-4c6f-ad40-09561b8a4908 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:11:39 user nova-compute[73188]: WARNING nova.compute.manager [req-2c2da64d-3549-42df-b6c2-810a374e8f6c req-c7787898-ba18-49e0-b9a5-e24aea40957e service nova] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Received unexpected event network-vif-plugged-2d3fdbfd-6453-4c6f-ad40-09561b8a4908 for instance with vm_state deleted and task_state None.
Aug 15 19:11:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-26fa9392-312b-4ef6-baf1-b9bce55f64b8 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147 tempest-TestServerVolumeAttachScenarioOldVersion-1844885147-project-member] Lock "082c19a9-6a4f-4f27-8c77-d37db7d2306a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.530s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "c3ca002b-c535-4b87-8d39-861ce6847f12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "c3ca002b-c535-4b87-8d39-861ce6847f12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "c3ca002b-c535-4b87-8d39-861ce6847f12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "c3ca002b-c535-4b87-8d39-861ce6847f12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "c3ca002b-c535-4b87-8d39-861ce6847f12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:50 user nova-compute[73188]: INFO nova.compute.manager [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Terminating instance
Aug 15 19:11:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:11:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-76981601-b256-4091-936c-e174a43b81e1 req-d81ce1b3-180f-4353-bd84-1018e24f83a2 service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Received event network-vif-unplugged-933ca0dd-f8d4-4a81-86e9-83a706d12d82 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:11:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-76981601-b256-4091-936c-e174a43b81e1 req-d81ce1b3-180f-4353-bd84-1018e24f83a2 service nova] Acquiring lock "c3ca002b-c535-4b87-8d39-861ce6847f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-76981601-b256-4091-936c-e174a43b81e1 req-d81ce1b3-180f-4353-bd84-1018e24f83a2 service nova] Lock "c3ca002b-c535-4b87-8d39-861ce6847f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-76981601-b256-4091-936c-e174a43b81e1 req-d81ce1b3-180f-4353-bd84-1018e24f83a2 service nova] Lock "c3ca002b-c535-4b87-8d39-861ce6847f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-76981601-b256-4091-936c-e174a43b81e1 req-d81ce1b3-180f-4353-bd84-1018e24f83a2 service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] No waiting events found dispatching network-vif-unplugged-933ca0dd-f8d4-4a81-86e9-83a706d12d82 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:11:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-76981601-b256-4091-936c-e174a43b81e1 req-d81ce1b3-180f-4353-bd84-1018e24f83a2 service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Received event network-vif-unplugged-933ca0dd-f8d4-4a81-86e9-83a706d12d82 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:11:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:51 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Instance destroyed successfully.
Aug 15 19:11:51 user nova-compute[73188]: DEBUG nova.objects.instance [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lazy-loading 'resources' on Instance uuid c3ca002b-c535-4b87-8d39-861ce6847f12 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:11:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2111588244',display_name='tempest-VolumesAdminNegativeTest-server-2111588244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2111588244',id=4,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhzEVgAZIyoFgQVeNPqSye3z6nlv/4/Stz29Mf3stl/ITeA48p+P9NnJNjCNBtWEqboNXma6QWyzwPbEWe3Cw9UBu7Pdv3uSvBIpGVrOwhcjYg0TsqlRs1Ya8hdoqwTsg==',key_name='tempest-keypair-766805598',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:05:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4761b15a8dae4f7cab8c13ace5b42ddd',ramdisk_id='',reservation_id='r-i1qctxbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1347354909',owner_user_name='tempest-VolumesAdminNegativeTest-1347354909-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:05:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a55d8274ea6d4970921dcbc36d8a00b3',uuid=c3ca002b-c535-4b87-8d39-861ce6847f12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "address": "fa:16:3e:ce:f4:29", "network": {"id": "574343fe-52ff-4be4-9622-e61a33db8396", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-946260414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4761b15a8dae4f7cab8c13ace5b42ddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933ca0dd-f8", "ovs_interfaceid": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:11:51 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Converting VIF {"id": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "address": "fa:16:3e:ce:f4:29", "network": {"id": "574343fe-52ff-4be4-9622-e61a33db8396", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-946260414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4761b15a8dae4f7cab8c13ace5b42ddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933ca0dd-f8", "ovs_interfaceid": "933ca0dd-f8d4-4a81-86e9-83a706d12d82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:11:51 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f4:29,bridge_name='br-int',has_traffic_filtering=True,id=933ca0dd-f8d4-4a81-86e9-83a706d12d82,network=Network(574343fe-52ff-4be4-9622-e61a33db8396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap933ca0dd-f8') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:11:51 user nova-compute[73188]: DEBUG os_vif [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f4:29,bridge_name='br-int',has_traffic_filtering=True,id=933ca0dd-f8d4-4a81-86e9-83a706d12d82,network=Network(574343fe-52ff-4be4-9622-e61a33db8396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap933ca0dd-f8') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:11:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap933ca0dd-f8, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:11:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:51 user nova-compute[73188]: INFO os_vif [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f4:29,bridge_name='br-int',has_traffic_filtering=True,id=933ca0dd-f8d4-4a81-86e9-83a706d12d82,network=Network(574343fe-52ff-4be4-9622-e61a33db8396),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap933ca0dd-f8')
Aug 15 19:11:51 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Deleting instance files /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12_del
Aug 15 19:11:51 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Deletion of /opt/stack/data/nova/instances/c3ca002b-c535-4b87-8d39-861ce6847f12_del complete
Aug 15 19:11:51 user nova-compute[73188]: INFO nova.compute.manager [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 15 19:11:51 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:11:51 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:11:51 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:11:52 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:11:52 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Took 1.16 seconds to deallocate network for instance.
Aug 15 19:11:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-c6e47263-2f18-4f4e-848e-7040f072b812 req-052105d4-7bd9-421e-8796-3056e35630f1 service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Received event network-vif-deleted-933ca0dd-f8d4-4a81-86e9-83a706d12d82 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:11:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:52 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692126697.439466, 082c19a9-6a4f-4f27-8c77-d37db7d2306a => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:11:52 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] VM Stopped (Lifecycle Event)
Aug 15 19:11:52 user nova-compute[73188]: DEBUG nova.compute.manager [None req-08cd2b65-957d-4a34-89b8-2c054db2cfea None None] [instance: 082c19a9-6a4f-4f27-8c77-d37db7d2306a] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:11:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2e1304da-bafa-47fa-a791-bfc024bef4df req-9a4f7666-4ec1-463c-924a-7e2475d3b737 service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Received event network-vif-plugged-933ca0dd-f8d4-4a81-86e9-83a706d12d82 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:11:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2e1304da-bafa-47fa-a791-bfc024bef4df req-9a4f7666-4ec1-463c-924a-7e2475d3b737 service nova] Acquiring lock "c3ca002b-c535-4b87-8d39-861ce6847f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2e1304da-bafa-47fa-a791-bfc024bef4df req-9a4f7666-4ec1-463c-924a-7e2475d3b737 service nova] Lock "c3ca002b-c535-4b87-8d39-861ce6847f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2e1304da-bafa-47fa-a791-bfc024bef4df req-9a4f7666-4ec1-463c-924a-7e2475d3b737 service nova] Lock "c3ca002b-c535-4b87-8d39-861ce6847f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-2e1304da-bafa-47fa-a791-bfc024bef4df req-9a4f7666-4ec1-463c-924a-7e2475d3b737 service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] No waiting events found dispatching network-vif-plugged-933ca0dd-f8d4-4a81-86e9-83a706d12d82 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:11:52 user nova-compute[73188]: WARNING nova.compute.manager [req-2e1304da-bafa-47fa-a791-bfc024bef4df req-9a4f7666-4ec1-463c-924a-7e2475d3b737 service nova] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Received unexpected event network-vif-plugged-933ca0dd-f8d4-4a81-86e9-83a706d12d82 for instance with vm_state deleted and task_state None.
Aug 15 19:11:52 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:11:52 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:11:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:52 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Deleted allocations for instance c3ca002b-c535-4b87-8d39-861ce6847f12
Aug 15 19:11:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-beaed565-bc70-437b-bffa-c6518ef66c74 tempest-VolumesAdminNegativeTest-1347354909 tempest-VolumesAdminNegativeTest-1347354909-project-member] Lock "c3ca002b-c535-4b87-8d39-861ce6847f12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.853s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:57 user nova-compute[73188]: INFO nova.compute.manager [None req-3c5fd3db-1049-4a01-aaae-86ba359893a4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Unrescuing
Aug 15 19:11:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3c5fd3db-1049-4a01-aaae-86ba359893a4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "refresh_cache-3d713d03-3e60-4dec-a295-a4652ac21842" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:11:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3c5fd3db-1049-4a01-aaae-86ba359893a4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquired lock "refresh_cache-3d713d03-3e60-4dec-a295-a4652ac21842" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:11:57 user nova-compute[73188]: DEBUG nova.network.neutron [None req-3c5fd3db-1049-4a01-aaae-86ba359893a4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:11:58 user nova-compute[73188]: DEBUG nova.network.neutron [None req-3c5fd3db-1049-4a01-aaae-86ba359893a4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Updating instance_info_cache with network_info: [{"id": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "address": "fa:16:3e:b4:8c:fd", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8c4e95-fc", "ovs_interfaceid": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:11:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3c5fd3db-1049-4a01-aaae-86ba359893a4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Releasing lock "refresh_cache-3d713d03-3e60-4dec-a295-a4652ac21842" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:11:58 user nova-compute[73188]: DEBUG nova.objects.instance [None req-3c5fd3db-1049-4a01-aaae-86ba359893a4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'flavor' on Instance uuid 3d713d03-3e60-4dec-a295-a4652ac21842 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:11:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-b7fcd23a-2ffb-40c8-9553-bc69c140b676 req-9c86ffec-4ce4-44d8-a21c-8c7ea1a76e97 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received event network-vif-unplugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:11:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b7fcd23a-2ffb-40c8-9553-bc69c140b676 req-9c86ffec-4ce4-44d8-a21c-8c7ea1a76e97 service nova] Acquiring lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:11:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b7fcd23a-2ffb-40c8-9553-bc69c140b676 req-9c86ffec-4ce4-44d8-a21c-8c7ea1a76e97 service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:11:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b7fcd23a-2ffb-40c8-9553-bc69c140b676 req-9c86ffec-4ce4-44d8-a21c-8c7ea1a76e97 service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:11:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-b7fcd23a-2ffb-40c8-9553-bc69c140b676 req-9c86ffec-4ce4-44d8-a21c-8c7ea1a76e97 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] No waiting events found dispatching network-vif-unplugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:11:58 user nova-compute[73188]: WARNING nova.compute.manager [req-b7fcd23a-2ffb-40c8-9553-bc69c140b676 req-9c86ffec-4ce4-44d8-a21c-8c7ea1a76e97 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received unexpected event network-vif-unplugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d for instance with vm_state rescued and task_state unrescuing.
Aug 15 19:11:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:11:59 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Instance destroyed successfully.
Aug 15 19:12:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:00 user nova-compute[73188]: DEBUG nova.compute.manager [req-b5e87be9-1e04-4cdd-bd30-d3a6cd53ab68 req-e4fd14e3-f82c-46ef-abd1-c55d59db43b1 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received event network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:12:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b5e87be9-1e04-4cdd-bd30-d3a6cd53ab68 req-e4fd14e3-f82c-46ef-abd1-c55d59db43b1 service nova] Acquiring lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:12:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b5e87be9-1e04-4cdd-bd30-d3a6cd53ab68 req-e4fd14e3-f82c-46ef-abd1-c55d59db43b1 service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:12:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b5e87be9-1e04-4cdd-bd30-d3a6cd53ab68 req-e4fd14e3-f82c-46ef-abd1-c55d59db43b1 service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:12:00 user nova-compute[73188]: DEBUG nova.compute.manager [req-b5e87be9-1e04-4cdd-bd30-d3a6cd53ab68 req-e4fd14e3-f82c-46ef-abd1-c55d59db43b1 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] No waiting events found dispatching network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:12:00 user nova-compute[73188]: WARNING nova.compute.manager [req-b5e87be9-1e04-4cdd-bd30-d3a6cd53ab68 req-e4fd14e3-f82c-46ef-abd1-c55d59db43b1 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received unexpected event network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d for instance with vm_state rescued and task_state unrescuing.
Aug 15 19:12:00 user nova-compute[73188]: DEBUG nova.compute.manager [req-b5e87be9-1e04-4cdd-bd30-d3a6cd53ab68 req-e4fd14e3-f82c-46ef-abd1-c55d59db43b1 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received event network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:12:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b5e87be9-1e04-4cdd-bd30-d3a6cd53ab68 req-e4fd14e3-f82c-46ef-abd1-c55d59db43b1 service nova] Acquiring lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:12:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b5e87be9-1e04-4cdd-bd30-d3a6cd53ab68 req-e4fd14e3-f82c-46ef-abd1-c55d59db43b1 service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:12:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b5e87be9-1e04-4cdd-bd30-d3a6cd53ab68 req-e4fd14e3-f82c-46ef-abd1-c55d59db43b1 service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:12:00 user nova-compute[73188]: DEBUG nova.compute.manager [req-b5e87be9-1e04-4cdd-bd30-d3a6cd53ab68 req-e4fd14e3-f82c-46ef-abd1-c55d59db43b1 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] No waiting events found dispatching network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:12:00 user nova-compute[73188]: WARNING nova.compute.manager [req-b5e87be9-1e04-4cdd-bd30-d3a6cd53ab68 req-e4fd14e3-f82c-46ef-abd1-c55d59db43b1 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received unexpected event network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d for instance with vm_state rescued and task_state unrescuing.
Aug 15 19:12:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:02 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Removed pending event for 3d713d03-3e60-4dec-a295-a4652ac21842 due to event {{(pid=73188) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 19:12:02 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126722.6454473, 3d713d03-3e60-4dec-a295-a4652ac21842 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:12:02 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] VM Resumed (Lifecycle Event)
Aug 15 19:12:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3c5fd3db-1049-4a01-aaae-86ba359893a4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:12:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:12:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:12:02 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 19:12:02 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126722.64701, 3d713d03-3e60-4dec-a295-a4652ac21842 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:12:02 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] VM Started (Lifecycle Event)
Aug 15 19:12:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:12:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:12:02 user nova-compute[73188]: DEBUG nova.compute.manager [req-ea92960e-9c90-420c-8985-2a5b42e0f689 req-9804526d-34ac-455e-9f21-c6a238e9f0f5 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received event network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:12:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ea92960e-9c90-420c-8985-2a5b42e0f689 req-9804526d-34ac-455e-9f21-c6a238e9f0f5 service nova] Acquiring lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:12:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ea92960e-9c90-420c-8985-2a5b42e0f689 req-9804526d-34ac-455e-9f21-c6a238e9f0f5 service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:12:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ea92960e-9c90-420c-8985-2a5b42e0f689 req-9804526d-34ac-455e-9f21-c6a238e9f0f5 service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:12:02 user nova-compute[73188]: DEBUG nova.compute.manager [req-ea92960e-9c90-420c-8985-2a5b42e0f689 req-9804526d-34ac-455e-9f21-c6a238e9f0f5 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] No waiting events found dispatching network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:12:02 user nova-compute[73188]: WARNING nova.compute.manager [req-ea92960e-9c90-420c-8985-2a5b42e0f689 req-9804526d-34ac-455e-9f21-c6a238e9f0f5 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received unexpected event network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d for instance with vm_state active and task_state None.
Aug 15 19:12:05 user nova-compute[73188]: DEBUG nova.compute.manager [req-a92b4a37-d429-4089-b331-d21508f6f92e req-7a492f4a-6a8c-45d0-a24e-7fe3e26e5ed6 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received event network-changed-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:12:05 user nova-compute[73188]: DEBUG nova.compute.manager [req-a92b4a37-d429-4089-b331-d21508f6f92e req-7a492f4a-6a8c-45d0-a24e-7fe3e26e5ed6 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Refreshing instance network info cache due to event network-changed-f07c7de0-8264-42c8-aa30-1a8c7405379a. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:12:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a92b4a37-d429-4089-b331-d21508f6f92e req-7a492f4a-6a8c-45d0-a24e-7fe3e26e5ed6 service nova] Acquiring lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:12:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a92b4a37-d429-4089-b331-d21508f6f92e req-7a492f4a-6a8c-45d0-a24e-7fe3e26e5ed6 service nova] Acquired lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:12:05 user nova-compute[73188]: DEBUG nova.network.neutron [req-a92b4a37-d429-4089-b331-d21508f6f92e req-7a492f4a-6a8c-45d0-a24e-7fe3e26e5ed6 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Refreshing network info cache for port f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:12:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:06 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692126711.0610466, c3ca002b-c535-4b87-8d39-861ce6847f12 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:12:06 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] VM Stopped (Lifecycle Event)
Aug 15 19:12:06 user nova-compute[73188]: DEBUG nova.compute.manager [None req-78b14ef5-b0eb-4b5c-a1c9-adb12ea38686 None None] [instance: c3ca002b-c535-4b87-8d39-861ce6847f12] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:12:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:06 user nova-compute[73188]: DEBUG nova.network.neutron [req-a92b4a37-d429-4089-b331-d21508f6f92e req-7a492f4a-6a8c-45d0-a24e-7fe3e26e5ed6 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Updated VIF entry in instance network info cache for port f07c7de0-8264-42c8-aa30-1a8c7405379a. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:12:06 user nova-compute[73188]: DEBUG nova.network.neutron [req-a92b4a37-d429-4089-b331-d21508f6f92e req-7a492f4a-6a8c-45d0-a24e-7fe3e26e5ed6 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Updating instance_info_cache with network_info: [{"id": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "address": "fa:16:3e:06:3e:cd", "network": {"id": "72ad2e88-4c2b-4cba-bfa5-801725bc0041", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824390140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b47c13ca2b84149926b814a26148366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf07c7de0-82", "ovs_interfaceid": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:12:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a92b4a37-d429-4089-b331-d21508f6f92e req-7a492f4a-6a8c-45d0-a24e-7fe3e26e5ed6 service nova] Releasing lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:12:06 user nova-compute[73188]: DEBUG nova.compute.manager [None req-aa798766-ccf3-46f2-ab02-5cfb6884c4bf tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:12:06 user nova-compute[73188]: INFO nova.compute.manager [None req-aa798766-ccf3-46f2-ab02-5cfb6884c4bf tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] instance snapshotting
Aug 15 19:12:06 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-aa798766-ccf3-46f2-ab02-5cfb6884c4bf tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Beginning live snapshot process
Aug 15 19:12:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-aa798766-ccf3-46f2-ab02-5cfb6884c4bf tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json -f qcow2 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-aa798766-ccf3-46f2-ab02-5cfb6884c4bf tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-aa798766-ccf3-46f2-ab02-5cfb6884c4bf tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json -f qcow2 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-aa798766-ccf3-46f2-ab02-5cfb6884c4bf tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-aa798766-ccf3-46f2-ab02-5cfb6884c4bf tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-aa798766-ccf3-46f2-ab02-5cfb6884c4bf tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.169s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-aa798766-ccf3-46f2-ab02-5cfb6884c4bf tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjz7nhckc/8802ce753bae485b8c4b360ed9e0bc99.delta 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-aa798766-ccf3-46f2-ab02-5cfb6884c4bf tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjz7nhckc/8802ce753bae485b8c4b360ed9e0bc99.delta 1073741824" returned: 0 in 0.058s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:07 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-aa798766-ccf3-46f2-ab02-5cfb6884c4bf tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 19:12:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-aa798766-ccf3-46f2-ab02-5cfb6884c4bf tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73188) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 19:12:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-aa798766-ccf3-46f2-ab02-5cfb6884c4bf tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73188) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 19:12:08 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-aa798766-ccf3-46f2-ab02-5cfb6884c4bf tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 19:12:09 user nova-compute[73188]: DEBUG nova.privsep.utils [None req-aa798766-ccf3-46f2-ab02-5cfb6884c4bf tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73188) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 19:12:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-aa798766-ccf3-46f2-ab02-5cfb6884c4bf tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjz7nhckc/8802ce753bae485b8c4b360ed9e0bc99.delta /opt/stack/data/nova/instances/snapshots/tmpjz7nhckc/8802ce753bae485b8c4b360ed9e0bc99 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-aa798766-ccf3-46f2-ab02-5cfb6884c4bf tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjz7nhckc/8802ce753bae485b8c4b360ed9e0bc99.delta /opt/stack/data/nova/instances/snapshots/tmpjz7nhckc/8802ce753bae485b8c4b360ed9e0bc99" returned: 0 in 0.623s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:09 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-aa798766-ccf3-46f2-ab02-5cfb6884c4bf tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Snapshot extracted, beginning image upload
Aug 15 19:12:10 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:12:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:11 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:12:11 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:12:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:12:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:12:11 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:12:12 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-aa798766-ccf3-46f2-ab02-5cfb6884c4bf tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Snapshot image upload complete
Aug 15 19:12:12 user nova-compute[73188]: INFO nova.compute.manager [None req-aa798766-ccf3-46f2-ab02-5cfb6884c4bf tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Took 5.26 seconds to snapshot the instance on the hypervisor.
Aug 15 19:12:12 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Updating instance_info_cache with network_info: [{"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:12:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-d1b5f5bf-9672-40a8-83da-3a8f25007e91" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:12:12 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:12:14 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:12:14 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:12:15 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:12:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:12:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:12:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:12:15 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:12:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514c4115-057d-4cd2-8869-daf3d38fa5de/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Acquiring lock "0d5df01f-2a14-423a-9872-69132a3874ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:12:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "0d5df01f-2a14-423a-9872-69132a3874ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:12:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Acquiring lock "0d5df01f-2a14-423a-9872-69132a3874ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:12:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "0d5df01f-2a14-423a-9872-69132a3874ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:12:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "0d5df01f-2a14-423a-9872-69132a3874ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:12:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514c4115-057d-4cd2-8869-daf3d38fa5de/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:16 user nova-compute[73188]: INFO nova.compute.manager [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Terminating instance
Aug 15 19:12:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514c4115-057d-4cd2-8869-daf3d38fa5de/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:16 user nova-compute[73188]: DEBUG nova.compute.manager [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:12:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514c4115-057d-4cd2-8869-daf3d38fa5de/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-819d3885-e021-44df-8367-ac0ee41e2b8d req-a55b94d8-20fe-4301-b8f7-9eb52176fbe8 service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Received event network-vif-unplugged-21d69054-1e25-44d3-bd72-c036ff3f1498 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-819d3885-e021-44df-8367-ac0ee41e2b8d req-a55b94d8-20fe-4301-b8f7-9eb52176fbe8 service nova] Acquiring lock "0d5df01f-2a14-423a-9872-69132a3874ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-819d3885-e021-44df-8367-ac0ee41e2b8d req-a55b94d8-20fe-4301-b8f7-9eb52176fbe8 service nova] Lock "0d5df01f-2a14-423a-9872-69132a3874ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-819d3885-e021-44df-8367-ac0ee41e2b8d req-a55b94d8-20fe-4301-b8f7-9eb52176fbe8 service nova] Lock "0d5df01f-2a14-423a-9872-69132a3874ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-819d3885-e021-44df-8367-ac0ee41e2b8d req-a55b94d8-20fe-4301-b8f7-9eb52176fbe8 service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] No waiting events found dispatching network-vif-unplugged-21d69054-1e25-44d3-bd72-c036ff3f1498 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-819d3885-e021-44df-8367-ac0ee41e2b8d req-a55b94d8-20fe-4301-b8f7-9eb52176fbe8 service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Received event network-vif-unplugged-21d69054-1e25-44d3-bd72-c036ff3f1498 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:17 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Instance destroyed successfully.
Aug 15 19:12:17 user nova-compute[73188]: DEBUG nova.objects.instance [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lazy-loading 'resources' on Instance uuid 0d5df01f-2a14-423a-9872-69132a3874ce {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-847195272',display_name='tempest-TestVolumeSwap-server-847195272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-847195272',id=8,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXLgBdOuGGSI2Gcx1o1boIlmvFQ+7RFJUMVgLSdLYqlMomb7RsMMdyhZjNyDa27FEEZtA0u+yovnpZ9rfnMIyfGtgycONM94fVEImJ++RsOvW7M/9VTTbUvLO2SykQAHg==',key_name='tempest-keypair-1036656956',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:06:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84ad86ad70c74685904ae5ef488e84f6',ramdisk_id='',reservation_id='r-fopowlgx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-235731223',owner_user_name='tempest-TestVolumeSwap-235731223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:06:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48475ca817954e9fafd6801aff768985',uuid=0d5df01f-2a14-423a-9872-69132a3874ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21d69054-1e25-44d3-bd72-c036ff3f1498", "address": "fa:16:3e:22:74:a1", "network": {"id": "80270e7b-f136-47b6-8ff6-be6ff6bc6381", "bridge": "br-int", "label": "tempest-TestVolumeSwap-984990596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84ad86ad70c74685904ae5ef488e84f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d69054-1e", "ovs_interfaceid": "21d69054-1e25-44d3-bd72-c036ff3f1498", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Converting VIF {"id": "21d69054-1e25-44d3-bd72-c036ff3f1498", "address": "fa:16:3e:22:74:a1", "network": {"id": "80270e7b-f136-47b6-8ff6-be6ff6bc6381", "bridge": "br-int", "label": "tempest-TestVolumeSwap-984990596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84ad86ad70c74685904ae5ef488e84f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d69054-1e", "ovs_interfaceid": "21d69054-1e25-44d3-bd72-c036ff3f1498", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:74:a1,bridge_name='br-int',has_traffic_filtering=True,id=21d69054-1e25-44d3-bd72-c036ff3f1498,network=Network(80270e7b-f136-47b6-8ff6-be6ff6bc6381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d69054-1e') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG os_vif [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:74:a1,bridge_name='br-int',has_traffic_filtering=True,id=21d69054-1e25-44d3-bd72-c036ff3f1498,network=Network(80270e7b-f136-47b6-8ff6-be6ff6bc6381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d69054-1e') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21d69054-1e, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:12:17 user nova-compute[73188]: INFO os_vif [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:74:a1,bridge_name='br-int',has_traffic_filtering=True,id=21d69054-1e25-44d3-bd72-c036ff3f1498,network=Network(80270e7b-f136-47b6-8ff6-be6ff6bc6381),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d69054-1e')
Aug 15 19:12:17 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Deleting instance files /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce_del
Aug 15 19:12:17 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Deletion of /opt/stack/data/nova/instances/0d5df01f-2a14-423a-9872-69132a3874ce_del complete
Aug 15 19:12:17 user nova-compute[73188]: INFO nova.compute.manager [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 15 19:12:17 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38af35a8-ea67-4871-8de9-57b04614faa3/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38af35a8-ea67-4871-8de9-57b04614faa3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38af35a8-ea67-4871-8de9-57b04614faa3/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:17 user nova-compute[73188]: INFO nova.compute.manager [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Rescuing
Aug 15 19:12:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "refresh_cache-215077af-60a1-4a82-b24e-1545349363d0" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquired lock "refresh_cache-215077af-60a1-4a82-b24e-1545349363d0" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:12:17 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:12:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38af35a8-ea67-4871-8de9-57b04614faa3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:18 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Updating instance_info_cache with network_info: [{"id": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "address": "fa:16:3e:d0:70:59", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38266cdc-3c", "ovs_interfaceid": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:12:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Releasing lock "refresh_cache-215077af-60a1-4a82-b24e-1545349363d0" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:12:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:12:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:18 user nova-compute[73188]: DEBUG nova.compute.manager [req-fcd564a3-c8ba-4ea8-a818-9f03ae5a8f0b req-cd9e9e8e-c071-4f7a-aa5f-581bc03b6c03 service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Received event network-vif-unplugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:12:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fcd564a3-c8ba-4ea8-a818-9f03ae5a8f0b req-cd9e9e8e-c071-4f7a-aa5f-581bc03b6c03 service nova] Acquiring lock "215077af-60a1-4a82-b24e-1545349363d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:12:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fcd564a3-c8ba-4ea8-a818-9f03ae5a8f0b req-cd9e9e8e-c071-4f7a-aa5f-581bc03b6c03 service nova] Lock "215077af-60a1-4a82-b24e-1545349363d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:12:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fcd564a3-c8ba-4ea8-a818-9f03ae5a8f0b req-cd9e9e8e-c071-4f7a-aa5f-581bc03b6c03 service nova] Lock "215077af-60a1-4a82-b24e-1545349363d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:12:18 user nova-compute[73188]: DEBUG nova.compute.manager [req-fcd564a3-c8ba-4ea8-a818-9f03ae5a8f0b req-cd9e9e8e-c071-4f7a-aa5f-581bc03b6c03 service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] No waiting events found dispatching network-vif-unplugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:12:18 user nova-compute[73188]: WARNING nova.compute.manager [req-fcd564a3-c8ba-4ea8-a818-9f03ae5a8f0b req-cd9e9e8e-c071-4f7a-aa5f-581bc03b6c03 service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Received unexpected event network-vif-unplugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf for instance with vm_state active and task_state rescuing.
Aug 15 19:12:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.compute.manager [req-2b6c3c18-b118-4c1a-8653-09730cdf2a00 req-8fb41345-14b5-44c0-8a9c-0d592c7b10eb service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Received event network-vif-plugged-21d69054-1e25-44d3-bd72-c036ff3f1498 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2b6c3c18-b118-4c1a-8653-09730cdf2a00 req-8fb41345-14b5-44c0-8a9c-0d592c7b10eb service nova] Acquiring lock "0d5df01f-2a14-423a-9872-69132a3874ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2b6c3c18-b118-4c1a-8653-09730cdf2a00 req-8fb41345-14b5-44c0-8a9c-0d592c7b10eb service nova] Lock "0d5df01f-2a14-423a-9872-69132a3874ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2b6c3c18-b118-4c1a-8653-09730cdf2a00 req-8fb41345-14b5-44c0-8a9c-0d592c7b10eb service nova] Lock "0d5df01f-2a14-423a-9872-69132a3874ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.compute.manager [req-2b6c3c18-b118-4c1a-8653-09730cdf2a00 req-8fb41345-14b5-44c0-8a9c-0d592c7b10eb service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] No waiting events found dispatching network-vif-plugged-21d69054-1e25-44d3-bd72-c036ff3f1498 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:12:19 user nova-compute[73188]: WARNING nova.compute.manager [req-2b6c3c18-b118-4c1a-8653-09730cdf2a00 req-8fb41345-14b5-44c0-8a9c-0d592c7b10eb service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Received unexpected event network-vif-plugged-21d69054-1e25-44d3-bd72-c036ff3f1498 for instance with vm_state active and task_state deleting.
Aug 15 19:12:19 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Instance destroyed successfully.
Aug 15 19:12:19 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Attempting rescue
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73188) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Instance directory exists: not creating {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 19:12:19 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Creating image(s)
Aug 15 19:12:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "/opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "/opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "/opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.objects.instance [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'trusted_certs' on Instance uuid 215077af-60a1-4a82-b24e-1545349363d0 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:12:19 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Took 1.73 seconds to deallocate network for instance.
Aug 15 19:12:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.175s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue" returned: 0 in 0.059s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.objects.instance [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'migration_context' on Instance uuid 215077af-60a1-4a82-b24e-1545349363d0 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Start _get_guest_xml network_info=[{"id": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "address": "fa:16:3e:d0:70:59", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "vif_mac": "fa:16:3e:d0:70:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38266cdc-3c", "ovs_interfaceid": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.objects.instance [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'resources' on Instance uuid 215077af-60a1-4a82-b24e-1545349363d0 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.objects.instance [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'numa_topology' on Instance uuid 215077af-60a1-4a82-b24e-1545349363d0 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:12:19 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:12:19 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.objects.instance [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'vcpu_model' on Instance uuid 215077af-60a1-4a82-b24e-1545349363d0 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-151802008',display_name='tempest-ServerRescueNegativeTestJSON-server-151802008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-151802008',id=19,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:10:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eeb950591a3349908b17b33c0ebca302',ramdisk_id='',reservation_id='r-j4tpbmap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-990996828',owner_user_name='tempest-ServerRescueNegativeTestJSON-990996828-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:10:38Z,user_data=None,user_id='88c0edd2a58744da9497d7c5164f22a2',uuid=215077af-60a1-4a82-b24e-1545349363d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "address": "fa:16:3e:d0:70:59", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "vif_mac": "fa:16:3e:d0:70:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38266cdc-3c", "ovs_interfaceid": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converting VIF {"id": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "address": "fa:16:3e:d0:70:59", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "vif_mac": "fa:16:3e:d0:70:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38266cdc-3c", "ovs_interfaceid": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:70:59,bridge_name='br-int',has_traffic_filtering=True,id=38266cdc-3cf0-422f-b63b-4cec2cbc3eaf,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38266cdc-3c') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.objects.instance [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'pci_devices' on Instance uuid 215077af-60a1-4a82-b24e-1545349363d0 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:12:19 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:12:19 user nova-compute[73188]:   <uuid>215077af-60a1-4a82-b24e-1545349363d0</uuid>
Aug 15 19:12:19 user nova-compute[73188]:   <name>instance-00000013</name>
Aug 15 19:12:19 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:12:19 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:12:19 user nova-compute[73188]:   <metadata>
Aug 15 19:12:19 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:12:19 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:12:19 user nova-compute[73188]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-151802008</nova:name>
Aug 15 19:12:19 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:12:19</nova:creationTime>
Aug 15 19:12:19 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:12:19 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:12:19 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:12:19 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:12:19 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:12:19 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:12:19 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:12:19 user nova-compute[73188]:       <nova:owner>
Aug 15 19:12:19 user nova-compute[73188]:         <nova:user uuid="88c0edd2a58744da9497d7c5164f22a2">tempest-ServerRescueNegativeTestJSON-990996828-project-member</nova:user>
Aug 15 19:12:19 user nova-compute[73188]:         <nova:project uuid="eeb950591a3349908b17b33c0ebca302">tempest-ServerRescueNegativeTestJSON-990996828</nova:project>
Aug 15 19:12:19 user nova-compute[73188]:       </nova:owner>
Aug 15 19:12:19 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:12:19 user nova-compute[73188]:       <nova:ports>
Aug 15 19:12:19 user nova-compute[73188]:         <nova:port uuid="38266cdc-3cf0-422f-b63b-4cec2cbc3eaf">
Aug 15 19:12:19 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 19:12:19 user nova-compute[73188]:         </nova:port>
Aug 15 19:12:19 user nova-compute[73188]:       </nova:ports>
Aug 15 19:12:19 user nova-compute[73188]:     </nova:instance>
Aug 15 19:12:19 user nova-compute[73188]:   </metadata>
Aug 15 19:12:19 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:12:19 user nova-compute[73188]:     <system>
Aug 15 19:12:19 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:12:19 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:12:19 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:12:19 user nova-compute[73188]:       <entry name="serial">215077af-60a1-4a82-b24e-1545349363d0</entry>
Aug 15 19:12:19 user nova-compute[73188]:       <entry name="uuid">215077af-60a1-4a82-b24e-1545349363d0</entry>
Aug 15 19:12:19 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:12:19 user nova-compute[73188]:     </system>
Aug 15 19:12:19 user nova-compute[73188]:   </sysinfo>
Aug 15 19:12:19 user nova-compute[73188]:   <os>
Aug 15 19:12:19 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:12:19 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:12:19 user nova-compute[73188]:   </os>
Aug 15 19:12:19 user nova-compute[73188]:   <features>
Aug 15 19:12:19 user nova-compute[73188]:     <acpi/>
Aug 15 19:12:19 user nova-compute[73188]:     <apic/>
Aug 15 19:12:19 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:12:19 user nova-compute[73188]:   </features>
Aug 15 19:12:19 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:12:19 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:12:19 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:12:19 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:12:19 user nova-compute[73188]:   </clock>
Aug 15 19:12:19 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:12:19 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:12:19 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:12:19 user nova-compute[73188]:   </cpu>
Aug 15 19:12:19 user nova-compute[73188]:   <devices>
Aug 15 19:12:19 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:12:19 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:12:19 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue"/>
Aug 15 19:12:19 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:12:19 user nova-compute[73188]:     </disk>
Aug 15 19:12:19 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:12:19 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:12:19 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk"/>
Aug 15 19:12:19 user nova-compute[73188]:       <target dev="vdb" bus="virtio"/>
Aug 15 19:12:19 user nova-compute[73188]:     </disk>
Aug 15 19:12:19 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:12:19 user nova-compute[73188]:       <mac address="fa:16:3e:d0:70:59"/>
Aug 15 19:12:19 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:12:19 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:12:19 user nova-compute[73188]:       <target dev="tap38266cdc-3c"/>
Aug 15 19:12:19 user nova-compute[73188]:     </interface>
Aug 15 19:12:19 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:12:19 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/console.log" append="off"/>
Aug 15 19:12:19 user nova-compute[73188]:     </serial>
Aug 15 19:12:19 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:12:19 user nova-compute[73188]:     <video>
Aug 15 19:12:19 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:12:19 user nova-compute[73188]:     </video>
Aug 15 19:12:19 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:12:19 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:12:19 user nova-compute[73188]:     </rng>
Aug 15 19:12:19 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:12:19 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:12:19 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:12:19 user nova-compute[73188]:     </memballoon>
Aug 15 19:12:19 user nova-compute[73188]:   </devices>
Aug 15 19:12:19 user nova-compute[73188]: </domain>
Aug 15 19:12:19 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:12:19 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Instance destroyed successfully.
Aug 15 19:12:20 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:12:20 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=6944MB free_disk=25.338512420654297GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] No VIF found with MAC fa:16:3e:d0:70:59, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.007s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.213s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:12:20 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Deleted allocations for instance 0d5df01f-2a14-423a-9872-69132a3874ce
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 7caf434b-1484-4832-afee-0e2454bb5089 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3d713d03-3e60-4dec-a295-a4652ac21842 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance d1b5f5bf-9672-40a8-83da-3a8f25007e91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e00adf53-085f-436d-a09f-e97e92ca79cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance de6929cd-c95d-4964-b81c-96872a137f90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 139ccf1c-4792-4653-9475-c61b1f9c4846 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 215077af-60a1-4a82-b24e-1545349363d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 38af35a8-ea67-4871-8de9-57b04614faa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 514c4115-057d-4cd2-8869-daf3d38fa5de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dda4dba2-ffba-4b93-a3cf-07b056fccfb4 tempest-TestVolumeSwap-235731223 tempest-TestVolumeSwap-235731223-project-member] Lock "0d5df01f-2a14-423a-9872-69132a3874ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.979s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.compute.manager [req-1a28ad47-3b65-4338-b09e-ff574cb47e81 req-fa7ea694-ec38-47ba-8cd9-006a52bd7a63 service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Received event network-vif-plugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1a28ad47-3b65-4338-b09e-ff574cb47e81 req-fa7ea694-ec38-47ba-8cd9-006a52bd7a63 service nova] Acquiring lock "215077af-60a1-4a82-b24e-1545349363d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1a28ad47-3b65-4338-b09e-ff574cb47e81 req-fa7ea694-ec38-47ba-8cd9-006a52bd7a63 service nova] Lock "215077af-60a1-4a82-b24e-1545349363d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1a28ad47-3b65-4338-b09e-ff574cb47e81 req-fa7ea694-ec38-47ba-8cd9-006a52bd7a63 service nova] Lock "215077af-60a1-4a82-b24e-1545349363d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.compute.manager [req-1a28ad47-3b65-4338-b09e-ff574cb47e81 req-fa7ea694-ec38-47ba-8cd9-006a52bd7a63 service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] No waiting events found dispatching network-vif-plugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:12:20 user nova-compute[73188]: WARNING nova.compute.manager [req-1a28ad47-3b65-4338-b09e-ff574cb47e81 req-fa7ea694-ec38-47ba-8cd9-006a52bd7a63 service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Received unexpected event network-vif-plugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf for instance with vm_state active and task_state rescuing.
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:12:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.459s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:12:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-510693b8-03fd-4a33-a486-606457fbf39e req-441bef60-df66-48ce-b439-730bf9284bd1 service nova] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Received event network-vif-deleted-21d69054-1e25-44d3-bd72-c036ff3f1498 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:12:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:21 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:12:21 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:12:21 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:12:21 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:12:21 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:12:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-9f719143-fd1a-4987-b7d4-a0cf8d0f874a req-c4fac0d8-21ee-4b9e-a20d-05450f0df6df service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Received event network-vif-plugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:12:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9f719143-fd1a-4987-b7d4-a0cf8d0f874a req-c4fac0d8-21ee-4b9e-a20d-05450f0df6df service nova] Acquiring lock "215077af-60a1-4a82-b24e-1545349363d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:12:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9f719143-fd1a-4987-b7d4-a0cf8d0f874a req-c4fac0d8-21ee-4b9e-a20d-05450f0df6df service nova] Lock "215077af-60a1-4a82-b24e-1545349363d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:12:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9f719143-fd1a-4987-b7d4-a0cf8d0f874a req-c4fac0d8-21ee-4b9e-a20d-05450f0df6df service nova] Lock "215077af-60a1-4a82-b24e-1545349363d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:12:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-9f719143-fd1a-4987-b7d4-a0cf8d0f874a req-c4fac0d8-21ee-4b9e-a20d-05450f0df6df service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] No waiting events found dispatching network-vif-plugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:12:22 user nova-compute[73188]: WARNING nova.compute.manager [req-9f719143-fd1a-4987-b7d4-a0cf8d0f874a req-c4fac0d8-21ee-4b9e-a20d-05450f0df6df service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Received unexpected event network-vif-plugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf for instance with vm_state active and task_state rescuing.
Aug 15 19:12:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-9f719143-fd1a-4987-b7d4-a0cf8d0f874a req-c4fac0d8-21ee-4b9e-a20d-05450f0df6df service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Received event network-vif-plugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:12:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9f719143-fd1a-4987-b7d4-a0cf8d0f874a req-c4fac0d8-21ee-4b9e-a20d-05450f0df6df service nova] Acquiring lock "215077af-60a1-4a82-b24e-1545349363d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:12:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9f719143-fd1a-4987-b7d4-a0cf8d0f874a req-c4fac0d8-21ee-4b9e-a20d-05450f0df6df service nova] Lock "215077af-60a1-4a82-b24e-1545349363d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:12:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9f719143-fd1a-4987-b7d4-a0cf8d0f874a req-c4fac0d8-21ee-4b9e-a20d-05450f0df6df service nova] Lock "215077af-60a1-4a82-b24e-1545349363d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:12:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-9f719143-fd1a-4987-b7d4-a0cf8d0f874a req-c4fac0d8-21ee-4b9e-a20d-05450f0df6df service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] No waiting events found dispatching network-vif-plugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:12:22 user nova-compute[73188]: WARNING nova.compute.manager [req-9f719143-fd1a-4987-b7d4-a0cf8d0f874a req-c4fac0d8-21ee-4b9e-a20d-05450f0df6df service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Received unexpected event network-vif-plugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf for instance with vm_state active and task_state rescuing.
Aug 15 19:12:24 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Removed pending event for 215077af-60a1-4a82-b24e-1545349363d0 due to event {{(pid=73188) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 19:12:24 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126744.0128686, 215077af-60a1-4a82-b24e-1545349363d0 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:12:24 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 215077af-60a1-4a82-b24e-1545349363d0] VM Resumed (Lifecycle Event)
Aug 15 19:12:24 user nova-compute[73188]: DEBUG nova.compute.manager [None req-cb6073dd-2fe3-4bd4-8fe6-55062d6657d1 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:12:24 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:12:24 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:12:24 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 215077af-60a1-4a82-b24e-1545349363d0] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 19:12:24 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126744.0153673, 215077af-60a1-4a82-b24e-1545349363d0 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:12:24 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 215077af-60a1-4a82-b24e-1545349363d0] VM Started (Lifecycle Event)
Aug 15 19:12:24 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:12:24 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:12:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Acquiring lock "38af35a8-ea67-4871-8de9-57b04614faa3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:12:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Lock "38af35a8-ea67-4871-8de9-57b04614faa3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:12:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Acquiring lock "38af35a8-ea67-4871-8de9-57b04614faa3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:12:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Lock "38af35a8-ea67-4871-8de9-57b04614faa3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:12:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Lock "38af35a8-ea67-4871-8de9-57b04614faa3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:12:28 user nova-compute[73188]: INFO nova.compute.manager [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Terminating instance
Aug 15 19:12:28 user nova-compute[73188]: DEBUG nova.compute.manager [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:12:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:29 user nova-compute[73188]: DEBUG nova.compute.manager [req-a7264893-d0c9-461b-84d3-ce848e51ce5e req-c64375d3-9349-4e91-b319-7a33275e991e service nova] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Received event network-vif-unplugged-7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:12:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a7264893-d0c9-461b-84d3-ce848e51ce5e req-c64375d3-9349-4e91-b319-7a33275e991e service nova] Acquiring lock "38af35a8-ea67-4871-8de9-57b04614faa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:12:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a7264893-d0c9-461b-84d3-ce848e51ce5e req-c64375d3-9349-4e91-b319-7a33275e991e service nova] Lock "38af35a8-ea67-4871-8de9-57b04614faa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:12:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a7264893-d0c9-461b-84d3-ce848e51ce5e req-c64375d3-9349-4e91-b319-7a33275e991e service nova] Lock "38af35a8-ea67-4871-8de9-57b04614faa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:12:29 user nova-compute[73188]: DEBUG nova.compute.manager [req-a7264893-d0c9-461b-84d3-ce848e51ce5e req-c64375d3-9349-4e91-b319-7a33275e991e service nova] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] No waiting events found dispatching network-vif-unplugged-7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:12:29 user nova-compute[73188]: DEBUG nova.compute.manager [req-a7264893-d0c9-461b-84d3-ce848e51ce5e req-c64375d3-9349-4e91-b319-7a33275e991e service nova] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Received event network-vif-unplugged-7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:12:29 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Instance destroyed successfully.
Aug 15 19:12:29 user nova-compute[73188]: DEBUG nova.objects.instance [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Lazy-loading 'resources' on Instance uuid 38af35a8-ea67-4871-8de9-57b04614faa3 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:12:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1973142812',display_name='tempest-VolumesNegativeTest-instance-1973142812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1973142812',id=20,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:10:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba0bf776d30d44cfbb8134ee25e1b5ff',ramdisk_id='',reservation_id='r-l2yhi98l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1659730329',owner_user_name='tempest-VolumesNegativeTest-1659730329-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:10:46Z,user_data=None,user_id='51512b550684412da17492201f62282c',uuid=38af35a8-ea67-4871-8de9-57b04614faa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa", "address": "fa:16:3e:00:f9:cc", "network": {"id": "07572d5d-8c74-428e-b234-b8f5f902c82f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "955614a7fb044176adad07bac93ae638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee6b62-7d", "ovs_interfaceid": "7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:12:29 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Converting VIF {"id": "7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa", "address": "fa:16:3e:00:f9:cc", "network": {"id": "07572d5d-8c74-428e-b234-b8f5f902c82f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.231", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "955614a7fb044176adad07bac93ae638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cee6b62-7d", "ovs_interfaceid": "7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:12:29 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:f9:cc,bridge_name='br-int',has_traffic_filtering=True,id=7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa,network=Network(07572d5d-8c74-428e-b234-b8f5f902c82f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cee6b62-7d') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:12:29 user nova-compute[73188]: DEBUG os_vif [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:f9:cc,bridge_name='br-int',has_traffic_filtering=True,id=7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa,network=Network(07572d5d-8c74-428e-b234-b8f5f902c82f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cee6b62-7d') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:12:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cee6b62-7d, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:12:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:29 user nova-compute[73188]: INFO os_vif [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:f9:cc,bridge_name='br-int',has_traffic_filtering=True,id=7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa,network=Network(07572d5d-8c74-428e-b234-b8f5f902c82f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cee6b62-7d')
Aug 15 19:12:29 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Deleting instance files /opt/stack/data/nova/instances/38af35a8-ea67-4871-8de9-57b04614faa3_del
Aug 15 19:12:29 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Deletion of /opt/stack/data/nova/instances/38af35a8-ea67-4871-8de9-57b04614faa3_del complete
Aug 15 19:12:29 user nova-compute[73188]: INFO nova.compute.manager [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 15 19:12:29 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:12:29 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:12:29 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:12:30 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:12:30 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Took 0.52 seconds to deallocate network for instance.
Aug 15 19:12:30 user nova-compute[73188]: DEBUG nova.compute.manager [req-1a605434-26aa-4d97-8be2-c74814dfaa59 req-66e7a426-2443-4b5f-aa7e-aa95f518da6a service nova] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Received event network-vif-deleted-7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:12:30 user nova-compute[73188]: INFO nova.compute.manager [req-1a605434-26aa-4d97-8be2-c74814dfaa59 req-66e7a426-2443-4b5f-aa7e-aa95f518da6a service nova] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Neutron deleted interface 7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa; detaching it from the instance and deleting it from the info cache
Aug 15 19:12:30 user nova-compute[73188]: DEBUG nova.network.neutron [req-1a605434-26aa-4d97-8be2-c74814dfaa59 req-66e7a426-2443-4b5f-aa7e-aa95f518da6a service nova] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:12:30 user nova-compute[73188]: DEBUG nova.compute.manager [req-1a605434-26aa-4d97-8be2-c74814dfaa59 req-66e7a426-2443-4b5f-aa7e-aa95f518da6a service nova] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Detach interface failed, port_id=7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa, reason: Instance 38af35a8-ea67-4871-8de9-57b04614faa3 could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:12:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:12:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:12:30 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:12:30 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:12:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:12:30 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Deleted allocations for instance 38af35a8-ea67-4871-8de9-57b04614faa3
Aug 15 19:12:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dc3b3bd5-dde2-43e7-950c-9f6473423330 tempest-VolumesNegativeTest-1659730329 tempest-VolumesNegativeTest-1659730329-project-member] Lock "38af35a8-ea67-4871-8de9-57b04614faa3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.024s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:12:31 user nova-compute[73188]: DEBUG nova.compute.manager [req-d2b6a1f4-2ee5-4d0e-9a1d-aecbebf1672e req-72fde97b-c4b7-49c4-995c-c8ebba44b68d service nova] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Received event network-vif-plugged-7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:12:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d2b6a1f4-2ee5-4d0e-9a1d-aecbebf1672e req-72fde97b-c4b7-49c4-995c-c8ebba44b68d service nova] Acquiring lock "38af35a8-ea67-4871-8de9-57b04614faa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:12:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d2b6a1f4-2ee5-4d0e-9a1d-aecbebf1672e req-72fde97b-c4b7-49c4-995c-c8ebba44b68d service nova] Lock "38af35a8-ea67-4871-8de9-57b04614faa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:12:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d2b6a1f4-2ee5-4d0e-9a1d-aecbebf1672e req-72fde97b-c4b7-49c4-995c-c8ebba44b68d service nova] Lock "38af35a8-ea67-4871-8de9-57b04614faa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:12:31 user nova-compute[73188]: DEBUG nova.compute.manager [req-d2b6a1f4-2ee5-4d0e-9a1d-aecbebf1672e req-72fde97b-c4b7-49c4-995c-c8ebba44b68d service nova] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] No waiting events found dispatching network-vif-plugged-7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:12:31 user nova-compute[73188]: WARNING nova.compute.manager [req-d2b6a1f4-2ee5-4d0e-9a1d-aecbebf1672e req-72fde97b-c4b7-49c4-995c-c8ebba44b68d service nova] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Received unexpected event network-vif-plugged-7cee6b62-7d14-4a7d-bbaf-43ddb79b1eaa for instance with vm_state deleted and task_state None.
Aug 15 19:12:32 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692126737.5173361, 0d5df01f-2a14-423a-9872-69132a3874ce => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:12:32 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] VM Stopped (Lifecycle Event)
Aug 15 19:12:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-9ba4aff2-ccd6-45b1-8e1a-d579efb907ed None None] [instance: 0d5df01f-2a14-423a-9872-69132a3874ce] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:12:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:44 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692126749.6638787, 38af35a8-ea67-4871-8de9-57b04614faa3 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:12:44 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] VM Stopped (Lifecycle Event)
Aug 15 19:12:44 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3e32a74e-9df9-4a28-8f07-7bb42cf7a3ef None None] [instance: 38af35a8-ea67-4871-8de9-57b04614faa3] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:12:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:12:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:13:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "2a472af2-b10c-456b-8dba-6c75f3ab806a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:11 user nova-compute[73188]: DEBUG nova.compute.manager [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:13:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:11 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:13:11 user nova-compute[73188]: INFO nova.compute.claims [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Claim successful on node user
Aug 15 19:13:12 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:13:12 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:13:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:12 user nova-compute[73188]: DEBUG nova.compute.manager [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:13:12 user nova-compute[73188]: DEBUG nova.compute.manager [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:13:12 user nova-compute[73188]: DEBUG nova.network.neutron [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:13:12 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:13:12 user nova-compute[73188]: DEBUG nova.compute.manager [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:13:12 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:13:12 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:13:12 user nova-compute[73188]: DEBUG nova.policy [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c30de55a2834422c8f6df816899b881e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c085a0ccf841e297d98037c07a7111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:13:12 user nova-compute[73188]: DEBUG nova.compute.manager [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:13:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:13:12 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Creating image(s)
Aug 15 19:13:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "/opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "/opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-7caf434b-1484-4832-afee-0e2454bb5089" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:13:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-7caf434b-1484-4832-afee-0e2454bb5089" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:13:12 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:13:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk 1073741824" returned: 0 in 0.055s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.227s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:13 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:13:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:13 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Updating instance_info_cache with network_info: [{"id": "8b93115d-3416-4846-9c43-a36a66f99e41", "address": "fa:16:3e:da:94:b4", "network": {"id": "8c59b78f-940b-409a-a485-2ee269ef8a5f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2048234860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f959aaaf0fe4406a723804e59eb47ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b93115d-34", "ovs_interfaceid": "8b93115d-3416-4846-9c43-a36a66f99e41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:13:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-7caf434b-1484-4832-afee-0e2454bb5089" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:13:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:13:13 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:13:13 user nova-compute[73188]: DEBUG nova.network.neutron [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Successfully created port: fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:13:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:13 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Cannot resize image /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:13:13 user nova-compute[73188]: DEBUG nova.objects.instance [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'migration_context' on Instance uuid 2a472af2-b10c-456b-8dba-6c75f3ab806a {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:13:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:13:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Ensure instance console log exists: /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:13:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.network.neutron [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Successfully updated port: fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "refresh_cache-2a472af2-b10c-456b-8dba-6c75f3ab806a" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquired lock "refresh_cache-2a472af2-b10c-456b-8dba-6c75f3ab806a" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.network.neutron [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.compute.manager [req-b4cf30bf-a1e0-4493-b128-59c022067948 req-ad0c1508-941b-4237-b275-53d2122124a3 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Received event network-changed-fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.compute.manager [req-b4cf30bf-a1e0-4493-b128-59c022067948 req-ad0c1508-941b-4237-b275-53d2122124a3 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Refreshing instance network info cache due to event network-changed-fadc6652-e769-4a50-81a4-caefd1de83ff. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b4cf30bf-a1e0-4493-b128-59c022067948 req-ad0c1508-941b-4237-b275-53d2122124a3 service nova] Acquiring lock "refresh_cache-2a472af2-b10c-456b-8dba-6c75f3ab806a" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.network.neutron [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.network.neutron [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Updating instance_info_cache with network_info: [{"id": "fadc6652-e769-4a50-81a4-caefd1de83ff", "address": "fa:16:3e:28:1c:a1", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc6652-e7", "ovs_interfaceid": "fadc6652-e769-4a50-81a4-caefd1de83ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Releasing lock "refresh_cache-2a472af2-b10c-456b-8dba-6c75f3ab806a" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Instance network_info: |[{"id": "fadc6652-e769-4a50-81a4-caefd1de83ff", "address": "fa:16:3e:28:1c:a1", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc6652-e7", "ovs_interfaceid": "fadc6652-e769-4a50-81a4-caefd1de83ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b4cf30bf-a1e0-4493-b128-59c022067948 req-ad0c1508-941b-4237-b275-53d2122124a3 service nova] Acquired lock "refresh_cache-2a472af2-b10c-456b-8dba-6c75f3ab806a" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.network.neutron [req-b4cf30bf-a1e0-4493-b128-59c022067948 req-ad0c1508-941b-4237-b275-53d2122124a3 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Refreshing network info cache for port fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Start _get_guest_xml network_info=[{"id": "fadc6652-e769-4a50-81a4-caefd1de83ff", "address": "fa:16:3e:28:1c:a1", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc6652-e7", "ovs_interfaceid": "fadc6652-e769-4a50-81a4-caefd1de83ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:13:14 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:13:14 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2127906751',display_name='tempest-tempest.common.compute-instance-2127906751',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2127906751',id=22,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT7pHtenQdl314usiZ2R/MplkqppVUszRcYtdF8PoT9iwdYNWnlBFP4lclfbI6J8I2Ewyw1annhgge1Ik0u6ps1bdNRiu2LQt8/JVAam6sa0kutoFjAwiPMLeb/O6NAfQ==',key_name='tempest-keypair-1165066426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c085a0ccf841e297d98037c07a7111',ramdisk_id='',reservation_id='r-x091yrli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2026424764',owner_user_name='tempest-ServerActionsTestOtherA-2026424764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:13:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30de55a2834422c8f6df816899b881e',uuid=2a472af2-b10c-456b-8dba-6c75f3ab806a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fadc6652-e769-4a50-81a4-caefd1de83ff", "address": "fa:16:3e:28:1c:a1", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc6652-e7", "ovs_interfaceid": "fadc6652-e769-4a50-81a4-caefd1de83ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converting VIF {"id": "fadc6652-e769-4a50-81a4-caefd1de83ff", "address": "fa:16:3e:28:1c:a1", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc6652-e7", "ovs_interfaceid": "fadc6652-e769-4a50-81a4-caefd1de83ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:1c:a1,bridge_name='br-int',has_traffic_filtering=True,id=fadc6652-e769-4a50-81a4-caefd1de83ff,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc6652-e7') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.objects.instance [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a472af2-b10c-456b-8dba-6c75f3ab806a {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:13:14 user nova-compute[73188]:   <uuid>2a472af2-b10c-456b-8dba-6c75f3ab806a</uuid>
Aug 15 19:13:14 user nova-compute[73188]:   <name>instance-00000016</name>
Aug 15 19:13:14 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:13:14 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:13:14 user nova-compute[73188]:   <metadata>
Aug 15 19:13:14 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:13:14 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:13:14 user nova-compute[73188]:       <nova:name>tempest-tempest.common.compute-instance-2127906751</nova:name>
Aug 15 19:13:14 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:13:14</nova:creationTime>
Aug 15 19:13:14 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:13:14 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:13:14 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:13:14 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:13:14 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:13:14 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:13:14 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:13:14 user nova-compute[73188]:       <nova:owner>
Aug 15 19:13:14 user nova-compute[73188]:         <nova:user uuid="c30de55a2834422c8f6df816899b881e">tempest-ServerActionsTestOtherA-2026424764-project-member</nova:user>
Aug 15 19:13:14 user nova-compute[73188]:         <nova:project uuid="a3c085a0ccf841e297d98037c07a7111">tempest-ServerActionsTestOtherA-2026424764</nova:project>
Aug 15 19:13:14 user nova-compute[73188]:       </nova:owner>
Aug 15 19:13:14 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:13:14 user nova-compute[73188]:       <nova:ports>
Aug 15 19:13:14 user nova-compute[73188]:         <nova:port uuid="fadc6652-e769-4a50-81a4-caefd1de83ff">
Aug 15 19:13:14 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 19:13:14 user nova-compute[73188]:         </nova:port>
Aug 15 19:13:14 user nova-compute[73188]:       </nova:ports>
Aug 15 19:13:14 user nova-compute[73188]:     </nova:instance>
Aug 15 19:13:14 user nova-compute[73188]:   </metadata>
Aug 15 19:13:14 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:13:14 user nova-compute[73188]:     <system>
Aug 15 19:13:14 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:13:14 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:13:14 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:13:14 user nova-compute[73188]:       <entry name="serial">2a472af2-b10c-456b-8dba-6c75f3ab806a</entry>
Aug 15 19:13:14 user nova-compute[73188]:       <entry name="uuid">2a472af2-b10c-456b-8dba-6c75f3ab806a</entry>
Aug 15 19:13:14 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:13:14 user nova-compute[73188]:     </system>
Aug 15 19:13:14 user nova-compute[73188]:   </sysinfo>
Aug 15 19:13:14 user nova-compute[73188]:   <os>
Aug 15 19:13:14 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:13:14 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:13:14 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:13:14 user nova-compute[73188]:   </os>
Aug 15 19:13:14 user nova-compute[73188]:   <features>
Aug 15 19:13:14 user nova-compute[73188]:     <acpi/>
Aug 15 19:13:14 user nova-compute[73188]:     <apic/>
Aug 15 19:13:14 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:13:14 user nova-compute[73188]:   </features>
Aug 15 19:13:14 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:13:14 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:13:14 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:13:14 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:13:14 user nova-compute[73188]:   </clock>
Aug 15 19:13:14 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:13:14 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:13:14 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:13:14 user nova-compute[73188]:   </cpu>
Aug 15 19:13:14 user nova-compute[73188]:   <devices>
Aug 15 19:13:14 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:13:14 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:13:14 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk"/>
Aug 15 19:13:14 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:13:14 user nova-compute[73188]:     </disk>
Aug 15 19:13:14 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:13:14 user nova-compute[73188]:       <mac address="fa:16:3e:28:1c:a1"/>
Aug 15 19:13:14 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:13:14 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:13:14 user nova-compute[73188]:       <target dev="tapfadc6652-e7"/>
Aug 15 19:13:14 user nova-compute[73188]:     </interface>
Aug 15 19:13:14 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:13:14 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/console.log" append="off"/>
Aug 15 19:13:14 user nova-compute[73188]:     </serial>
Aug 15 19:13:14 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:13:14 user nova-compute[73188]:     <video>
Aug 15 19:13:14 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:13:14 user nova-compute[73188]:     </video>
Aug 15 19:13:14 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:13:14 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:13:14 user nova-compute[73188]:     </rng>
Aug 15 19:13:14 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:13:14 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:13:14 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:13:14 user nova-compute[73188]:     </memballoon>
Aug 15 19:13:14 user nova-compute[73188]:   </devices>
Aug 15 19:13:14 user nova-compute[73188]: </domain>
Aug 15 19:13:14 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2127906751',display_name='tempest-tempest.common.compute-instance-2127906751',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2127906751',id=22,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT7pHtenQdl314usiZ2R/MplkqppVUszRcYtdF8PoT9iwdYNWnlBFP4lclfbI6J8I2Ewyw1annhgge1Ik0u6ps1bdNRiu2LQt8/JVAam6sa0kutoFjAwiPMLeb/O6NAfQ==',key_name='tempest-keypair-1165066426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c085a0ccf841e297d98037c07a7111',ramdisk_id='',reservation_id='r-x091yrli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2026424764',owner_user_name='tempest-ServerActionsTestOtherA-2026424764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:13:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30de55a2834422c8f6df816899b881e',uuid=2a472af2-b10c-456b-8dba-6c75f3ab806a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fadc6652-e769-4a50-81a4-caefd1de83ff", "address": "fa:16:3e:28:1c:a1", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc6652-e7", "ovs_interfaceid": "fadc6652-e769-4a50-81a4-caefd1de83ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converting VIF {"id": "fadc6652-e769-4a50-81a4-caefd1de83ff", "address": "fa:16:3e:28:1c:a1", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc6652-e7", "ovs_interfaceid": "fadc6652-e769-4a50-81a4-caefd1de83ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:1c:a1,bridge_name='br-int',has_traffic_filtering=True,id=fadc6652-e769-4a50-81a4-caefd1de83ff,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc6652-e7') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG os_vif [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:1c:a1,bridge_name='br-int',has_traffic_filtering=True,id=fadc6652-e769-4a50-81a4-caefd1de83ff,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc6652-e7') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfadc6652-e7, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfadc6652-e7, col_values=(('external_ids', {'iface-id': 'fadc6652-e769-4a50-81a4-caefd1de83ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:1c:a1', 'vm-uuid': '2a472af2-b10c-456b-8dba-6c75f3ab806a'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:14 user nova-compute[73188]: INFO os_vif [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:1c:a1,bridge_name='br-int',has_traffic_filtering=True,id=fadc6652-e769-4a50-81a4-caefd1de83ff,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc6652-e7')
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:13:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] No VIF found with MAC fa:16:3e:28:1c:a1, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:13:15 user nova-compute[73188]: DEBUG nova.network.neutron [req-b4cf30bf-a1e0-4493-b128-59c022067948 req-ad0c1508-941b-4237-b275-53d2122124a3 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Updated VIF entry in instance network info cache for port fadc6652-e769-4a50-81a4-caefd1de83ff. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:13:15 user nova-compute[73188]: DEBUG nova.network.neutron [req-b4cf30bf-a1e0-4493-b128-59c022067948 req-ad0c1508-941b-4237-b275-53d2122124a3 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Updating instance_info_cache with network_info: [{"id": "fadc6652-e769-4a50-81a4-caefd1de83ff", "address": "fa:16:3e:28:1c:a1", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc6652-e7", "ovs_interfaceid": "fadc6652-e769-4a50-81a4-caefd1de83ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:13:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b4cf30bf-a1e0-4493-b128-59c022067948 req-ad0c1508-941b-4237-b275-53d2122124a3 service nova] Releasing lock "refresh_cache-2a472af2-b10c-456b-8dba-6c75f3ab806a" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:13:15 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:13:15 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:13:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:15 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:13:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:16 user nova-compute[73188]: DEBUG nova.compute.manager [req-2952acf2-89cb-4a13-80cb-a35e98a52aa3 req-9e955f30-10f3-4008-ba03-0fd2e08f2048 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Received event network-vif-plugged-fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:13:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2952acf2-89cb-4a13-80cb-a35e98a52aa3 req-9e955f30-10f3-4008-ba03-0fd2e08f2048 service nova] Acquiring lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2952acf2-89cb-4a13-80cb-a35e98a52aa3 req-9e955f30-10f3-4008-ba03-0fd2e08f2048 service nova] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2952acf2-89cb-4a13-80cb-a35e98a52aa3 req-9e955f30-10f3-4008-ba03-0fd2e08f2048 service nova] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:16 user nova-compute[73188]: DEBUG nova.compute.manager [req-2952acf2-89cb-4a13-80cb-a35e98a52aa3 req-9e955f30-10f3-4008-ba03-0fd2e08f2048 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] No waiting events found dispatching network-vif-plugged-fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:13:16 user nova-compute[73188]: WARNING nova.compute.manager [req-2952acf2-89cb-4a13-80cb-a35e98a52aa3 req-9e955f30-10f3-4008-ba03-0fd2e08f2048 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Received unexpected event network-vif-plugged-fadc6652-e769-4a50-81a4-caefd1de83ff for instance with vm_state building and task_state spawning.
Aug 15 19:13:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:18 user nova-compute[73188]: DEBUG nova.compute.manager [req-0abb1272-86aa-40c0-94ae-c4c4c2857f60 req-6f6dec11-b073-492c-823b-7af899667145 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Received event network-vif-plugged-fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:13:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0abb1272-86aa-40c0-94ae-c4c4c2857f60 req-6f6dec11-b073-492c-823b-7af899667145 service nova] Acquiring lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0abb1272-86aa-40c0-94ae-c4c4c2857f60 req-6f6dec11-b073-492c-823b-7af899667145 service nova] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0abb1272-86aa-40c0-94ae-c4c4c2857f60 req-6f6dec11-b073-492c-823b-7af899667145 service nova] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:18 user nova-compute[73188]: DEBUG nova.compute.manager [req-0abb1272-86aa-40c0-94ae-c4c4c2857f60 req-6f6dec11-b073-492c-823b-7af899667145 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] No waiting events found dispatching network-vif-plugged-fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:13:18 user nova-compute[73188]: WARNING nova.compute.manager [req-0abb1272-86aa-40c0-94ae-c4c4c2857f60 req-6f6dec11-b073-492c-823b-7af899667145 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Received unexpected event network-vif-plugged-fadc6652-e769-4a50-81a4-caefd1de83ff for instance with vm_state building and task_state spawning.
Aug 15 19:13:18 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126798.940827, 2a472af2-b10c-456b-8dba-6c75f3ab806a => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:13:18 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] VM Resumed (Lifecycle Event)
Aug 15 19:13:18 user nova-compute[73188]: DEBUG nova.compute.manager [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:13:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:13:18 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Instance spawned successfully.
Aug 15 19:13:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:13:18 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:13:18 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:13:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:19 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:13:19 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126798.9436643, 2a472af2-b10c-456b-8dba-6c75f3ab806a => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:13:19 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] VM Started (Lifecycle Event)
Aug 15 19:13:19 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:13:19 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:13:19 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:13:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:19 user nova-compute[73188]: INFO nova.compute.manager [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Took 6.55 seconds to spawn the instance on the hypervisor.
Aug 15 19:13:19 user nova-compute[73188]: DEBUG nova.compute.manager [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:13:19 user nova-compute[73188]: INFO nova.compute.manager [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Took 7.48 seconds to build instance.
Aug 15 19:13:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d8d281c8-13da-4a8a-9e91-162ed7db44ff tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.602s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514c4115-057d-4cd2-8869-daf3d38fa5de/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514c4115-057d-4cd2-8869-daf3d38fa5de/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514c4115-057d-4cd2-8869-daf3d38fa5de/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514c4115-057d-4cd2-8869-daf3d38fa5de/disk --force-share --output=json" returned: 0 in 0.326s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:13:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.289s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:13:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:24 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:13:24 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:13:24 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=7428MB free_disk=25.37929916381836GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:13:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:24 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:13:24 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 7caf434b-1484-4832-afee-0e2454bb5089 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:13:24 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3d713d03-3e60-4dec-a295-a4652ac21842 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:13:24 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance d1b5f5bf-9672-40a8-83da-3a8f25007e91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:13:24 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e00adf53-085f-436d-a09f-e97e92ca79cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:13:24 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance de6929cd-c95d-4964-b81c-96872a137f90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:13:24 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 139ccf1c-4792-4653-9475-c61b1f9c4846 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:13:24 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 215077af-60a1-4a82-b24e-1545349363d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:13:24 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 514c4115-057d-4cd2-8869-daf3d38fa5de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:13:24 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 2a472af2-b10c-456b-8dba-6c75f3ab806a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:13:24 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:13:24 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:13:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:25 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:13:25 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:13:25 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:13:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.525s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:26 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:13:26 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:13:26 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:13:26 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:13:26 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:13:26 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:13:26 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:13:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Acquiring lock "514c4115-057d-4cd2-8869-daf3d38fa5de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Acquiring lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:28 user nova-compute[73188]: INFO nova.compute.manager [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Terminating instance
Aug 15 19:13:28 user nova-compute[73188]: DEBUG nova.compute.manager [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:13:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:28 user nova-compute[73188]: DEBUG nova.compute.manager [req-ab6276fc-267e-4045-afc9-f459a3ab0336 req-599684f3-7bf2-478e-bb99-fae7058291f4 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Received event network-vif-unplugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:13:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ab6276fc-267e-4045-afc9-f459a3ab0336 req-599684f3-7bf2-478e-bb99-fae7058291f4 service nova] Acquiring lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ab6276fc-267e-4045-afc9-f459a3ab0336 req-599684f3-7bf2-478e-bb99-fae7058291f4 service nova] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ab6276fc-267e-4045-afc9-f459a3ab0336 req-599684f3-7bf2-478e-bb99-fae7058291f4 service nova] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:28 user nova-compute[73188]: DEBUG nova.compute.manager [req-ab6276fc-267e-4045-afc9-f459a3ab0336 req-599684f3-7bf2-478e-bb99-fae7058291f4 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] No waiting events found dispatching network-vif-unplugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:13:28 user nova-compute[73188]: DEBUG nova.compute.manager [req-ab6276fc-267e-4045-afc9-f459a3ab0336 req-599684f3-7bf2-478e-bb99-fae7058291f4 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Received event network-vif-unplugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:13:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:29 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Instance destroyed successfully.
Aug 15 19:13:29 user nova-compute[73188]: DEBUG nova.objects.instance [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Lazy-loading 'resources' on Instance uuid 514c4115-057d-4cd2-8869-daf3d38fa5de {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:13:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-320628993',display_name='tempest-VolumesActionsTest-instance-320628993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-320628993',id=21,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:11:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='508c36eff4c347438cd7a3d0c035c479',ramdisk_id='',reservation_id='r-44i6k9qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1096761073',owner_user_name='tempest-VolumesActionsTest-1096761073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:11:32Z,user_data=None,user_id='f0af9d72e3404f7f8d1657b11116656e',uuid=514c4115-057d-4cd2-8869-daf3d38fa5de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5f8bc4e-22d5-457f-9eca-81ccf5442e8b", "address": "fa:16:3e:0d:a6:aa", "network": {"id": "d238bdf0-2605-488f-b339-ad066bb65e0a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-404711833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508c36eff4c347438cd7a3d0c035c479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f8bc4e-22", "ovs_interfaceid": "d5f8bc4e-22d5-457f-9eca-81ccf5442e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:13:29 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Converting VIF {"id": "d5f8bc4e-22d5-457f-9eca-81ccf5442e8b", "address": "fa:16:3e:0d:a6:aa", "network": {"id": "d238bdf0-2605-488f-b339-ad066bb65e0a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-404711833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508c36eff4c347438cd7a3d0c035c479", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f8bc4e-22", "ovs_interfaceid": "d5f8bc4e-22d5-457f-9eca-81ccf5442e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:13:29 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:a6:aa,bridge_name='br-int',has_traffic_filtering=True,id=d5f8bc4e-22d5-457f-9eca-81ccf5442e8b,network=Network(d238bdf0-2605-488f-b339-ad066bb65e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f8bc4e-22') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:13:29 user nova-compute[73188]: DEBUG os_vif [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:a6:aa,bridge_name='br-int',has_traffic_filtering=True,id=d5f8bc4e-22d5-457f-9eca-81ccf5442e8b,network=Network(d238bdf0-2605-488f-b339-ad066bb65e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f8bc4e-22') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:13:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5f8bc4e-22, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:13:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:13:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:29 user nova-compute[73188]: INFO os_vif [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:a6:aa,bridge_name='br-int',has_traffic_filtering=True,id=d5f8bc4e-22d5-457f-9eca-81ccf5442e8b,network=Network(d238bdf0-2605-488f-b339-ad066bb65e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f8bc4e-22')
Aug 15 19:13:29 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Deleting instance files /opt/stack/data/nova/instances/514c4115-057d-4cd2-8869-daf3d38fa5de_del
Aug 15 19:13:29 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Deletion of /opt/stack/data/nova/instances/514c4115-057d-4cd2-8869-daf3d38fa5de_del complete
Aug 15 19:13:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:29 user nova-compute[73188]: INFO nova.compute.manager [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 15 19:13:29 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:13:29 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:13:29 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:13:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:30 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:13:30 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Took 1.14 seconds to deallocate network for instance.
Aug 15 19:13:30 user nova-compute[73188]: DEBUG nova.compute.manager [req-a9633320-987d-4c92-9bfb-39fb09418cea req-ee0a41fb-db72-435b-acba-b9f21a666ed9 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Received event network-vif-deleted-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:13:30 user nova-compute[73188]: INFO nova.compute.manager [req-a9633320-987d-4c92-9bfb-39fb09418cea req-ee0a41fb-db72-435b-acba-b9f21a666ed9 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Neutron deleted interface d5f8bc4e-22d5-457f-9eca-81ccf5442e8b; detaching it from the instance and deleting it from the info cache
Aug 15 19:13:30 user nova-compute[73188]: DEBUG nova.network.neutron [req-a9633320-987d-4c92-9bfb-39fb09418cea req-ee0a41fb-db72-435b-acba-b9f21a666ed9 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:13:30 user nova-compute[73188]: DEBUG nova.compute.manager [req-a9633320-987d-4c92-9bfb-39fb09418cea req-ee0a41fb-db72-435b-acba-b9f21a666ed9 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Detach interface failed, port_id=d5f8bc4e-22d5-457f-9eca-81ccf5442e8b, reason: Instance 514c4115-057d-4cd2-8869-daf3d38fa5de could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:13:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG nova.compute.manager [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Received event network-vif-plugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] Acquiring lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG nova.compute.manager [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] No waiting events found dispatching network-vif-plugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:13:31 user nova-compute[73188]: WARNING nova.compute.manager [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Received unexpected event network-vif-plugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b for instance with vm_state deleted and task_state None.
Aug 15 19:13:31 user nova-compute[73188]: DEBUG nova.compute.manager [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Received event network-vif-plugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] Acquiring lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG nova.compute.manager [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] No waiting events found dispatching network-vif-plugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:13:31 user nova-compute[73188]: WARNING nova.compute.manager [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Received unexpected event network-vif-plugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b for instance with vm_state deleted and task_state None.
Aug 15 19:13:31 user nova-compute[73188]: DEBUG nova.compute.manager [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Received event network-vif-plugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] Acquiring lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG nova.compute.manager [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] No waiting events found dispatching network-vif-plugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:13:31 user nova-compute[73188]: WARNING nova.compute.manager [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Received unexpected event network-vif-plugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b for instance with vm_state deleted and task_state None.
Aug 15 19:13:31 user nova-compute[73188]: DEBUG nova.compute.manager [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Received event network-vif-unplugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] Acquiring lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG nova.compute.manager [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] No waiting events found dispatching network-vif-unplugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:13:31 user nova-compute[73188]: WARNING nova.compute.manager [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Received unexpected event network-vif-unplugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b for instance with vm_state deleted and task_state None.
Aug 15 19:13:31 user nova-compute[73188]: DEBUG nova.compute.manager [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Received event network-vif-plugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] Acquiring lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG nova.compute.manager [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] No waiting events found dispatching network-vif-plugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:13:31 user nova-compute[73188]: WARNING nova.compute.manager [req-3ca18a14-501b-43cf-b709-5025d6662d4a req-43fdd699-dc4b-4d7a-aeea-946dd5268267 service nova] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Received unexpected event network-vif-plugged-d5f8bc4e-22d5-457f-9eca-81ccf5442e8b for instance with vm_state deleted and task_state None.
Aug 15 19:13:31 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.498s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:31 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Deleted allocations for instance 514c4115-057d-4cd2-8869-daf3d38fa5de
Aug 15 19:13:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d75a6d2e-9ed4-4ec9-8d62-4f362e0923d3 tempest-VolumesActionsTest-1096761073 tempest-VolumesActionsTest-1096761073-project-member] Lock "514c4115-057d-4cd2-8869-daf3d38fa5de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.024s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "7f96acc3-0856-462e-9a32-879848f60a0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "7f96acc3-0856-462e-9a32-879848f60a0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:42 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:13:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:13:42 user nova-compute[73188]: INFO nova.compute.claims [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Claim successful on node user
Aug 15 19:13:43 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:13:43 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:13:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:43 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:13:43 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:13:43 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:13:43 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:13:43 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:13:43 user nova-compute[73188]: DEBUG nova.policy [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f7c7805c0754c61a5b9f8d16e28b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575959aac5a1464dac98034bdb3bb948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:13:43 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:13:43 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:13:43 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Creating image(s)
Aug 15 19:13:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "/opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "/opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84.part --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84.part --force-share --output=json" returned: 0 in 0.213s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:43 user nova-compute[73188]: DEBUG nova.virt.images [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] db09264f-693e-42ea-ab97-9a80e0e3d7f0 was qcow2, converting to raw {{(pid=73188) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 19:13:43 user nova-compute[73188]: DEBUG nova.privsep.utils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73188) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 19:13:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84.part /opt/stack/data/nova/instances/_base/bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84.converted {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:44 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Successfully created port: c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:13:44 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692126809.151042, 514c4115-057d-4cd2-8869-daf3d38fa5de => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:13:44 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] VM Stopped (Lifecycle Event)
Aug 15 19:13:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84.part /opt/stack/data/nova/instances/_base/bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84.converted" returned: 0 in 0.247s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84.converted --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:44 user nova-compute[73188]: DEBUG nova.compute.manager [None req-44870c53-ede5-41e5-9b0d-da500bb4b4c0 None None] [instance: 514c4115-057d-4cd2-8869-daf3d38fa5de] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:13:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.036s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84 --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84 --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84 --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84 --force-share --output=json" returned: 0 in 0.215s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84,backing_fmt=raw /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84,backing_fmt=raw /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk 1073741824" returned: 0 in 0.069s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84 --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Successfully updated port: c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "refresh_cache-7f96acc3-0856-462e-9a32-879848f60a0e" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquired lock "refresh_cache-7f96acc3-0856-462e-9a32-879848f60a0e" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.compute.manager [req-3993d01f-dce0-433d-9af3-28098f93d06f req-f21f9b57-9616-4dae-a797-f9283f0cf306 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Received event network-changed-c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.compute.manager [req-3993d01f-dce0-433d-9af3-28098f93d06f req-f21f9b57-9616-4dae-a797-f9283f0cf306 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Refreshing instance network info cache due to event network-changed-c10933cb-e730-47f0-9b80-fcec4cf6c359. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3993d01f-dce0-433d-9af3-28098f93d06f req-f21f9b57-9616-4dae-a797-f9283f0cf306 service nova] Acquiring lock "refresh_cache-7f96acc3-0856-462e-9a32-879848f60a0e" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84 --force-share --output=json" returned: 0 in 0.247s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Cannot resize image /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.objects.instance [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lazy-loading 'migration_context' on Instance uuid 7f96acc3-0856-462e-9a32-879848f60a0e {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Ensure instance console log exists: /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Updating instance_info_cache with network_info: [{"id": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "address": "fa:16:3e:9b:51:30", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10933cb-e7", "ovs_interfaceid": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Releasing lock "refresh_cache-7f96acc3-0856-462e-9a32-879848f60a0e" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Instance network_info: |[{"id": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "address": "fa:16:3e:9b:51:30", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10933cb-e7", "ovs_interfaceid": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3993d01f-dce0-433d-9af3-28098f93d06f req-f21f9b57-9616-4dae-a797-f9283f0cf306 service nova] Acquired lock "refresh_cache-7f96acc3-0856-462e-9a32-879848f60a0e" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.network.neutron [req-3993d01f-dce0-433d-9af3-28098f93d06f req-f21f9b57-9616-4dae-a797-f9283f0cf306 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Refreshing network info cache for port c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Start _get_guest_xml network_info=[{"id": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "address": "fa:16:3e:9b:51:30", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10933cb-e7", "ovs_interfaceid": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:13:40Z,direct_url=<?>,disk_format='qcow2',id=db09264f-693e-42ea-ab97-9a80e0e3d7f0,min_disk=0,min_ram=0,name='tempest-scenario-img--1039630936',owner='575959aac5a1464dac98034bdb3bb948',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:13:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'db09264f-693e-42ea-ab97-9a80e0e3d7f0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:13:45 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:13:45 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:13:40Z,direct_url=<?>,disk_format='qcow2',id=db09264f-693e-42ea-ab97-9a80e0e3d7f0,min_disk=0,min_ram=0,name='tempest-scenario-img--1039630936',owner='575959aac5a1464dac98034bdb3bb948',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:13:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-111252592',display_name='tempest-TestMinimumBasicScenario-server-111252592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-111252592',id=23,image_ref='db09264f-693e-42ea-ab97-9a80e0e3d7f0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzo1j4cBVFAovrT7TfUccrKZwiKQpZGTviawtl6Vd3nA7f6TnDYbJz/KfV9RA6oyc9t51QGzFgTfIWoGj/0yFu5Aw7Xq/O5Z50dyEYYFvMfClGGQzXjpVM891a+E+DfEw==',key_name='tempest-TestMinimumBasicScenario-48362326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='575959aac5a1464dac98034bdb3bb948',ramdisk_id='',reservation_id='r-6e5ncuey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='db09264f-693e-42ea-ab97-9a80e0e3d7f0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1939446316',owner_user_name='tempest-TestMinimumBasicScenario-1939446316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:13:43Z,user_data=None,user_id='9f7c7805c0754c61a5b9f8d16e28b228',uuid=7f96acc3-0856-462e-9a32-879848f60a0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "address": "fa:16:3e:9b:51:30", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10933cb-e7", "ovs_interfaceid": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Converting VIF {"id": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "address": "fa:16:3e:9b:51:30", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10933cb-e7", "ovs_interfaceid": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:51:30,bridge_name='br-int',has_traffic_filtering=True,id=c10933cb-e730-47f0-9b80-fcec4cf6c359,network=Network(a4981d47-8986-4ebf-a0cd-54692da9ff40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc10933cb-e7') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.objects.instance [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f96acc3-0856-462e-9a32-879848f60a0e {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:13:45 user nova-compute[73188]:   <uuid>7f96acc3-0856-462e-9a32-879848f60a0e</uuid>
Aug 15 19:13:45 user nova-compute[73188]:   <name>instance-00000017</name>
Aug 15 19:13:45 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:13:45 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:13:45 user nova-compute[73188]:   <metadata>
Aug 15 19:13:45 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:13:45 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:13:45 user nova-compute[73188]:       <nova:name>tempest-TestMinimumBasicScenario-server-111252592</nova:name>
Aug 15 19:13:45 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:13:45</nova:creationTime>
Aug 15 19:13:45 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:13:45 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:13:45 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:13:45 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:13:45 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:13:45 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:13:45 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:13:45 user nova-compute[73188]:       <nova:owner>
Aug 15 19:13:45 user nova-compute[73188]:         <nova:user uuid="9f7c7805c0754c61a5b9f8d16e28b228">tempest-TestMinimumBasicScenario-1939446316-project-member</nova:user>
Aug 15 19:13:45 user nova-compute[73188]:         <nova:project uuid="575959aac5a1464dac98034bdb3bb948">tempest-TestMinimumBasicScenario-1939446316</nova:project>
Aug 15 19:13:45 user nova-compute[73188]:       </nova:owner>
Aug 15 19:13:45 user nova-compute[73188]:       <nova:root type="image" uuid="db09264f-693e-42ea-ab97-9a80e0e3d7f0"/>
Aug 15 19:13:45 user nova-compute[73188]:       <nova:ports>
Aug 15 19:13:45 user nova-compute[73188]:         <nova:port uuid="c10933cb-e730-47f0-9b80-fcec4cf6c359">
Aug 15 19:13:45 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 19:13:45 user nova-compute[73188]:         </nova:port>
Aug 15 19:13:45 user nova-compute[73188]:       </nova:ports>
Aug 15 19:13:45 user nova-compute[73188]:     </nova:instance>
Aug 15 19:13:45 user nova-compute[73188]:   </metadata>
Aug 15 19:13:45 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:13:45 user nova-compute[73188]:     <system>
Aug 15 19:13:45 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:13:45 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:13:45 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:13:45 user nova-compute[73188]:       <entry name="serial">7f96acc3-0856-462e-9a32-879848f60a0e</entry>
Aug 15 19:13:45 user nova-compute[73188]:       <entry name="uuid">7f96acc3-0856-462e-9a32-879848f60a0e</entry>
Aug 15 19:13:45 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:13:45 user nova-compute[73188]:     </system>
Aug 15 19:13:45 user nova-compute[73188]:   </sysinfo>
Aug 15 19:13:45 user nova-compute[73188]:   <os>
Aug 15 19:13:45 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:13:45 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:13:45 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:13:45 user nova-compute[73188]:   </os>
Aug 15 19:13:45 user nova-compute[73188]:   <features>
Aug 15 19:13:45 user nova-compute[73188]:     <acpi/>
Aug 15 19:13:45 user nova-compute[73188]:     <apic/>
Aug 15 19:13:45 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:13:45 user nova-compute[73188]:   </features>
Aug 15 19:13:45 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:13:45 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:13:45 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:13:45 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:13:45 user nova-compute[73188]:   </clock>
Aug 15 19:13:45 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:13:45 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:13:45 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:13:45 user nova-compute[73188]:   </cpu>
Aug 15 19:13:45 user nova-compute[73188]:   <devices>
Aug 15 19:13:45 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:13:45 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:13:45 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk"/>
Aug 15 19:13:45 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:13:45 user nova-compute[73188]:     </disk>
Aug 15 19:13:45 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:13:45 user nova-compute[73188]:       <mac address="fa:16:3e:9b:51:30"/>
Aug 15 19:13:45 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:13:45 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:13:45 user nova-compute[73188]:       <target dev="tapc10933cb-e7"/>
Aug 15 19:13:45 user nova-compute[73188]:     </interface>
Aug 15 19:13:45 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:13:45 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/console.log" append="off"/>
Aug 15 19:13:45 user nova-compute[73188]:     </serial>
Aug 15 19:13:45 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:13:45 user nova-compute[73188]:     <video>
Aug 15 19:13:45 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:13:45 user nova-compute[73188]:     </video>
Aug 15 19:13:45 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:13:45 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:13:45 user nova-compute[73188]:     </rng>
Aug 15 19:13:45 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:13:45 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:13:45 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:13:45 user nova-compute[73188]:     </memballoon>
Aug 15 19:13:45 user nova-compute[73188]:   </devices>
Aug 15 19:13:45 user nova-compute[73188]: </domain>
Aug 15 19:13:45 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-111252592',display_name='tempest-TestMinimumBasicScenario-server-111252592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-111252592',id=23,image_ref='db09264f-693e-42ea-ab97-9a80e0e3d7f0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzo1j4cBVFAovrT7TfUccrKZwiKQpZGTviawtl6Vd3nA7f6TnDYbJz/KfV9RA6oyc9t51QGzFgTfIWoGj/0yFu5Aw7Xq/O5Z50dyEYYFvMfClGGQzXjpVM891a+E+DfEw==',key_name='tempest-TestMinimumBasicScenario-48362326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='575959aac5a1464dac98034bdb3bb948',ramdisk_id='',reservation_id='r-6e5ncuey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='db09264f-693e-42ea-ab97-9a80e0e3d7f0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1939446316',owner_user_name='tempest-TestMinimumBasicScenario-1939446316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:13:43Z,user_data=None,user_id='9f7c7805c0754c61a5b9f8d16e28b228',uuid=7f96acc3-0856-462e-9a32-879848f60a0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "address": "fa:16:3e:9b:51:30", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10933cb-e7", "ovs_interfaceid": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Converting VIF {"id": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "address": "fa:16:3e:9b:51:30", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10933cb-e7", "ovs_interfaceid": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:51:30,bridge_name='br-int',has_traffic_filtering=True,id=c10933cb-e730-47f0-9b80-fcec4cf6c359,network=Network(a4981d47-8986-4ebf-a0cd-54692da9ff40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc10933cb-e7') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG os_vif [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:51:30,bridge_name='br-int',has_traffic_filtering=True,id=c10933cb-e730-47f0-9b80-fcec4cf6c359,network=Network(a4981d47-8986-4ebf-a0cd-54692da9ff40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc10933cb-e7') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc10933cb-e7, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc10933cb-e7, col_values=(('external_ids', {'iface-id': 'c10933cb-e730-47f0-9b80-fcec4cf6c359', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:51:30', 'vm-uuid': '7f96acc3-0856-462e-9a32-879848f60a0e'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:45 user nova-compute[73188]: INFO os_vif [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:51:30,bridge_name='br-int',has_traffic_filtering=True,id=c10933cb-e730-47f0-9b80-fcec4cf6c359,network=Network(a4981d47-8986-4ebf-a0cd-54692da9ff40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc10933cb-e7')
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] No VIF found with MAC fa:16:3e:9b:51:30, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.network.neutron [req-3993d01f-dce0-433d-9af3-28098f93d06f req-f21f9b57-9616-4dae-a797-f9283f0cf306 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Updated VIF entry in instance network info cache for port c10933cb-e730-47f0-9b80-fcec4cf6c359. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:13:45 user nova-compute[73188]: DEBUG nova.network.neutron [req-3993d01f-dce0-433d-9af3-28098f93d06f req-f21f9b57-9616-4dae-a797-f9283f0cf306 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Updating instance_info_cache with network_info: [{"id": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "address": "fa:16:3e:9b:51:30", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10933cb-e7", "ovs_interfaceid": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:13:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3993d01f-dce0-433d-9af3-28098f93d06f req-f21f9b57-9616-4dae-a797-f9283f0cf306 service nova] Releasing lock "refresh_cache-7f96acc3-0856-462e-9a32-879848f60a0e" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:13:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Acquiring lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:13:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:46 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:13:46 user nova-compute[73188]: INFO nova.compute.claims [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Claim successful on node user
Aug 15 19:13:46 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:13:46 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:13:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.586s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:13:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:13:46 user nova-compute[73188]: DEBUG nova.network.neutron [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:13:46 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:13:47 user nova-compute[73188]: DEBUG nova.compute.manager [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG nova.policy [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bee4ed91c66d41a791684721e77abc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dbae0375534e838d252cbd3f47722a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG nova.compute.manager [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:13:47 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Creating image(s)
Aug 15 19:13:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Acquiring lock "/opt/stack/data/nova/instances/4cc14820-2d7d-4779-8d90-b77462f1bfa8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "/opt/stack/data/nova/instances/4cc14820-2d7d-4779-8d90-b77462f1bfa8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "/opt/stack/data/nova/instances/4cc14820-2d7d-4779-8d90-b77462f1bfa8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.227s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG nova.compute.manager [req-7b2234f0-9ebf-40ac-ab78-4599a9a5b04d req-6b2a1ef0-6ad9-4966-ac76-7b0f822c168e service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Received event network-vif-plugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7b2234f0-9ebf-40ac-ab78-4599a9a5b04d req-6b2a1ef0-6ad9-4966-ac76-7b0f822c168e service nova] Acquiring lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7b2234f0-9ebf-40ac-ab78-4599a9a5b04d req-6b2a1ef0-6ad9-4966-ac76-7b0f822c168e service nova] Lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7b2234f0-9ebf-40ac-ab78-4599a9a5b04d req-6b2a1ef0-6ad9-4966-ac76-7b0f822c168e service nova] Lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG nova.compute.manager [req-7b2234f0-9ebf-40ac-ab78-4599a9a5b04d req-6b2a1ef0-6ad9-4966-ac76-7b0f822c168e service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] No waiting events found dispatching network-vif-plugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:13:47 user nova-compute[73188]: WARNING nova.compute.manager [req-7b2234f0-9ebf-40ac-ab78-4599a9a5b04d req-6b2a1ef0-6ad9-4966-ac76-7b0f822c168e service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Received unexpected event network-vif-plugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 for instance with vm_state building and task_state spawning.
Aug 15 19:13:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.195s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/4cc14820-2d7d-4779-8d90-b77462f1bfa8/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/4cc14820-2d7d-4779-8d90-b77462f1bfa8/disk 1073741824" returned: 0 in 0.073s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.214s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4cc14820-2d7d-4779-8d90-b77462f1bfa8/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:13:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cc14820-2d7d-4779-8d90-b77462f1bfa8/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:48 user nova-compute[73188]: DEBUG nova.network.neutron [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Successfully created port: bacf9b02-1d5c-4db2-bf85-aeaefdaa6690 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:13:48 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cc14820-2d7d-4779-8d90-b77462f1bfa8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:48 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Cannot resize image /opt/stack/data/nova/instances/4cc14820-2d7d-4779-8d90-b77462f1bfa8/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:13:48 user nova-compute[73188]: DEBUG nova.objects.instance [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lazy-loading 'migration_context' on Instance uuid 4cc14820-2d7d-4779-8d90-b77462f1bfa8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:13:48 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:13:48 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Ensure instance console log exists: /opt/stack/data/nova/instances/4cc14820-2d7d-4779-8d90-b77462f1bfa8/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:13:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.network.neutron [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Successfully updated port: bacf9b02-1d5c-4db2-bf85-aeaefdaa6690 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Acquiring lock "refresh_cache-4cc14820-2d7d-4779-8d90-b77462f1bfa8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Acquired lock "refresh_cache-4cc14820-2d7d-4779-8d90-b77462f1bfa8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.network.neutron [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.network.neutron [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126829.3846493, 7f96acc3-0856-462e-9a32-879848f60a0e => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:13:49 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] VM Resumed (Lifecycle Event)
Aug 15 19:13:49 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Instance spawned successfully.
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:49 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126829.3896909, 7f96acc3-0856-462e-9a32-879848f60a0e => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:13:49 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] VM Started (Lifecycle Event)
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:13:49 user nova-compute[73188]: INFO nova.compute.manager [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Took 6.17 seconds to spawn the instance on the hypervisor.
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:13:49 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.network.neutron [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Updating instance_info_cache with network_info: [{"id": "bacf9b02-1d5c-4db2-bf85-aeaefdaa6690", "address": "fa:16:3e:f9:aa:e7", "network": {"id": "c8017021-3911-4579-bb4d-707d3db965e8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1745022888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dbae0375534e838d252cbd3f47722a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf9b02-1d", "ovs_interfaceid": "bacf9b02-1d5c-4db2-bf85-aeaefdaa6690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Releasing lock "refresh_cache-4cc14820-2d7d-4779-8d90-b77462f1bfa8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.compute.manager [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Instance network_info: |[{"id": "bacf9b02-1d5c-4db2-bf85-aeaefdaa6690", "address": "fa:16:3e:f9:aa:e7", "network": {"id": "c8017021-3911-4579-bb4d-707d3db965e8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1745022888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dbae0375534e838d252cbd3f47722a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf9b02-1d", "ovs_interfaceid": "bacf9b02-1d5c-4db2-bf85-aeaefdaa6690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Start _get_guest_xml network_info=[{"id": "bacf9b02-1d5c-4db2-bf85-aeaefdaa6690", "address": "fa:16:3e:f9:aa:e7", "network": {"id": "c8017021-3911-4579-bb4d-707d3db965e8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1745022888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dbae0375534e838d252cbd3f47722a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf9b02-1d", "ovs_interfaceid": "bacf9b02-1d5c-4db2-bf85-aeaefdaa6690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:13:49 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:13:49 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:13:49 user nova-compute[73188]: INFO nova.compute.manager [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Took 7.02 seconds to build instance.
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-964063720',display_name='tempest-DeleteServersTestJSON-server-964063720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-964063720',id=24,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73dbae0375534e838d252cbd3f47722a',ramdisk_id='',reservation_id='r-bgda3jho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-606129902',owner_user_name='tempest-DeleteServersTestJSON-606129902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:13:47Z,user_data=None,user_id='bee4ed91c66d41a791684721e77abc17',uuid=4cc14820-2d7d-4779-8d90-b77462f1bfa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bacf9b02-1d5c-4db2-bf85-aeaefdaa6690", "address": "fa:16:3e:f9:aa:e7", "network": {"id": "c8017021-3911-4579-bb4d-707d3db965e8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1745022888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dbae0375534e838d252cbd3f47722a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf9b02-1d", "ovs_interfaceid": "bacf9b02-1d5c-4db2-bf85-aeaefdaa6690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Converting VIF {"id": "bacf9b02-1d5c-4db2-bf85-aeaefdaa6690", "address": "fa:16:3e:f9:aa:e7", "network": {"id": "c8017021-3911-4579-bb4d-707d3db965e8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1745022888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dbae0375534e838d252cbd3f47722a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf9b02-1d", "ovs_interfaceid": "bacf9b02-1d5c-4db2-bf85-aeaefdaa6690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:aa:e7,bridge_name='br-int',has_traffic_filtering=True,id=bacf9b02-1d5c-4db2-bf85-aeaefdaa6690,network=Network(c8017021-3911-4579-bb4d-707d3db965e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacf9b02-1d') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.objects.instance [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lazy-loading 'pci_devices' on Instance uuid 4cc14820-2d7d-4779-8d90-b77462f1bfa8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1cba1690-aefe-44ea-94fc-d33c77061548 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "7f96acc3-0856-462e-9a32-879848f60a0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.163s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.compute.manager [req-70361ede-1643-4b4f-b000-675be77355ff req-ec354ba0-9315-4f41-8ac4-21b395fb6f9a service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Received event network-vif-plugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-70361ede-1643-4b4f-b000-675be77355ff req-ec354ba0-9315-4f41-8ac4-21b395fb6f9a service nova] Acquiring lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-70361ede-1643-4b4f-b000-675be77355ff req-ec354ba0-9315-4f41-8ac4-21b395fb6f9a service nova] Lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-70361ede-1643-4b4f-b000-675be77355ff req-ec354ba0-9315-4f41-8ac4-21b395fb6f9a service nova] Lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.compute.manager [req-70361ede-1643-4b4f-b000-675be77355ff req-ec354ba0-9315-4f41-8ac4-21b395fb6f9a service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] No waiting events found dispatching network-vif-plugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:13:49 user nova-compute[73188]: WARNING nova.compute.manager [req-70361ede-1643-4b4f-b000-675be77355ff req-ec354ba0-9315-4f41-8ac4-21b395fb6f9a service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Received unexpected event network-vif-plugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 for instance with vm_state active and task_state None.
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.compute.manager [req-70361ede-1643-4b4f-b000-675be77355ff req-ec354ba0-9315-4f41-8ac4-21b395fb6f9a service nova] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Received event network-changed-bacf9b02-1d5c-4db2-bf85-aeaefdaa6690 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.compute.manager [req-70361ede-1643-4b4f-b000-675be77355ff req-ec354ba0-9315-4f41-8ac4-21b395fb6f9a service nova] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Refreshing instance network info cache due to event network-changed-bacf9b02-1d5c-4db2-bf85-aeaefdaa6690. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-70361ede-1643-4b4f-b000-675be77355ff req-ec354ba0-9315-4f41-8ac4-21b395fb6f9a service nova] Acquiring lock "refresh_cache-4cc14820-2d7d-4779-8d90-b77462f1bfa8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-70361ede-1643-4b4f-b000-675be77355ff req-ec354ba0-9315-4f41-8ac4-21b395fb6f9a service nova] Acquired lock "refresh_cache-4cc14820-2d7d-4779-8d90-b77462f1bfa8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.network.neutron [req-70361ede-1643-4b4f-b000-675be77355ff req-ec354ba0-9315-4f41-8ac4-21b395fb6f9a service nova] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Refreshing network info cache for port bacf9b02-1d5c-4db2-bf85-aeaefdaa6690 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:13:49 user nova-compute[73188]:   <uuid>4cc14820-2d7d-4779-8d90-b77462f1bfa8</uuid>
Aug 15 19:13:49 user nova-compute[73188]:   <name>instance-00000018</name>
Aug 15 19:13:49 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:13:49 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:13:49 user nova-compute[73188]:   <metadata>
Aug 15 19:13:49 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:13:49 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:13:49 user nova-compute[73188]:       <nova:name>tempest-DeleteServersTestJSON-server-964063720</nova:name>
Aug 15 19:13:49 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:13:49</nova:creationTime>
Aug 15 19:13:49 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:13:49 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:13:49 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:13:49 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:13:49 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:13:49 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:13:49 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:13:49 user nova-compute[73188]:       <nova:owner>
Aug 15 19:13:49 user nova-compute[73188]:         <nova:user uuid="bee4ed91c66d41a791684721e77abc17">tempest-DeleteServersTestJSON-606129902-project-member</nova:user>
Aug 15 19:13:49 user nova-compute[73188]:         <nova:project uuid="73dbae0375534e838d252cbd3f47722a">tempest-DeleteServersTestJSON-606129902</nova:project>
Aug 15 19:13:49 user nova-compute[73188]:       </nova:owner>
Aug 15 19:13:49 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:13:49 user nova-compute[73188]:       <nova:ports>
Aug 15 19:13:49 user nova-compute[73188]:         <nova:port uuid="bacf9b02-1d5c-4db2-bf85-aeaefdaa6690">
Aug 15 19:13:49 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 19:13:49 user nova-compute[73188]:         </nova:port>
Aug 15 19:13:49 user nova-compute[73188]:       </nova:ports>
Aug 15 19:13:49 user nova-compute[73188]:     </nova:instance>
Aug 15 19:13:49 user nova-compute[73188]:   </metadata>
Aug 15 19:13:49 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:13:49 user nova-compute[73188]:     <system>
Aug 15 19:13:49 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:13:49 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:13:49 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:13:49 user nova-compute[73188]:       <entry name="serial">4cc14820-2d7d-4779-8d90-b77462f1bfa8</entry>
Aug 15 19:13:49 user nova-compute[73188]:       <entry name="uuid">4cc14820-2d7d-4779-8d90-b77462f1bfa8</entry>
Aug 15 19:13:49 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:13:49 user nova-compute[73188]:     </system>
Aug 15 19:13:49 user nova-compute[73188]:   </sysinfo>
Aug 15 19:13:49 user nova-compute[73188]:   <os>
Aug 15 19:13:49 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:13:49 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:13:49 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:13:49 user nova-compute[73188]:   </os>
Aug 15 19:13:49 user nova-compute[73188]:   <features>
Aug 15 19:13:49 user nova-compute[73188]:     <acpi/>
Aug 15 19:13:49 user nova-compute[73188]:     <apic/>
Aug 15 19:13:49 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:13:49 user nova-compute[73188]:   </features>
Aug 15 19:13:49 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:13:49 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:13:49 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:13:49 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:13:49 user nova-compute[73188]:   </clock>
Aug 15 19:13:49 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:13:49 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:13:49 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:13:49 user nova-compute[73188]:   </cpu>
Aug 15 19:13:49 user nova-compute[73188]:   <devices>
Aug 15 19:13:49 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:13:49 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:13:49 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/4cc14820-2d7d-4779-8d90-b77462f1bfa8/disk"/>
Aug 15 19:13:49 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:13:49 user nova-compute[73188]:     </disk>
Aug 15 19:13:49 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:13:49 user nova-compute[73188]:       <mac address="fa:16:3e:f9:aa:e7"/>
Aug 15 19:13:49 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:13:49 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:13:49 user nova-compute[73188]:       <target dev="tapbacf9b02-1d"/>
Aug 15 19:13:49 user nova-compute[73188]:     </interface>
Aug 15 19:13:49 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:13:49 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/4cc14820-2d7d-4779-8d90-b77462f1bfa8/console.log" append="off"/>
Aug 15 19:13:49 user nova-compute[73188]:     </serial>
Aug 15 19:13:49 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:13:49 user nova-compute[73188]:     <video>
Aug 15 19:13:49 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:13:49 user nova-compute[73188]:     </video>
Aug 15 19:13:49 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:13:49 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:13:49 user nova-compute[73188]:     </rng>
Aug 15 19:13:49 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:13:49 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:13:49 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:13:49 user nova-compute[73188]:     </memballoon>
Aug 15 19:13:49 user nova-compute[73188]:   </devices>
Aug 15 19:13:49 user nova-compute[73188]: </domain>
Aug 15 19:13:49 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-964063720',display_name='tempest-DeleteServersTestJSON-server-964063720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-964063720',id=24,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73dbae0375534e838d252cbd3f47722a',ramdisk_id='',reservation_id='r-bgda3jho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-606129902',owner_user_name='tempest-DeleteServersTestJSON-606129902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:13:47Z,user_data=None,user_id='bee4ed91c66d41a791684721e77abc17',uuid=4cc14820-2d7d-4779-8d90-b77462f1bfa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bacf9b02-1d5c-4db2-bf85-aeaefdaa6690", "address": "fa:16:3e:f9:aa:e7", "network": {"id": "c8017021-3911-4579-bb4d-707d3db965e8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1745022888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dbae0375534e838d252cbd3f47722a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf9b02-1d", "ovs_interfaceid": "bacf9b02-1d5c-4db2-bf85-aeaefdaa6690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Converting VIF {"id": "bacf9b02-1d5c-4db2-bf85-aeaefdaa6690", "address": "fa:16:3e:f9:aa:e7", "network": {"id": "c8017021-3911-4579-bb4d-707d3db965e8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1745022888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dbae0375534e838d252cbd3f47722a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf9b02-1d", "ovs_interfaceid": "bacf9b02-1d5c-4db2-bf85-aeaefdaa6690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:aa:e7,bridge_name='br-int',has_traffic_filtering=True,id=bacf9b02-1d5c-4db2-bf85-aeaefdaa6690,network=Network(c8017021-3911-4579-bb4d-707d3db965e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacf9b02-1d') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG os_vif [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:aa:e7,bridge_name='br-int',has_traffic_filtering=True,id=bacf9b02-1d5c-4db2-bf85-aeaefdaa6690,network=Network(c8017021-3911-4579-bb4d-707d3db965e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacf9b02-1d') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbacf9b02-1d, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbacf9b02-1d, col_values=(('external_ids', {'iface-id': 'bacf9b02-1d5c-4db2-bf85-aeaefdaa6690', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:aa:e7', 'vm-uuid': '4cc14820-2d7d-4779-8d90-b77462f1bfa8'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:49 user nova-compute[73188]: INFO os_vif [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:aa:e7,bridge_name='br-int',has_traffic_filtering=True,id=bacf9b02-1d5c-4db2-bf85-aeaefdaa6690,network=Network(c8017021-3911-4579-bb4d-707d3db965e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacf9b02-1d')
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:13:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] No VIF found with MAC fa:16:3e:f9:aa:e7, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:13:50 user nova-compute[73188]: DEBUG nova.network.neutron [req-70361ede-1643-4b4f-b000-675be77355ff req-ec354ba0-9315-4f41-8ac4-21b395fb6f9a service nova] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Updated VIF entry in instance network info cache for port bacf9b02-1d5c-4db2-bf85-aeaefdaa6690. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:13:50 user nova-compute[73188]: DEBUG nova.network.neutron [req-70361ede-1643-4b4f-b000-675be77355ff req-ec354ba0-9315-4f41-8ac4-21b395fb6f9a service nova] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Updating instance_info_cache with network_info: [{"id": "bacf9b02-1d5c-4db2-bf85-aeaefdaa6690", "address": "fa:16:3e:f9:aa:e7", "network": {"id": "c8017021-3911-4579-bb4d-707d3db965e8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1745022888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dbae0375534e838d252cbd3f47722a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf9b02-1d", "ovs_interfaceid": "bacf9b02-1d5c-4db2-bf85-aeaefdaa6690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:13:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-70361ede-1643-4b4f-b000-675be77355ff req-ec354ba0-9315-4f41-8ac4-21b395fb6f9a service nova] Releasing lock "refresh_cache-4cc14820-2d7d-4779-8d90-b77462f1bfa8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:13:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:13:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:50 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:13:50 user nova-compute[73188]: INFO nova.compute.claims [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Claim successful on node user
Aug 15 19:13:51 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:13:51 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:13:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:13:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:13:51 user nova-compute[73188]: DEBUG nova.network.neutron [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:13:51 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:13:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:13:51 user nova-compute[73188]: DEBUG nova.policy [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bad952eceaec400396fd0a28c438c761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab4e1cccd434f6c83f2f9e4687d274e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:13:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:13:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:13:51 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Creating image(s)
Aug 15 19:13:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "/opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "/opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.287s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.225s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-d3ef06ab-6ae1-4f8c-b3ef-a9492377e9fe req-55885fe0-44e0-4e04-866c-df1d9e512467 service nova] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Received event network-vif-plugged-bacf9b02-1d5c-4db2-bf85-aeaefdaa6690 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d3ef06ab-6ae1-4f8c-b3ef-a9492377e9fe req-55885fe0-44e0-4e04-866c-df1d9e512467 service nova] Acquiring lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d3ef06ab-6ae1-4f8c-b3ef-a9492377e9fe req-55885fe0-44e0-4e04-866c-df1d9e512467 service nova] Lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d3ef06ab-6ae1-4f8c-b3ef-a9492377e9fe req-55885fe0-44e0-4e04-866c-df1d9e512467 service nova] Lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-d3ef06ab-6ae1-4f8c-b3ef-a9492377e9fe req-55885fe0-44e0-4e04-866c-df1d9e512467 service nova] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] No waiting events found dispatching network-vif-plugged-bacf9b02-1d5c-4db2-bf85-aeaefdaa6690 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:13:52 user nova-compute[73188]: WARNING nova.compute.manager [req-d3ef06ab-6ae1-4f8c-b3ef-a9492377e9fe req-55885fe0-44e0-4e04-866c-df1d9e512467 service nova] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Received unexpected event network-vif-plugged-bacf9b02-1d5c-4db2-bf85-aeaefdaa6690 for instance with vm_state building and task_state spawning.
Aug 15 19:13:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk 1073741824" returned: 0 in 0.070s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.203s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Cannot resize image /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG nova.objects.instance [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'migration_context' on Instance uuid 0ee7de87-76ad-48ae-8bcd-93b2792a96cd {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG nova.network.neutron [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Successfully created port: 03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Ensure instance console log exists: /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.network.neutron [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Successfully updated port: 03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "refresh_cache-0ee7de87-76ad-48ae-8bcd-93b2792a96cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquired lock "refresh_cache-0ee7de87-76ad-48ae-8bcd-93b2792a96cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.network.neutron [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.compute.manager [req-d02af89f-930b-4146-b09a-e1d01ef90e51 req-ab71c35a-b0a7-4c42-972b-8507659086df service nova] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Received event network-changed-03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.compute.manager [req-d02af89f-930b-4146-b09a-e1d01ef90e51 req-ab71c35a-b0a7-4c42-972b-8507659086df service nova] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Refreshing instance network info cache due to event network-changed-03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d02af89f-930b-4146-b09a-e1d01ef90e51 req-ab71c35a-b0a7-4c42-972b-8507659086df service nova] Acquiring lock "refresh_cache-0ee7de87-76ad-48ae-8bcd-93b2792a96cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.network.neutron [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.network.neutron [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Updating instance_info_cache with network_info: [{"id": "03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7", "address": "fa:16:3e:05:76:cf", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b9fe2a-e4", "ovs_interfaceid": "03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Releasing lock "refresh_cache-0ee7de87-76ad-48ae-8bcd-93b2792a96cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.compute.manager [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Instance network_info: |[{"id": "03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7", "address": "fa:16:3e:05:76:cf", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b9fe2a-e4", "ovs_interfaceid": "03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d02af89f-930b-4146-b09a-e1d01ef90e51 req-ab71c35a-b0a7-4c42-972b-8507659086df service nova] Acquired lock "refresh_cache-0ee7de87-76ad-48ae-8bcd-93b2792a96cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.network.neutron [req-d02af89f-930b-4146-b09a-e1d01ef90e51 req-ab71c35a-b0a7-4c42-972b-8507659086df service nova] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Refreshing network info cache for port 03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Start _get_guest_xml network_info=[{"id": "03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7", "address": "fa:16:3e:05:76:cf", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b9fe2a-e4", "ovs_interfaceid": "03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:13:53 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:13:53 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:13:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:13:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1906080092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1906080092',id=25,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ab4e1cccd434f6c83f2f9e4687d274e',ramdisk_id='',reservation_id='r-0ck2f0wd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:13:51Z,user_data=None,user_id='bad952eceaec400396fd0a28c438c761',uuid=0ee7de87-76ad-48ae-8bcd-93b2792a96cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7", "address": "fa:16:3e:05:76:cf", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b9fe2a-e4", "ovs_interfaceid": "03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converting VIF {"id": "03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7", "address": "fa:16:3e:05:76:cf", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b9fe2a-e4", "ovs_interfaceid": "03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:76:cf,bridge_name='br-int',has_traffic_filtering=True,id=03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03b9fe2a-e4') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.objects.instance [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ee7de87-76ad-48ae-8bcd-93b2792a96cd {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126834.0459697, 4cc14820-2d7d-4779-8d90-b77462f1bfa8 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:13:54 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] VM Resumed (Lifecycle Event)
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.compute.manager [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:13:54 user nova-compute[73188]:   <uuid>0ee7de87-76ad-48ae-8bcd-93b2792a96cd</uuid>
Aug 15 19:13:54 user nova-compute[73188]:   <name>instance-00000019</name>
Aug 15 19:13:54 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:13:54 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:13:54 user nova-compute[73188]:   <metadata>
Aug 15 19:13:54 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:13:54 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:13:54 user nova-compute[73188]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1906080092</nova:name>
Aug 15 19:13:54 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:13:53</nova:creationTime>
Aug 15 19:13:54 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:13:54 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:13:54 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:13:54 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:13:54 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:13:54 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:13:54 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:13:54 user nova-compute[73188]:       <nova:owner>
Aug 15 19:13:54 user nova-compute[73188]:         <nova:user uuid="bad952eceaec400396fd0a28c438c761">tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member</nova:user>
Aug 15 19:13:54 user nova-compute[73188]:         <nova:project uuid="0ab4e1cccd434f6c83f2f9e4687d274e">tempest-ServerBootFromVolumeStableRescueTest-1886926549</nova:project>
Aug 15 19:13:54 user nova-compute[73188]:       </nova:owner>
Aug 15 19:13:54 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:13:54 user nova-compute[73188]:       <nova:ports>
Aug 15 19:13:54 user nova-compute[73188]:         <nova:port uuid="03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7">
Aug 15 19:13:54 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 19:13:54 user nova-compute[73188]:         </nova:port>
Aug 15 19:13:54 user nova-compute[73188]:       </nova:ports>
Aug 15 19:13:54 user nova-compute[73188]:     </nova:instance>
Aug 15 19:13:54 user nova-compute[73188]:   </metadata>
Aug 15 19:13:54 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:13:54 user nova-compute[73188]:     <system>
Aug 15 19:13:54 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:13:54 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:13:54 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:13:54 user nova-compute[73188]:       <entry name="serial">0ee7de87-76ad-48ae-8bcd-93b2792a96cd</entry>
Aug 15 19:13:54 user nova-compute[73188]:       <entry name="uuid">0ee7de87-76ad-48ae-8bcd-93b2792a96cd</entry>
Aug 15 19:13:54 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:13:54 user nova-compute[73188]:     </system>
Aug 15 19:13:54 user nova-compute[73188]:   </sysinfo>
Aug 15 19:13:54 user nova-compute[73188]:   <os>
Aug 15 19:13:54 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:13:54 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:13:54 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:13:54 user nova-compute[73188]:   </os>
Aug 15 19:13:54 user nova-compute[73188]:   <features>
Aug 15 19:13:54 user nova-compute[73188]:     <acpi/>
Aug 15 19:13:54 user nova-compute[73188]:     <apic/>
Aug 15 19:13:54 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:13:54 user nova-compute[73188]:   </features>
Aug 15 19:13:54 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:13:54 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:13:54 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:13:54 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:13:54 user nova-compute[73188]:   </clock>
Aug 15 19:13:54 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:13:54 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:13:54 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:13:54 user nova-compute[73188]:   </cpu>
Aug 15 19:13:54 user nova-compute[73188]:   <devices>
Aug 15 19:13:54 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:13:54 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:13:54 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk"/>
Aug 15 19:13:54 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:13:54 user nova-compute[73188]:     </disk>
Aug 15 19:13:54 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:13:54 user nova-compute[73188]:       <mac address="fa:16:3e:05:76:cf"/>
Aug 15 19:13:54 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:13:54 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:13:54 user nova-compute[73188]:       <target dev="tap03b9fe2a-e4"/>
Aug 15 19:13:54 user nova-compute[73188]:     </interface>
Aug 15 19:13:54 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:13:54 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/console.log" append="off"/>
Aug 15 19:13:54 user nova-compute[73188]:     </serial>
Aug 15 19:13:54 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:13:54 user nova-compute[73188]:     <video>
Aug 15 19:13:54 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:13:54 user nova-compute[73188]:     </video>
Aug 15 19:13:54 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:13:54 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:13:54 user nova-compute[73188]:     </rng>
Aug 15 19:13:54 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:13:54 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:13:54 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:13:54 user nova-compute[73188]:     </memballoon>
Aug 15 19:13:54 user nova-compute[73188]:   </devices>
Aug 15 19:13:54 user nova-compute[73188]: </domain>
Aug 15 19:13:54 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:13:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1906080092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1906080092',id=25,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ab4e1cccd434f6c83f2f9e4687d274e',ramdisk_id='',reservation_id='r-0ck2f0wd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:13:51Z,user_data=None,user_id='bad952eceaec400396fd0a28c438c761',uuid=0ee7de87-76ad-48ae-8bcd-93b2792a96cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7", "address": "fa:16:3e:05:76:cf", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b9fe2a-e4", "ovs_interfaceid": "03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converting VIF {"id": "03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7", "address": "fa:16:3e:05:76:cf", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b9fe2a-e4", "ovs_interfaceid": "03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:76:cf,bridge_name='br-int',has_traffic_filtering=True,id=03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03b9fe2a-e4') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG os_vif [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:76:cf,bridge_name='br-int',has_traffic_filtering=True,id=03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03b9fe2a-e4') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03b9fe2a-e4, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap03b9fe2a-e4, col_values=(('external_ids', {'iface-id': '03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:76:cf', 'vm-uuid': '0ee7de87-76ad-48ae-8bcd-93b2792a96cd'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:54 user nova-compute[73188]: INFO os_vif [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:76:cf,bridge_name='br-int',has_traffic_filtering=True,id=03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03b9fe2a-e4')
Aug 15 19:13:54 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Instance spawned successfully.
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:13:54 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126834.056341, 4cc14820-2d7d-4779-8d90-b77462f1bfa8 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:13:54 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] VM Started (Lifecycle Event)
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.compute.manager [req-2645805e-7b26-412e-8fa2-2072851e2fad req-4c62f845-af41-444f-bf0e-b1c50c046902 service nova] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Received event network-vif-plugged-bacf9b02-1d5c-4db2-bf85-aeaefdaa6690 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2645805e-7b26-412e-8fa2-2072851e2fad req-4c62f845-af41-444f-bf0e-b1c50c046902 service nova] Acquiring lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2645805e-7b26-412e-8fa2-2072851e2fad req-4c62f845-af41-444f-bf0e-b1c50c046902 service nova] Lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2645805e-7b26-412e-8fa2-2072851e2fad req-4c62f845-af41-444f-bf0e-b1c50c046902 service nova] Lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.compute.manager [req-2645805e-7b26-412e-8fa2-2072851e2fad req-4c62f845-af41-444f-bf0e-b1c50c046902 service nova] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] No waiting events found dispatching network-vif-plugged-bacf9b02-1d5c-4db2-bf85-aeaefdaa6690 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:13:54 user nova-compute[73188]: WARNING nova.compute.manager [req-2645805e-7b26-412e-8fa2-2072851e2fad req-4c62f845-af41-444f-bf0e-b1c50c046902 service nova] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Received unexpected event network-vif-plugged-bacf9b02-1d5c-4db2-bf85-aeaefdaa6690 for instance with vm_state building and task_state spawning.
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:13:54 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] No VIF found with MAC fa:16:3e:05:76:cf, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:13:54 user nova-compute[73188]: INFO nova.compute.manager [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Took 7.07 seconds to spawn the instance on the hypervisor.
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.compute.manager [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:13:54 user nova-compute[73188]: INFO nova.compute.manager [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Took 8.19 seconds to build instance.
Aug 15 19:13:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-547c58ca-e2f7-4b1a-873e-afdc10608653 tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.347s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.network.neutron [req-d02af89f-930b-4146-b09a-e1d01ef90e51 req-ab71c35a-b0a7-4c42-972b-8507659086df service nova] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Updated VIF entry in instance network info cache for port 03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG nova.network.neutron [req-d02af89f-930b-4146-b09a-e1d01ef90e51 req-ab71c35a-b0a7-4c42-972b-8507659086df service nova] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Updating instance_info_cache with network_info: [{"id": "03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7", "address": "fa:16:3e:05:76:cf", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b9fe2a-e4", "ovs_interfaceid": "03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:13:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d02af89f-930b-4146-b09a-e1d01ef90e51 req-ab71c35a-b0a7-4c42-972b-8507659086df service nova] Releasing lock "refresh_cache-0ee7de87-76ad-48ae-8bcd-93b2792a96cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:13:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:13:56 user nova-compute[73188]: DEBUG nova.compute.manager [req-23ae106f-9130-48f0-b7c2-c6194c148a3c req-8576782c-c2f2-4366-b548-48e264ee58c0 service nova] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Received event network-vif-plugged-03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:13:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-23ae106f-9130-48f0-b7c2-c6194c148a3c req-8576782c-c2f2-4366-b548-48e264ee58c0 service nova] Acquiring lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-23ae106f-9130-48f0-b7c2-c6194c148a3c req-8576782c-c2f2-4366-b548-48e264ee58c0 service nova] Lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-23ae106f-9130-48f0-b7c2-c6194c148a3c req-8576782c-c2f2-4366-b548-48e264ee58c0 service nova] Lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:56 user nova-compute[73188]: DEBUG nova.compute.manager [req-23ae106f-9130-48f0-b7c2-c6194c148a3c req-8576782c-c2f2-4366-b548-48e264ee58c0 service nova] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] No waiting events found dispatching network-vif-plugged-03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:13:56 user nova-compute[73188]: WARNING nova.compute.manager [req-23ae106f-9130-48f0-b7c2-c6194c148a3c req-8576782c-c2f2-4366-b548-48e264ee58c0 service nova] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Received unexpected event network-vif-plugged-03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7 for instance with vm_state building and task_state spawning.
Aug 15 19:13:58 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126838.1727052, 0ee7de87-76ad-48ae-8bcd-93b2792a96cd => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:13:58 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] VM Resumed (Lifecycle Event)
Aug 15 19:13:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:13:58 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Instance spawned successfully.
Aug 15 19:13:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquiring lock "de6929cd-c95d-4964-b81c-96872a137f90" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "de6929cd-c95d-4964-b81c-96872a137f90" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:13:58 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:13:58 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126838.1764665, 0ee7de87-76ad-48ae-8bcd-93b2792a96cd => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:13:58 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] VM Started (Lifecycle Event)
Aug 15 19:13:58 user nova-compute[73188]: DEBUG nova.objects.instance [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lazy-loading 'flavor' on Instance uuid de6929cd-c95d-4964-b81c-96872a137f90 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:13:58 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "de6929cd-c95d-4964-b81c-96872a137f90" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-6ce9c4de-7765-4a7c-af81-eb922270da01 req-3570241c-9af3-49cb-ac26-2bb898a334e8 service nova] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Received event network-vif-plugged-03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6ce9c4de-7765-4a7c-af81-eb922270da01 req-3570241c-9af3-49cb-ac26-2bb898a334e8 service nova] Acquiring lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6ce9c4de-7765-4a7c-af81-eb922270da01 req-3570241c-9af3-49cb-ac26-2bb898a334e8 service nova] Lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6ce9c4de-7765-4a7c-af81-eb922270da01 req-3570241c-9af3-49cb-ac26-2bb898a334e8 service nova] Lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-6ce9c4de-7765-4a7c-af81-eb922270da01 req-3570241c-9af3-49cb-ac26-2bb898a334e8 service nova] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] No waiting events found dispatching network-vif-plugged-03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:13:58 user nova-compute[73188]: WARNING nova.compute.manager [req-6ce9c4de-7765-4a7c-af81-eb922270da01 req-3570241c-9af3-49cb-ac26-2bb898a334e8 service nova] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Received unexpected event network-vif-plugged-03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7 for instance with vm_state building and task_state spawning.
Aug 15 19:13:58 user nova-compute[73188]: INFO nova.compute.manager [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Took 6.82 seconds to spawn the instance on the hypervisor.
Aug 15 19:13:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:13:58 user nova-compute[73188]: INFO nova.compute.manager [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Took 7.88 seconds to build instance.
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-057e09a6-6646-4764-887b-cc2ed979f438 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.006s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquiring lock "de6929cd-c95d-4964-b81c-96872a137f90" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "de6929cd-c95d-4964-b81c-96872a137f90" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:13:58 user nova-compute[73188]: INFO nova.compute.manager [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Attaching volume a79f2e74-d8ef-433b-914a-1f0714b0e6a5 to /dev/vdb
Aug 15 19:13:58 user nova-compute[73188]: DEBUG os_brick.utils [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccb8766-bcc4-407f-8177-fd2091e84ab7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7c9648-1d70-4ab4-b855-a06d27354b0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9bcec5-6503-4c93-a0ff-fdf28134e504]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bbb294-151e-4100-9edd-4a3a247419e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:13:58 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:13:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[744556ad-c9e8-4145-a65d-985abaf7ced8]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG os_brick.utils [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:13:58 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Updating existing volume attachment record: 9ed859d0-079b-473a-adea-95c2fde9c514 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:13:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:05 user nova-compute[73188]: INFO nova.compute.manager [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Terminating instance
Aug 15 19:14:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:14:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:05 user nova-compute[73188]: DEBUG nova.compute.manager [req-04f61b9e-a7d8-4810-99e7-f04dde4cc830 req-49423c65-7d0d-4017-9078-20f001acb470 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received event network-vif-unplugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:14:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-04f61b9e-a7d8-4810-99e7-f04dde4cc830 req-49423c65-7d0d-4017-9078-20f001acb470 service nova] Acquiring lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-04f61b9e-a7d8-4810-99e7-f04dde4cc830 req-49423c65-7d0d-4017-9078-20f001acb470 service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-04f61b9e-a7d8-4810-99e7-f04dde4cc830 req-49423c65-7d0d-4017-9078-20f001acb470 service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:05 user nova-compute[73188]: DEBUG nova.compute.manager [req-04f61b9e-a7d8-4810-99e7-f04dde4cc830 req-49423c65-7d0d-4017-9078-20f001acb470 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] No waiting events found dispatching network-vif-unplugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:14:05 user nova-compute[73188]: DEBUG nova.compute.manager [req-04f61b9e-a7d8-4810-99e7-f04dde4cc830 req-49423c65-7d0d-4017-9078-20f001acb470 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received event network-vif-unplugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:14:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:06 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Instance destroyed successfully.
Aug 15 19:14:06 user nova-compute[73188]: DEBUG nova.objects.instance [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lazy-loading 'resources' on Instance uuid d1b5f5bf-9672-40a8-83da-3a8f25007e91 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2075783787',display_name='tempest-ServerActionsTestOtherB-server-2075783787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2075783787',id=2,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGAn2WMlt73NTUykPIA6PkYCDLbBTR2Yho5Rj2kET8coL/tBEtc4GHmcnA5ijjJ1l2hsUy4+ooa5E/SUoQZ5kfWNtXI5i4fVvpa+4mLZw6dteSEtg5YyfVDHt6PHs7vAQ==',key_name='tempest-keypair-93276017',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:11:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='418458ca9ca647788ef8dd45ced52707',ramdisk_id='',reservation_id='r-36kpwfhi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1641219687',owner_user_name='tempest-ServerActionsTestOtherB-1641219687-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:11:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60be9c6b4c1b4f4b9038a3a6af7c3648',uuid=d1b5f5bf-9672-40a8-83da-3a8f25007e91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Converting VIF {"id": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "address": "fa:16:3e:10:5e:42", "network": {"id": "10d6e7cc-813b-43e5-850a-cbdd4bd41525", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1438605342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418458ca9ca647788ef8dd45ced52707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5133aa6-a8", "ovs_interfaceid": "d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:5e:42,bridge_name='br-int',has_traffic_filtering=True,id=d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a,network=Network(10d6e7cc-813b-43e5-850a-cbdd4bd41525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5133aa6-a8') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG os_vif [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:5e:42,bridge_name='br-int',has_traffic_filtering=True,id=d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a,network=Network(10d6e7cc-813b-43e5-850a-cbdd4bd41525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5133aa6-a8') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5133aa6-a8, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:14:06 user nova-compute[73188]: INFO os_vif [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:5e:42,bridge_name='br-int',has_traffic_filtering=True,id=d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a,network=Network(10d6e7cc-813b-43e5-850a-cbdd4bd41525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5133aa6-a8')
Aug 15 19:14:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUBLTriK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:14:06 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:14:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77b62f6-27c8-423c-8703-3ce32254c2db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2596d00f-8954-4e32-99a3-85bdc2097690]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:14:06 user nova-compute[73188]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)
Aug 15 19:14:06 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:14:06 user nova-compute[73188]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 (non-flash)
Aug 15 19:14:06 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f280866a830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65'): ({'sdc'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Removing single pathed devices sdc {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecab4fc7-da8f-4ba4-8eab-80b4a055144a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dc9543-fd76-4b28-9ecf-605c91073f1e]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Flushing IO for device /dev/sdc {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b74a16-c2a2-4506-a75d-d42dbc927736]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfd85d0-0341-4353-8d8f-d6558a59043b]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] SCSI volumes sdc have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[09224aed-d989-4244-b90e-99401b526c9f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd95ec63-5ad3-4067-9fa7-a3b930113a7b]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260]
Aug 15 19:14:06 user nova-compute[73188]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65, portal: 172.16.0.220,3260] successful.
Aug 15 19:14:06 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a56bdc00-9527-4777-a55c-7791842e4c65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbb7953-0a61-4d83-b1b6-b6a9cdd36139]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] <== disconnect_volume: return (329ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:14:06 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Deleting instance files /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91_del
Aug 15 19:14:06 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Deletion of /opt/stack/data/nova/instances/d1b5f5bf-9672-40a8-83da-3a8f25007e91_del complete
Aug 15 19:14:06 user nova-compute[73188]: INFO nova.compute.manager [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Took 1.48 seconds to destroy the instance on the hypervisor.
Aug 15 19:14:06 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:14:06 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:14:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-bfddfe6a-c776-4668-8d2b-62ae144938b8 req-81f8d712-6050-4e7f-b691-69c38e811367 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received event network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:14:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-bfddfe6a-c776-4668-8d2b-62ae144938b8 req-81f8d712-6050-4e7f-b691-69c38e811367 service nova] Acquiring lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-bfddfe6a-c776-4668-8d2b-62ae144938b8 req-81f8d712-6050-4e7f-b691-69c38e811367 service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-bfddfe6a-c776-4668-8d2b-62ae144938b8 req-81f8d712-6050-4e7f-b691-69c38e811367 service nova] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-bfddfe6a-c776-4668-8d2b-62ae144938b8 req-81f8d712-6050-4e7f-b691-69c38e811367 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] No waiting events found dispatching network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:14:07 user nova-compute[73188]: WARNING nova.compute.manager [req-bfddfe6a-c776-4668-8d2b-62ae144938b8 req-81f8d712-6050-4e7f-b691-69c38e811367 service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received unexpected event network-vif-plugged-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a for instance with vm_state active and task_state deleting.
Aug 15 19:14:07 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:14:07 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Took 1.08 seconds to deallocate network for instance.
Aug 15 19:14:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-73744786-5be5-4136-a76f-f48c435a7f1d req-3497dbbc-262f-45fe-8977-ecb9c7c40c8b service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Received event network-vif-deleted-d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:14:07 user nova-compute[73188]: INFO nova.compute.manager [req-73744786-5be5-4136-a76f-f48c435a7f1d req-3497dbbc-262f-45fe-8977-ecb9c7c40c8b service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Neutron deleted interface d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a; detaching it from the instance and deleting it from the info cache
Aug 15 19:14:07 user nova-compute[73188]: DEBUG nova.network.neutron [req-73744786-5be5-4136-a76f-f48c435a7f1d req-3497dbbc-262f-45fe-8977-ecb9c7c40c8b service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:14:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-73744786-5be5-4136-a76f-f48c435a7f1d req-3497dbbc-262f-45fe-8977-ecb9c7c40c8b service nova] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Detach interface failed, port_id=d5133aa6-a81a-409e-9f7d-7ab7ed5ceb1a, reason: Instance d1b5f5bf-9672-40a8-83da-3a8f25007e91 could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:14:08 user nova-compute[73188]: INFO nova.compute.manager [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Took 0.86 seconds to detach 1 volumes for instance.
Aug 15 19:14:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGkZntzH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:14:09 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:14:09 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:14:09 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[424af9ee-0f52-40e2-b96f-a6fcbdff8fca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:14:09 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[642e9201-dab9-4bef-a8c9-d29effb49c0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5] added
Aug 15 19:14:09 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.597s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9e7452-fc6e-4ad9-9cd9-40fbee6318e8]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6aea9b0-d0a1-4a6a-887e-54d1563cfb9a]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LGkZntzH {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:09 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Deleted allocations for instance d1b5f5bf-9672-40a8-83da-3a8f25007e91
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LGkZntzH" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3809b4-1024-4dbf-bd45-865170f138e3]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LGkZntzH'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fd09c6-dff1-4ca7-b4b5-5663956bb2a9]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e6c2f3-6caa-436c-979a-df56db96b9e0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:14:09 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:14:09 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b0eccfd6-de2d-4b12-ab1f-9d04f1518aa4 tempest-ServerActionsTestOtherB-1641219687 tempest-ServerActionsTestOtherB-1641219687-project-member] Lock "d1b5f5bf-9672-40a8-83da-3a8f25007e91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.341s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.128s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5431d018-ff25-426e-a2bc-d0a28d7af845]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5, portal: 172.16.0.220,3260]
Aug 15 19:14:09 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5, portal: 172.16.0.220,3260] successful.
Aug 15 19:14:09 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a175cff8-0158-4bc2-919b-acba3547f2f6]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[91eaf396-b0b8-41a3-8d7c-5449b5854366]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:14:09 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:14:09 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:14:09 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:14:09 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.036s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29eadce-8829-45a0-8bc5-30657e8a7d47]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:14:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGkZntzH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:14:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.481s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:14:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] <== connect_volume: return (1486ms) {'type': 'block', 'scsi_wwn': '23932323363333133', 'path': '/dev/sdc'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:14:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932323363333133', 'path': '/dev/sdc'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:14:10 user nova-compute[73188]: DEBUG nova.objects.instance [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lazy-loading 'flavor' on Instance uuid de6929cd-c95d-4964-b81c-96872a137f90 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:14:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:14:10 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:14:10 user nova-compute[73188]:   <source dev="/dev/sdc"/>
Aug 15 19:14:10 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:14:10 user nova-compute[73188]:   <serial>a79f2e74-d8ef-433b-914a-1f0714b0e6a5</serial>
Aug 15 19:14:10 user nova-compute[73188]: </disk>
Aug 15 19:14:10 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:14:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:11 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:14:11 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:14:11 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] No VIF found with MAC fa:16:3e:06:3e:cd, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:14:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ed37e3fc-2276-463e-aaf5-9f0832a84271 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "de6929cd-c95d-4964-b81c-96872a137f90" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.162s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:12 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:14:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:13 user nova-compute[73188]: INFO nova.compute.manager [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Rescuing
Aug 15 19:14:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquiring lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:14:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquired lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:14:13 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:14:13 user nova-compute[73188]: DEBUG nova.network.neutron [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Updating instance_info_cache with network_info: [{"id": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "address": "fa:16:3e:06:3e:cd", "network": {"id": "72ad2e88-4c2b-4cba-bfa5-801725bc0041", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824390140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b47c13ca2b84149926b814a26148366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf07c7de0-82", "ovs_interfaceid": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:14:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Releasing lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:14:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:14 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Instance destroyed successfully.
Aug 15 19:14:14 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Attempting a stable device rescue
Aug 15 19:14:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73188) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 19:14:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Instance directory exists: not creating {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 19:14:14 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Creating image(s)
Aug 15 19:14:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquiring lock "/opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "/opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "/opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:14 user nova-compute[73188]: DEBUG nova.objects.instance [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lazy-loading 'trusted_certs' on Instance uuid de6929cd-c95d-4964-b81c-96872a137f90 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:14:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquiring lock "fb4d2dfa8ae5a6d58488705f5f5605aa11359ed6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "fb4d2dfa8ae5a6d58488705f5f5605aa11359ed6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:14 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:14:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:14:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb4d2dfa8ae5a6d58488705f5f5605aa11359ed6.part --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb4d2dfa8ae5a6d58488705f5f5605aa11359ed6.part --force-share --output=json" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:15 user nova-compute[73188]: DEBUG nova.virt.images [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] d80640a5-2fbb-4b7c-8586-3f11a88d74be was qcow2, converting to raw {{(pid=73188) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 19:14:15 user nova-compute[73188]: DEBUG nova.privsep.utils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73188) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 19:14:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fb4d2dfa8ae5a6d58488705f5f5605aa11359ed6.part /opt/stack/data/nova/instances/_base/fb4d2dfa8ae5a6d58488705f5f5605aa11359ed6.converted {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-3d713d03-3e60-4dec-a295-a4652ac21842" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:14:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-3d713d03-3e60-4dec-a295-a4652ac21842" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:14:15 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:14:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fb4d2dfa8ae5a6d58488705f5f5605aa11359ed6.part /opt/stack/data/nova/instances/_base/fb4d2dfa8ae5a6d58488705f5f5605aa11359ed6.converted" returned: 0 in 0.168s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb4d2dfa8ae5a6d58488705f5f5605aa11359ed6.converted --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb4d2dfa8ae5a6d58488705f5f5605aa11359ed6.converted --force-share --output=json" returned: 0 in 0.205s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "fb4d2dfa8ae5a6d58488705f5f5605aa11359ed6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.399s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquiring lock "fb4d2dfa8ae5a6d58488705f5f5605aa11359ed6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "fb4d2dfa8ae5a6d58488705f5f5605aa11359ed6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb4d2dfa8ae5a6d58488705f5f5605aa11359ed6 --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb4d2dfa8ae5a6d58488705f5f5605aa11359ed6 --force-share --output=json" returned: 0 in 0.175s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb4d2dfa8ae5a6d58488705f5f5605aa11359ed6,backing_fmt=raw /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk.rescue {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Updating instance_info_cache with network_info: [{"id": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "address": "fa:16:3e:b4:8c:fd", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8c4e95-fc", "ovs_interfaceid": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb4d2dfa8ae5a6d58488705f5f5605aa11359ed6,backing_fmt=raw /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk.rescue" returned: 0 in 0.062s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "fb4d2dfa8ae5a6d58488705f5f5605aa11359ed6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.objects.instance [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lazy-loading 'migration_context' on Instance uuid de6929cd-c95d-4964-b81c-96872a137f90 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Start _get_guest_xml network_info=[{"id": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "address": "fa:16:3e:06:3e:cd", "network": {"id": "72ad2e88-4c2b-4cba-bfa5-801725bc0041", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824390140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1824390140-network", "vif_mac": "fa:16:3e:06:3e:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b47c13ca2b84149926b814a26148366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf07c7de0-82", "ovs_interfaceid": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd80640a5-2fbb-4b7c-8586-3f11a88d74be', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGkZntzH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'de6929cd-c95d-4964-b81c-96872a137f90', 'attached_at': '', 'detached_at': '', 'volume_id': 'a79f2e74-d8ef-433b-914a-1f0714b0e6a5', 'serial': 'a79f2e74-d8ef-433b-914a-1f0714b0e6a5'}, 'attachment_id': '9ed859d0-079b-473a-adea-95c2fde9c514', 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.objects.instance [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lazy-loading 'resources' on Instance uuid de6929cd-c95d-4964-b81c-96872a137f90 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-3d713d03-3e60-4dec-a295-a4652ac21842" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.objects.instance [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lazy-loading 'numa_topology' on Instance uuid de6929cd-c95d-4964-b81c-96872a137f90 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:14:16 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:14:16 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.objects.instance [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lazy-loading 'vcpu_model' on Instance uuid de6929cd-c95d-4964-b81c-96872a137f90 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGkZntzH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:14:16 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:14:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:14:16 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:14:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:14:16 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b4d8c2-fa7c-4c25-aa02-ff5c7ed3d771]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = LGkZntzH\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 19:14:16 user nova-compute[73188]: node.name = iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5
Aug 15 19:14:16 user nova-compute[73188]: node.tpgt = -1
Aug 15 19:14:16 user nova-compute[73188]: node.startup = automatic
Aug 15 19:14:16 user nova-compute[73188]: node.leading_login = No
Aug 15 19:14:16 user nova-compute[73188]: iface.iscsi_ifacename = default
Aug 15 19:14:16 user nova-compute[73188]: iface.net_ifacename = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.ipaddress = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.prefix_len = 0
Aug 15 19:14:16 user nova-compute[73188]: iface.hwaddress = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.transport_name = tcp
Aug 15 19:14:16 user nova-compute[73188]: iface.initiatorname = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.state = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.vlan_id = 0
Aug 15 19:14:16 user nova-compute[73188]: iface.vlan_priority = 0
Aug 15 19:14:16 user nova-compute[73188]: iface.vlan_state = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.iface_num = 0
Aug 15 19:14:16 user nova-compute[73188]: iface.mtu = 0
Aug 15 19:14:16 user nova-compute[73188]: iface.port = 0
Aug 15 19:14:16 user nova-compute[73188]: iface.bootproto = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.subnet_mask = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.gateway = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.dhcp_alt_client_id = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.dhcp_dns = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.dhcp_learn_iqn = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.dhcp_vendor_id_state = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.dhcp_vendor_id = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.dhcp_slp_da = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.fragmentation = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.gratuitous_arp = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.incoming_forwarding = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.tos_state = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.tos = 0
Aug 15 19:14:16 user nova-compute[73188]: iface.ttl = 0
Aug 15 19:14:16 user nova-compute[73188]: iface.delayed_ack = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.tcp_nagle = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.tcp_wsf_state = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.tcp_wsf = 0
Aug 15 19:14:16 user nova-compute[73188]: iface.tcp_timer_scale = 0
Aug 15 19:14:16 user nova-compute[73188]: iface.tcp_timestamp = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.redirect = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.def_task_mgmt_timeout = 0
Aug 15 19:14:16 user nova-compute[73188]: iface.header_digest = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.data_digest = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.immediate_data = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.initial_r2t = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.data_seq_inorder = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.data_pdu_inorder = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.erl = 0
Aug 15 19:14:16 user nova-compute[73188]: iface.max_receive_data_len = 0
Aug 15 19:14:16 user nova-compute[73188]: iface.first_burst_len = 0
Aug 15 19:14:16 user nova-compute[73188]: iface.max_outstanding_r2t = 0
Aug 15 19:14:16 user nova-compute[73188]: iface.max_burst_len = 0
Aug 15 19:14:16 user nova-compute[73188]: iface.chap_auth = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.bidi_chap = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.strict_login_compliance = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.discovery_auth = <empty>
Aug 15 19:14:16 user nova-compute[73188]: iface.discovery_logout = <empty>
Aug 15 19:14:16 user nova-compute[73188]: node.discovery_address = <empty>
Aug 15 19:14:16 user nova-compute[73188]: node.discovery_port = 0
Aug 15 19:14:16 user nova-compute[73188]: node.discovery_type = static
Aug 15 19:14:16 user nova-compute[73188]: node.session.initial_cmdsn = 0
Aug 15 19:14:16 user nova-compute[73188]: node.session.initial_login_retry_max = 8
Aug 15 19:14:16 user nova-compute[73188]: node.session.xmit_thread_priority = -20
Aug 15 19:14:16 user nova-compute[73188]: node.session.cmds_max = 128
Aug 15 19:14:16 user nova-compute[73188]: node.session.queue_depth = 32
Aug 15 19:14:16 user nova-compute[73188]: node.session.nr_sessions = 1
Aug 15 19:14:16 user nova-compute[73188]: node.session.auth.authmethod = CHAP
Aug 15 19:14:16 user nova-compute[73188]: node.session.auth.username = LGkZntzH
Aug 15 19:14:16 user nova-compute[73188]: node.session.auth.password = ***
Aug 15 19:14:16 user nova-compute[73188]: node.session.auth.username_in = <empty>
Aug 15 19:14:16 user nova-compute[73188]: node.session.auth.password_in = <empty>
Aug 15 19:14:16 user nova-compute[73188]: node.session.auth.chap_algs = MD5
Aug 15 19:14:16 user nova-compute[73188]: node.session.timeo.replacement_timeout = 120
Aug 15 19:14:16 user nova-compute[73188]: node.session.err_timeo.abort_timeout = 15
Aug 15 19:14:16 user nova-compute[73188]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 19:14:16 user nova-compute[73188]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 19:14:16 user nova-compute[73188]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 19:14:16 user nova-compute[73188]: node.session.iscsi.FastAbort = Yes
Aug 15 19:14:16 user nova-compute[73188]: node.session.iscsi.InitialR2T = No
Aug 15 19:14:16 user nova-compute[73188]: node.session.iscsi.ImmediateData = Yes
Aug 15 19:14:16 user nova-compute[73188]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 19:14:16 user nova-compute[73188]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 19:14:16 user nova-compute[73188]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 19:14:16 user nova-compute[73188]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 19:14:16 user nova-compute[73188]: node.session.iscsi.MaxConnections = 1
Aug 15 19:14:16 user nova-compute[73188]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 19:14:16 user nova-compute[73188]: node.session.iscsi.ERL = 0
Aug 15 19:14:16 user nova-compute[73188]: node.session.scan = manual
Aug 15 19:14:16 user nova-compute[73188]: node.session.reopen_max = 0
Aug 15 19:14:16 user nova-compute[73188]: node.conn[0].address = 172.16.0.220
Aug 15 19:14:16 user nova-compute[73188]: node.conn[0].port = 3260
Aug 15 19:14:16 user nova-compute[73188]: node.conn[0].startup = manual
Aug 15 19:14:16 user nova-compute[73188]: node.conn[0].tcp.window_size = 524288
Aug 15 19:14:16 user nova-compute[73188]: node.conn[0].tcp.type_of_service = 0
Aug 15 19:14:16 user nova-compute[73188]: node.conn[0].timeo.logout_timeout = 15
Aug 15 19:14:16 user nova-compute[73188]: node.conn[0].timeo.login_timeout = 15
Aug 15 19:14:16 user nova-compute[73188]: node.conn[0].timeo.auth_timeout = 45
Aug 15 19:14:16 user nova-compute[73188]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 19:14:16 user nova-compute[73188]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 19:14:16 user nova-compute[73188]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 19:14:16 user nova-compute[73188]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 19:14:16 user nova-compute[73188]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 19:14:16 user nova-compute[73188]: node.conn[0].iscsi.DataDigest = None
Aug 15 19:14:16 user nova-compute[73188]: node.conn[0].iscsi.IFMarker = No
Aug 15 19:14:16 user nova-compute[73188]: node.conn[0].iscsi.OFMarker = No
Aug 15 19:14:16 user nova-compute[73188]: # END RECORD
Aug 15 19:14:16 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb85777f-5d55-45e1-9c00-30d435ca6615]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d2d868-69c4-4671-92ec-655b78e66bd6]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LGkZntzH {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LGkZntzH" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e41b969-ac65-4856-8212-698b5808965c]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LGkZntzH'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daa3308-1392-40bd-bfa9-28098b1a8b9a]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a5f292-c1b9-4dc9-8f4c-8794d3962a49]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:14:16 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:14:16 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:14:16 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:14:16 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.172s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] HCTL ('34', '0', '0', 0) found on session 21 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3103c595-e082-476e-898b-6e383e1d9996]: (4, ('0 0 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Searching for a device in session 21 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGkZntzH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.230s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] <== connect_volume: return (231ms) {'type': 'block', 'scsi_wwn': '23932323363333133', 'path': '/dev/sdc'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932323363333133', 'path': '/dev/sdc'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:10:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1685172374',display_name='tempest-ServerStableDeviceRescueTest-server-1685172374',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1685172374',id=17,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZV2ZZ1PcyzXMuO4AObOOzlp+MD17bBbGreeYVcVHD8T7QwHW/JFWvZsik8+8K9lMujg7+2eVXXA7EFfclfRtmg+u/m1UQSUhNeDCmDVQ3LSOmEpIIFi4mYV6zZe1VY4Q==',key_name='tempest-keypair-313035603',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:10:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b47c13ca2b84149926b814a26148366',ramdisk_id='',reservation_id='r-06ruxa0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1845666905',owner_user_name='tempest-ServerStableDeviceRescueTest-1845666905-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:12:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47716a2e151a44c0a09e8bc538a8316f',uuid=de6929cd-c95d-4964-b81c-96872a137f90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "address": "fa:16:3e:06:3e:cd", "network": {"id": "72ad2e88-4c2b-4cba-bfa5-801725bc0041", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824390140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1824390140-network", "vif_mac": "fa:16:3e:06:3e:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b47c13ca2b84149926b814a26148366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf07c7de0-82", "ovs_interfaceid": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Converting VIF {"id": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "address": "fa:16:3e:06:3e:cd", "network": {"id": "72ad2e88-4c2b-4cba-bfa5-801725bc0041", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824390140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1824390140-network", "vif_mac": "fa:16:3e:06:3e:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b47c13ca2b84149926b814a26148366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf07c7de0-82", "ovs_interfaceid": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:3e:cd,bridge_name='br-int',has_traffic_filtering=True,id=f07c7de0-8264-42c8-aa30-1a8c7405379a,network=Network(72ad2e88-4c2b-4cba-bfa5-801725bc0041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf07c7de0-82') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.objects.instance [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lazy-loading 'pci_devices' on Instance uuid de6929cd-c95d-4964-b81c-96872a137f90 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:14:16 user nova-compute[73188]:   <uuid>de6929cd-c95d-4964-b81c-96872a137f90</uuid>
Aug 15 19:14:16 user nova-compute[73188]:   <name>instance-00000011</name>
Aug 15 19:14:16 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:14:16 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:14:16 user nova-compute[73188]:   <metadata>
Aug 15 19:14:16 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:14:16 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:14:16 user nova-compute[73188]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1685172374</nova:name>
Aug 15 19:14:16 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:14:16</nova:creationTime>
Aug 15 19:14:16 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:14:16 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:14:16 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:14:16 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:14:16 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:14:16 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:14:16 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:14:16 user nova-compute[73188]:       <nova:owner>
Aug 15 19:14:16 user nova-compute[73188]:         <nova:user uuid="47716a2e151a44c0a09e8bc538a8316f">tempest-ServerStableDeviceRescueTest-1845666905-project-member</nova:user>
Aug 15 19:14:16 user nova-compute[73188]:         <nova:project uuid="3b47c13ca2b84149926b814a26148366">tempest-ServerStableDeviceRescueTest-1845666905</nova:project>
Aug 15 19:14:16 user nova-compute[73188]:       </nova:owner>
Aug 15 19:14:16 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:14:16 user nova-compute[73188]:       <nova:ports>
Aug 15 19:14:16 user nova-compute[73188]:         <nova:port uuid="f07c7de0-8264-42c8-aa30-1a8c7405379a">
Aug 15 19:14:16 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 19:14:16 user nova-compute[73188]:         </nova:port>
Aug 15 19:14:16 user nova-compute[73188]:       </nova:ports>
Aug 15 19:14:16 user nova-compute[73188]:     </nova:instance>
Aug 15 19:14:16 user nova-compute[73188]:   </metadata>
Aug 15 19:14:16 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:14:16 user nova-compute[73188]:     <system>
Aug 15 19:14:16 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:14:16 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:14:16 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:14:16 user nova-compute[73188]:       <entry name="serial">de6929cd-c95d-4964-b81c-96872a137f90</entry>
Aug 15 19:14:16 user nova-compute[73188]:       <entry name="uuid">de6929cd-c95d-4964-b81c-96872a137f90</entry>
Aug 15 19:14:16 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:14:16 user nova-compute[73188]:     </system>
Aug 15 19:14:16 user nova-compute[73188]:   </sysinfo>
Aug 15 19:14:16 user nova-compute[73188]:   <os>
Aug 15 19:14:16 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:14:16 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:14:16 user nova-compute[73188]:   </os>
Aug 15 19:14:16 user nova-compute[73188]:   <features>
Aug 15 19:14:16 user nova-compute[73188]:     <acpi/>
Aug 15 19:14:16 user nova-compute[73188]:     <apic/>
Aug 15 19:14:16 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:14:16 user nova-compute[73188]:   </features>
Aug 15 19:14:16 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:14:16 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:14:16 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:14:16 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:14:16 user nova-compute[73188]:   </clock>
Aug 15 19:14:16 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:14:16 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:14:16 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:14:16 user nova-compute[73188]:   </cpu>
Aug 15 19:14:16 user nova-compute[73188]:   <devices>
Aug 15 19:14:16 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:14:16 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:14:16 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk"/>
Aug 15 19:14:16 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:14:16 user nova-compute[73188]:     </disk>
Aug 15 19:14:16 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:14:16 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:14:16 user nova-compute[73188]:       <source dev="/dev/sdc"/>
Aug 15 19:14:16 user nova-compute[73188]:       <target dev="vdb" bus="virtio"/>
Aug 15 19:14:16 user nova-compute[73188]:       <serial>a79f2e74-d8ef-433b-914a-1f0714b0e6a5</serial>
Aug 15 19:14:16 user nova-compute[73188]:     </disk>
Aug 15 19:14:16 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:14:16 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:14:16 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk.rescue"/>
Aug 15 19:14:16 user nova-compute[73188]:       <target dev="vdc" bus="virtio"/>
Aug 15 19:14:16 user nova-compute[73188]:       <boot order="1"/>
Aug 15 19:14:16 user nova-compute[73188]:     </disk>
Aug 15 19:14:16 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:14:16 user nova-compute[73188]:       <mac address="fa:16:3e:06:3e:cd"/>
Aug 15 19:14:16 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:14:16 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:14:16 user nova-compute[73188]:       <target dev="tapf07c7de0-82"/>
Aug 15 19:14:16 user nova-compute[73188]:     </interface>
Aug 15 19:14:16 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:14:16 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/console.log" append="off"/>
Aug 15 19:14:16 user nova-compute[73188]:     </serial>
Aug 15 19:14:16 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:14:16 user nova-compute[73188]:     <video>
Aug 15 19:14:16 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:14:16 user nova-compute[73188]:     </video>
Aug 15 19:14:16 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:14:16 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:14:16 user nova-compute[73188]:     </rng>
Aug 15 19:14:16 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:14:16 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:14:16 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:14:16 user nova-compute[73188]:     </memballoon>
Aug 15 19:14:16 user nova-compute[73188]:   </devices>
Aug 15 19:14:16 user nova-compute[73188]: </domain>
Aug 15 19:14:16 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:14:16 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Instance destroyed successfully.
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] No VIF found with MAC fa:16:3e:06:3e:cd, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:18 user nova-compute[73188]: DEBUG nova.compute.manager [req-7529e529-70ca-41e6-acf5-c91a39ffa996 req-25810f07-c95c-4b4b-9ebe-b09cb1bfaa6d service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received event network-vif-unplugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:14:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7529e529-70ca-41e6-acf5-c91a39ffa996 req-25810f07-c95c-4b4b-9ebe-b09cb1bfaa6d service nova] Acquiring lock "de6929cd-c95d-4964-b81c-96872a137f90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7529e529-70ca-41e6-acf5-c91a39ffa996 req-25810f07-c95c-4b4b-9ebe-b09cb1bfaa6d service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7529e529-70ca-41e6-acf5-c91a39ffa996 req-25810f07-c95c-4b4b-9ebe-b09cb1bfaa6d service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:18 user nova-compute[73188]: DEBUG nova.compute.manager [req-7529e529-70ca-41e6-acf5-c91a39ffa996 req-25810f07-c95c-4b4b-9ebe-b09cb1bfaa6d service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] No waiting events found dispatching network-vif-unplugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:14:18 user nova-compute[73188]: WARNING nova.compute.manager [req-7529e529-70ca-41e6-acf5-c91a39ffa996 req-25810f07-c95c-4b4b-9ebe-b09cb1bfaa6d service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received unexpected event network-vif-unplugged-f07c7de0-8264-42c8-aa30-1a8c7405379a for instance with vm_state active and task_state rescuing.
Aug 15 19:14:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:14:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Acquiring lock "7caf434b-1484-4832-afee-0e2454bb5089" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "7caf434b-1484-4832-afee-0e2454bb5089" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Acquiring lock "7caf434b-1484-4832-afee-0e2454bb5089-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "7caf434b-1484-4832-afee-0e2454bb5089-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "7caf434b-1484-4832-afee-0e2454bb5089-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:19 user nova-compute[73188]: INFO nova.compute.manager [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Terminating instance
Aug 15 19:14:19 user nova-compute[73188]: DEBUG nova.compute.manager [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:19 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Instance destroyed successfully.
Aug 15 19:14:19 user nova-compute[73188]: DEBUG nova.objects.instance [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lazy-loading 'resources' on Instance uuid 7caf434b-1484-4832-afee-0e2454bb5089 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2019357191',display_name='tempest-ServersNegativeTestJSON-server-2019357191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2019357191',id=3,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:05:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f959aaaf0fe4406a723804e59eb47ae',ramdisk_id='',reservation_id='r-p7joaxs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1086586370',owner_user_name='tempest-ServersNegativeTestJSON-1086586370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:05:35Z,user_data=None,user_id='86c870adbae94c43808f8418d9c8aebd',uuid=7caf434b-1484-4832-afee-0e2454bb5089,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b93115d-3416-4846-9c43-a36a66f99e41", "address": "fa:16:3e:da:94:b4", "network": {"id": "8c59b78f-940b-409a-a485-2ee269ef8a5f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2048234860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f959aaaf0fe4406a723804e59eb47ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b93115d-34", "ovs_interfaceid": "8b93115d-3416-4846-9c43-a36a66f99e41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Converting VIF {"id": "8b93115d-3416-4846-9c43-a36a66f99e41", "address": "fa:16:3e:da:94:b4", "network": {"id": "8c59b78f-940b-409a-a485-2ee269ef8a5f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2048234860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f959aaaf0fe4406a723804e59eb47ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b93115d-34", "ovs_interfaceid": "8b93115d-3416-4846-9c43-a36a66f99e41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:94:b4,bridge_name='br-int',has_traffic_filtering=True,id=8b93115d-3416-4846-9c43-a36a66f99e41,network=Network(8c59b78f-940b-409a-a485-2ee269ef8a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b93115d-34') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG os_vif [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:94:b4,bridge_name='br-int',has_traffic_filtering=True,id=8b93115d-3416-4846-9c43-a36a66f99e41,network=Network(8c59b78f-940b-409a-a485-2ee269ef8a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b93115d-34') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b93115d-34, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:14:19 user nova-compute[73188]: INFO os_vif [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:94:b4,bridge_name='br-int',has_traffic_filtering=True,id=8b93115d-3416-4846-9c43-a36a66f99e41,network=Network(8c59b78f-940b-409a-a485-2ee269ef8a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b93115d-34')
Aug 15 19:14:19 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Deleting instance files /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089_del
Aug 15 19:14:19 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Deletion of /opt/stack/data/nova/instances/7caf434b-1484-4832-afee-0e2454bb5089_del complete
Aug 15 19:14:20 user nova-compute[73188]: INFO nova.compute.manager [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Removed pending event for de6929cd-c95d-4964-b81c-96872a137f90 due to event {{(pid=73188) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126860.3420906, de6929cd-c95d-4964-b81c-96872a137f90 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:14:20 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] VM Resumed (Lifecycle Event)
Aug 15 19:14:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8a645699-e5a4-44c9-bef3-e149bb47666c tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:20 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 19:14:20 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126860.3454957, de6929cd-c95d-4964-b81c-96872a137f90 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:14:20 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] VM Started (Lifecycle Event)
Aug 15 19:14:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG nova.compute.manager [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received event network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] Acquiring lock "de6929cd-c95d-4964-b81c-96872a137f90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG nova.compute.manager [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] No waiting events found dispatching network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:14:20 user nova-compute[73188]: WARNING nova.compute.manager [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received unexpected event network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a for instance with vm_state rescued and task_state None.
Aug 15 19:14:20 user nova-compute[73188]: DEBUG nova.compute.manager [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received event network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] Acquiring lock "de6929cd-c95d-4964-b81c-96872a137f90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG nova.compute.manager [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] No waiting events found dispatching network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:14:20 user nova-compute[73188]: WARNING nova.compute.manager [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received unexpected event network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a for instance with vm_state rescued and task_state None.
Aug 15 19:14:20 user nova-compute[73188]: DEBUG nova.compute.manager [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received event network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] Acquiring lock "de6929cd-c95d-4964-b81c-96872a137f90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG nova.compute.manager [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] No waiting events found dispatching network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:14:20 user nova-compute[73188]: WARNING nova.compute.manager [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received unexpected event network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a for instance with vm_state rescued and task_state None.
Aug 15 19:14:20 user nova-compute[73188]: DEBUG nova.compute.manager [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Received event network-vif-unplugged-8b93115d-3416-4846-9c43-a36a66f99e41 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] Acquiring lock "7caf434b-1484-4832-afee-0e2454bb5089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] Lock "7caf434b-1484-4832-afee-0e2454bb5089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] Lock "7caf434b-1484-4832-afee-0e2454bb5089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG nova.compute.manager [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] No waiting events found dispatching network-vif-unplugged-8b93115d-3416-4846-9c43-a36a66f99e41 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG nova.compute.manager [req-2f72391d-544d-4033-aa5e-91d1ed9f4842 req-a630ecf0-92e8-4266-a185-cad7efadac72 service nova] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Received event network-vif-unplugged-8b93115d-3416-4846-9c43-a36a66f99e41 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cc14820-2d7d-4779-8d90-b77462f1bfa8/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cc14820-2d7d-4779-8d90-b77462f1bfa8/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cc14820-2d7d-4779-8d90-b77462f1bfa8/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:21 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:14:21 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Took 1.06 seconds to deallocate network for instance.
Aug 15 19:14:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-b8746e1c-6312-4865-9988-32c337defb58 req-d1e18e28-63d6-4dea-86ce-cf66a73903a3 service nova] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Received event network-vif-deleted-8b93115d-3416-4846-9c43-a36a66f99e41 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:14:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cc14820-2d7d-4779-8d90-b77462f1bfa8/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:21 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692126846.3023689, d1b5f5bf-9672-40a8-83da-3a8f25007e91 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:14:21 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] VM Stopped (Lifecycle Event)
Aug 15 19:14:21 user nova-compute[73188]: DEBUG nova.compute.manager [None req-9e3fa7dd-9fdf-4ddf-a98b-1c937837af2e None None] [instance: d1b5f5bf-9672-40a8-83da-3a8f25007e91] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:14:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:21 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:14:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:21 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:14:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.562s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:22 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Deleted allocations for instance 7caf434b-1484-4832-afee-0e2454bb5089
Aug 15 19:14:22 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:14:22 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:14:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=7188MB free_disk=25.145912170410156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-df8ac090-01be-4d77-8137-5cbfa7eb90e5 tempest-ServersNegativeTestJSON-1086586370 tempest-ServersNegativeTestJSON-1086586370-project-member] Lock "7caf434b-1484-4832-afee-0e2454bb5089" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.484s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3d713d03-3e60-4dec-a295-a4652ac21842 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e00adf53-085f-436d-a09f-e97e92ca79cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance de6929cd-c95d-4964-b81c-96872a137f90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 139ccf1c-4792-4653-9475-c61b1f9c4846 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 215077af-60a1-4a82-b24e-1545349363d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 2a472af2-b10c-456b-8dba-6c75f3ab806a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 7f96acc3-0856-462e-9a32-879848f60a0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 4cc14820-2d7d-4779-8d90-b77462f1bfa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 0ee7de87-76ad-48ae-8bcd-93b2792a96cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-b2eccf10-c4a0-448f-80aa-26fa73ec90cc req-3233e7d5-9021-4466-81de-7f04843fedcd service nova] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Received event network-vif-plugged-8b93115d-3416-4846-9c43-a36a66f99e41 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b2eccf10-c4a0-448f-80aa-26fa73ec90cc req-3233e7d5-9021-4466-81de-7f04843fedcd service nova] Acquiring lock "7caf434b-1484-4832-afee-0e2454bb5089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b2eccf10-c4a0-448f-80aa-26fa73ec90cc req-3233e7d5-9021-4466-81de-7f04843fedcd service nova] Lock "7caf434b-1484-4832-afee-0e2454bb5089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b2eccf10-c4a0-448f-80aa-26fa73ec90cc req-3233e7d5-9021-4466-81de-7f04843fedcd service nova] Lock "7caf434b-1484-4832-afee-0e2454bb5089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-b2eccf10-c4a0-448f-80aa-26fa73ec90cc req-3233e7d5-9021-4466-81de-7f04843fedcd service nova] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] No waiting events found dispatching network-vif-plugged-8b93115d-3416-4846-9c43-a36a66f99e41 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:14:22 user nova-compute[73188]: WARNING nova.compute.manager [req-b2eccf10-c4a0-448f-80aa-26fa73ec90cc req-3233e7d5-9021-4466-81de-7f04843fedcd service nova] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Received unexpected event network-vif-plugged-8b93115d-3416-4846-9c43-a36a66f99e41 for instance with vm_state deleted and task_state None.
Aug 15 19:14:22 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:14:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:23 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:14:23 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:14:23 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:14:23 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:14:23 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:14:23 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:14:23 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:14:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:34 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692126859.8312178, 7caf434b-1484-4832-afee-0e2454bb5089 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:14:34 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] VM Stopped (Lifecycle Event)
Aug 15 19:14:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1e917257-1482-440f-bf0e-dff483667c4e None None] [instance: 7caf434b-1484-4832-afee-0e2454bb5089] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:14:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "ffccaa95-3c00-4635-989f-ac583171b072" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "ffccaa95-3c00-4635-989f-ac583171b072" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:14:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:38 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:14:38 user nova-compute[73188]: INFO nova.compute.claims [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Claim successful on node user
Aug 15 19:14:39 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:14:39 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:14:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:14:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:14:39 user nova-compute[73188]: DEBUG nova.network.neutron [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:14:39 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:14:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:14:39 user nova-compute[73188]: INFO nova.virt.block_device [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Booting with volume snapshot 05b46a48-ec46-43f6-b4f7-78cee8f7c750 at /dev/vda
Aug 15 19:14:39 user nova-compute[73188]: DEBUG nova.policy [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9503705066e5402cb569fae3b2bd8976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18eadba32f4547ad9436aca9285b7aad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:14:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:40 user nova-compute[73188]: DEBUG nova.network.neutron [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Successfully created port: 105f246b-e2cf-4741-a8b5-691615cce8e9 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:14:41 user nova-compute[73188]: DEBUG nova.network.neutron [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Successfully updated port: 105f246b-e2cf-4741-a8b5-691615cce8e9 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:14:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "refresh_cache-ffccaa95-3c00-4635-989f-ac583171b072" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:14:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquired lock "refresh_cache-ffccaa95-3c00-4635-989f-ac583171b072" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:14:41 user nova-compute[73188]: DEBUG nova.network.neutron [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:14:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-175b49b6-022e-4964-b4d9-c37d94295278 req-a39d7434-cc73-43f9-a259-eef308959659 service nova] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Received event network-changed-105f246b-e2cf-4741-a8b5-691615cce8e9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:14:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-175b49b6-022e-4964-b4d9-c37d94295278 req-a39d7434-cc73-43f9-a259-eef308959659 service nova] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Refreshing instance network info cache due to event network-changed-105f246b-e2cf-4741-a8b5-691615cce8e9. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:14:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-175b49b6-022e-4964-b4d9-c37d94295278 req-a39d7434-cc73-43f9-a259-eef308959659 service nova] Acquiring lock "refresh_cache-ffccaa95-3c00-4635-989f-ac583171b072" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:14:41 user nova-compute[73188]: DEBUG nova.network.neutron [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:14:41 user nova-compute[73188]: DEBUG nova.network.neutron [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Updating instance_info_cache with network_info: [{"id": "105f246b-e2cf-4741-a8b5-691615cce8e9", "address": "fa:16:3e:86:6c:6a", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap105f246b-e2", "ovs_interfaceid": "105f246b-e2cf-4741-a8b5-691615cce8e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:14:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Releasing lock "refresh_cache-ffccaa95-3c00-4635-989f-ac583171b072" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:14:41 user nova-compute[73188]: DEBUG nova.compute.manager [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Instance network_info: |[{"id": "105f246b-e2cf-4741-a8b5-691615cce8e9", "address": "fa:16:3e:86:6c:6a", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap105f246b-e2", "ovs_interfaceid": "105f246b-e2cf-4741-a8b5-691615cce8e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:14:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-175b49b6-022e-4964-b4d9-c37d94295278 req-a39d7434-cc73-43f9-a259-eef308959659 service nova] Acquired lock "refresh_cache-ffccaa95-3c00-4635-989f-ac583171b072" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:14:41 user nova-compute[73188]: DEBUG nova.network.neutron [req-175b49b6-022e-4964-b4d9-c37d94295278 req-a39d7434-cc73-43f9-a259-eef308959659 service nova] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Refreshing network info cache for port 105f246b-e2cf-4741-a8b5-691615cce8e9 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:14:42 user nova-compute[73188]: DEBUG nova.network.neutron [req-175b49b6-022e-4964-b4d9-c37d94295278 req-a39d7434-cc73-43f9-a259-eef308959659 service nova] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Updated VIF entry in instance network info cache for port 105f246b-e2cf-4741-a8b5-691615cce8e9. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:14:42 user nova-compute[73188]: DEBUG nova.network.neutron [req-175b49b6-022e-4964-b4d9-c37d94295278 req-a39d7434-cc73-43f9-a259-eef308959659 service nova] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Updating instance_info_cache with network_info: [{"id": "105f246b-e2cf-4741-a8b5-691615cce8e9", "address": "fa:16:3e:86:6c:6a", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap105f246b-e2", "ovs_interfaceid": "105f246b-e2cf-4741-a8b5-691615cce8e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:14:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-175b49b6-022e-4964-b4d9-c37d94295278 req-a39d7434-cc73-43f9-a259-eef308959659 service nova] Releasing lock "refresh_cache-ffccaa95-3c00-4635-989f-ac583171b072" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:14:44 user nova-compute[73188]: DEBUG os_brick.utils [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:14:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:44 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[48382f2f-602b-4d85-bd3e-89f51fbaea47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:44 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b1fa9e-ab72-4c84-9350-8ed62962b8d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:44 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc35e35-8051-47b7-b64f-cbff95cd5045]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:44 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[167d4afe-c195-404c-8b8e-25fdab4e7263]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:14:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:14:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:14:45 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:14:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5286507-f3ca-4675-8a40-f97879791208]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:14:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:14:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:14:45 user nova-compute[73188]: DEBUG os_brick.utils [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:14:45 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Updating existing volume attachment record: f367fa2f-0fb2-4c4f-be46-acd2cdfc36ec {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:14:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG nova.compute.manager [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:14:54 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Creating image(s)
Aug 15 19:14:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Did not create local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Ensure instance console log exists: /opt/stack/data/nova/instances/ffccaa95-3c00-4635-989f-ac583171b072/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Start _get_guest_xml network_info=[{"id": "105f246b-e2cf-4741-a8b5-691615cce8e9", "address": "fa:16:3e:86:6c:6a", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap105f246b-e2", "ovs_interfaceid": "105f246b-e2cf-4741-a8b5-691615cce8e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DyLmXtes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ffccaa95-3c00-4635-989f-ac583171b072', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab64cf4d-162b-48c4-9117-8add14d4247c', 'serial': 'ab64cf4d-162b-48c4-9117-8add14d4247c'}, 'attachment_id': 'f367fa2f-0fb2-4c4f-be46-acd2cdfc36ec', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:14:54 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:14:54 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:14:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DyLmXtes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:14:54 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:14:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:14:54 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:14:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:14:54 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d303f5ac-292b-45e3-bd2c-f82aa9469409]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:14:54 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[79861288-8643-4876-ad49-d246db43f2c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c] added
Aug 15 19:14:54 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba6dc2f-f80e-4c8d-b8d6-380bf5dedd9e]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7826cff3-9e43-4740-a880-1102df8b0326]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DyLmXtes {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DyLmXtes" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[730dac8e-2ebf-4779-978a-386aba24eb8b]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DyLmXtes'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a872a63-c635-4216-b634-ac5437429f6c]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4401fd10-4796-4307-a36d-e2045eb7ff1e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:14:54 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:14:54 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:14:54 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:14:54 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c4de00-880a-48c2-9707-58fe34cbdf16]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c, portal: 172.16.0.220,3260]
Aug 15 19:14:54 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c, portal: 172.16.0.220,3260] successful.
Aug 15 19:14:54 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbf7d02-d168-4237-861d-50aea25fe55f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a2893b-65d3-4b3d-a5d8-923d36c92d59]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:14:54 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:14:54 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:14:54 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:14:54 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:14:54 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:14:54 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[359f9326-28dd-45fa-b344-c47d2cf3889c]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: None {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:14:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DyLmXtes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26166623530396662', 'path': '/dev/sdd'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166623530396662', 'path': '/dev/sdd'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:14:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-155103971',display_name='tempest-TestVolumeBootPattern-server-155103971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-155103971',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18eadba32f4547ad9436aca9285b7aad',ramdisk_id='',reservation_id='r-1atdvk8s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2114363476',owner_user_name='tempest-TestVolumeBootPattern-2114363476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:14:39Z,user_data=None,user_id='9503705066e5402cb569fae3b2bd8976',uuid=ffccaa95-3c00-4635-989f-ac583171b072,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "105f246b-e2cf-4741-a8b5-691615cce8e9", "address": "fa:16:3e:86:6c:6a", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap105f246b-e2", "ovs_interfaceid": "105f246b-e2cf-4741-a8b5-691615cce8e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converting VIF {"id": "105f246b-e2cf-4741-a8b5-691615cce8e9", "address": "fa:16:3e:86:6c:6a", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap105f246b-e2", "ovs_interfaceid": "105f246b-e2cf-4741-a8b5-691615cce8e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:6c:6a,bridge_name='br-int',has_traffic_filtering=True,id=105f246b-e2cf-4741-a8b5-691615cce8e9,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap105f246b-e2') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG nova.objects.instance [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lazy-loading 'pci_devices' on Instance uuid ffccaa95-3c00-4635-989f-ac583171b072 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:14:55 user nova-compute[73188]:   <uuid>ffccaa95-3c00-4635-989f-ac583171b072</uuid>
Aug 15 19:14:55 user nova-compute[73188]:   <name>instance-0000001a</name>
Aug 15 19:14:55 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:14:55 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:14:55 user nova-compute[73188]:   <metadata>
Aug 15 19:14:55 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:14:55 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:14:55 user nova-compute[73188]:       <nova:name>tempest-TestVolumeBootPattern-server-155103971</nova:name>
Aug 15 19:14:55 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:14:54</nova:creationTime>
Aug 15 19:14:55 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:14:55 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:14:55 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:14:55 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:14:55 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:14:55 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:14:55 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:14:55 user nova-compute[73188]:       <nova:owner>
Aug 15 19:14:55 user nova-compute[73188]:         <nova:user uuid="9503705066e5402cb569fae3b2bd8976">tempest-TestVolumeBootPattern-2114363476-project-member</nova:user>
Aug 15 19:14:55 user nova-compute[73188]:         <nova:project uuid="18eadba32f4547ad9436aca9285b7aad">tempest-TestVolumeBootPattern-2114363476</nova:project>
Aug 15 19:14:55 user nova-compute[73188]:       </nova:owner>
Aug 15 19:14:55 user nova-compute[73188]:       <nova:ports>
Aug 15 19:14:55 user nova-compute[73188]:         <nova:port uuid="105f246b-e2cf-4741-a8b5-691615cce8e9">
Aug 15 19:14:55 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 19:14:55 user nova-compute[73188]:         </nova:port>
Aug 15 19:14:55 user nova-compute[73188]:       </nova:ports>
Aug 15 19:14:55 user nova-compute[73188]:     </nova:instance>
Aug 15 19:14:55 user nova-compute[73188]:   </metadata>
Aug 15 19:14:55 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:14:55 user nova-compute[73188]:     <system>
Aug 15 19:14:55 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:14:55 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:14:55 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:14:55 user nova-compute[73188]:       <entry name="serial">ffccaa95-3c00-4635-989f-ac583171b072</entry>
Aug 15 19:14:55 user nova-compute[73188]:       <entry name="uuid">ffccaa95-3c00-4635-989f-ac583171b072</entry>
Aug 15 19:14:55 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:14:55 user nova-compute[73188]:     </system>
Aug 15 19:14:55 user nova-compute[73188]:   </sysinfo>
Aug 15 19:14:55 user nova-compute[73188]:   <os>
Aug 15 19:14:55 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:14:55 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:14:55 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:14:55 user nova-compute[73188]:   </os>
Aug 15 19:14:55 user nova-compute[73188]:   <features>
Aug 15 19:14:55 user nova-compute[73188]:     <acpi/>
Aug 15 19:14:55 user nova-compute[73188]:     <apic/>
Aug 15 19:14:55 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:14:55 user nova-compute[73188]:   </features>
Aug 15 19:14:55 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:14:55 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:14:55 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:14:55 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:14:55 user nova-compute[73188]:   </clock>
Aug 15 19:14:55 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:14:55 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:14:55 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:14:55 user nova-compute[73188]:   </cpu>
Aug 15 19:14:55 user nova-compute[73188]:   <devices>
Aug 15 19:14:55 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:14:55 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:14:55 user nova-compute[73188]:       <source dev="/dev/sdd"/>
Aug 15 19:14:55 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:14:55 user nova-compute[73188]:       <serial>ab64cf4d-162b-48c4-9117-8add14d4247c</serial>
Aug 15 19:14:55 user nova-compute[73188]:     </disk>
Aug 15 19:14:55 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:14:55 user nova-compute[73188]:       <mac address="fa:16:3e:86:6c:6a"/>
Aug 15 19:14:55 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:14:55 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:14:55 user nova-compute[73188]:       <target dev="tap105f246b-e2"/>
Aug 15 19:14:55 user nova-compute[73188]:     </interface>
Aug 15 19:14:55 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:14:55 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/ffccaa95-3c00-4635-989f-ac583171b072/console.log" append="off"/>
Aug 15 19:14:55 user nova-compute[73188]:     </serial>
Aug 15 19:14:55 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:14:55 user nova-compute[73188]:     <video>
Aug 15 19:14:55 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:14:55 user nova-compute[73188]:     </video>
Aug 15 19:14:55 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:14:55 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:14:55 user nova-compute[73188]:     </rng>
Aug 15 19:14:55 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:14:55 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:14:55 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:14:55 user nova-compute[73188]:     </memballoon>
Aug 15 19:14:55 user nova-compute[73188]:   </devices>
Aug 15 19:14:55 user nova-compute[73188]: </domain>
Aug 15 19:14:55 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:14:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-155103971',display_name='tempest-TestVolumeBootPattern-server-155103971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-155103971',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18eadba32f4547ad9436aca9285b7aad',ramdisk_id='',reservation_id='r-1atdvk8s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2114363476',owner_user_name='tempest-TestVolumeBootPattern-2114363476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:14:39Z,user_data=None,user_id='9503705066e5402cb569fae3b2bd8976',uuid=ffccaa95-3c00-4635-989f-ac583171b072,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "105f246b-e2cf-4741-a8b5-691615cce8e9", "address": "fa:16:3e:86:6c:6a", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap105f246b-e2", "ovs_interfaceid": "105f246b-e2cf-4741-a8b5-691615cce8e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converting VIF {"id": "105f246b-e2cf-4741-a8b5-691615cce8e9", "address": "fa:16:3e:86:6c:6a", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap105f246b-e2", "ovs_interfaceid": "105f246b-e2cf-4741-a8b5-691615cce8e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:6c:6a,bridge_name='br-int',has_traffic_filtering=True,id=105f246b-e2cf-4741-a8b5-691615cce8e9,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap105f246b-e2') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG os_vif [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:6c:6a,bridge_name='br-int',has_traffic_filtering=True,id=105f246b-e2cf-4741-a8b5-691615cce8e9,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap105f246b-e2') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap105f246b-e2, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap105f246b-e2, col_values=(('external_ids', {'iface-id': '105f246b-e2cf-4741-a8b5-691615cce8e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:6c:6a', 'vm-uuid': 'ffccaa95-3c00-4635-989f-ac583171b072'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:55 user nova-compute[73188]: INFO os_vif [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:6c:6a,bridge_name='br-int',has_traffic_filtering=True,id=105f246b-e2cf-4741-a8b5-691615cce8e9,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap105f246b-e2')
Aug 15 19:14:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:14:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] No VIF found with MAC fa:16:3e:86:6c:6a, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:14:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:57 user nova-compute[73188]: DEBUG nova.compute.manager [req-a8e254ad-21b9-4672-ab9f-274cb8be5e27 req-b3627324-aa79-4f94-86a4-9db272a7da98 service nova] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Received event network-vif-plugged-105f246b-e2cf-4741-a8b5-691615cce8e9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:14:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a8e254ad-21b9-4672-ab9f-274cb8be5e27 req-b3627324-aa79-4f94-86a4-9db272a7da98 service nova] Acquiring lock "ffccaa95-3c00-4635-989f-ac583171b072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a8e254ad-21b9-4672-ab9f-274cb8be5e27 req-b3627324-aa79-4f94-86a4-9db272a7da98 service nova] Lock "ffccaa95-3c00-4635-989f-ac583171b072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a8e254ad-21b9-4672-ab9f-274cb8be5e27 req-b3627324-aa79-4f94-86a4-9db272a7da98 service nova] Lock "ffccaa95-3c00-4635-989f-ac583171b072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:57 user nova-compute[73188]: DEBUG nova.compute.manager [req-a8e254ad-21b9-4672-ab9f-274cb8be5e27 req-b3627324-aa79-4f94-86a4-9db272a7da98 service nova] [instance: ffccaa95-3c00-4635-989f-ac583171b072] No waiting events found dispatching network-vif-plugged-105f246b-e2cf-4741-a8b5-691615cce8e9 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:14:57 user nova-compute[73188]: WARNING nova.compute.manager [req-a8e254ad-21b9-4672-ab9f-274cb8be5e27 req-b3627324-aa79-4f94-86a4-9db272a7da98 service nova] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Received unexpected event network-vif-plugged-105f246b-e2cf-4741-a8b5-691615cce8e9 for instance with vm_state building and task_state spawning.
Aug 15 19:14:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:14:59 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126899.0713522, ffccaa95-3c00-4635-989f-ac583171b072 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:14:59 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ffccaa95-3c00-4635-989f-ac583171b072] VM Resumed (Lifecycle Event)
Aug 15 19:14:59 user nova-compute[73188]: DEBUG nova.compute.manager [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:14:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:14:59 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Instance spawned successfully.
Aug 15 19:14:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:14:59 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:14:59 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:14:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:14:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:14:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:14:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:14:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:14:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:14:59 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ffccaa95-3c00-4635-989f-ac583171b072] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:14:59 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126899.0731156, ffccaa95-3c00-4635-989f-ac583171b072 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:14:59 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ffccaa95-3c00-4635-989f-ac583171b072] VM Started (Lifecycle Event)
Aug 15 19:14:59 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:14:59 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:14:59 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ffccaa95-3c00-4635-989f-ac583171b072] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:14:59 user nova-compute[73188]: INFO nova.compute.manager [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Took 5.05 seconds to spawn the instance on the hypervisor.
Aug 15 19:14:59 user nova-compute[73188]: DEBUG nova.compute.manager [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:14:59 user nova-compute[73188]: DEBUG nova.compute.manager [req-92598447-cafd-4adf-9ca6-6ac59760c734 req-b30140dc-5d4d-44fa-adef-745cce62a456 service nova] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Received event network-vif-plugged-105f246b-e2cf-4741-a8b5-691615cce8e9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:14:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-92598447-cafd-4adf-9ca6-6ac59760c734 req-b30140dc-5d4d-44fa-adef-745cce62a456 service nova] Acquiring lock "ffccaa95-3c00-4635-989f-ac583171b072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:14:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-92598447-cafd-4adf-9ca6-6ac59760c734 req-b30140dc-5d4d-44fa-adef-745cce62a456 service nova] Lock "ffccaa95-3c00-4635-989f-ac583171b072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:14:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-92598447-cafd-4adf-9ca6-6ac59760c734 req-b30140dc-5d4d-44fa-adef-745cce62a456 service nova] Lock "ffccaa95-3c00-4635-989f-ac583171b072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:14:59 user nova-compute[73188]: DEBUG nova.compute.manager [req-92598447-cafd-4adf-9ca6-6ac59760c734 req-b30140dc-5d4d-44fa-adef-745cce62a456 service nova] [instance: ffccaa95-3c00-4635-989f-ac583171b072] No waiting events found dispatching network-vif-plugged-105f246b-e2cf-4741-a8b5-691615cce8e9 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:14:59 user nova-compute[73188]: WARNING nova.compute.manager [req-92598447-cafd-4adf-9ca6-6ac59760c734 req-b30140dc-5d4d-44fa-adef-745cce62a456 service nova] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Received unexpected event network-vif-plugged-105f246b-e2cf-4741-a8b5-691615cce8e9 for instance with vm_state building and task_state spawning.
Aug 15 19:14:59 user nova-compute[73188]: INFO nova.compute.manager [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Took 20.65 seconds to build instance.
Aug 15 19:14:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-80eac7e6-163d-453d-b5ee-d7cdd1693c15 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "ffccaa95-3c00-4635-989f-ac583171b072" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.760s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:03 user nova-compute[73188]: DEBUG nova.compute.manager [req-9ef30f71-ebd7-4569-b621-b2c5f2a82cb5 req-8b0327bd-78e0-4d07-81b9-b39ea7b7444b service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Received event network-changed-fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:15:03 user nova-compute[73188]: DEBUG nova.compute.manager [req-9ef30f71-ebd7-4569-b621-b2c5f2a82cb5 req-8b0327bd-78e0-4d07-81b9-b39ea7b7444b service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Refreshing instance network info cache due to event network-changed-fadc6652-e769-4a50-81a4-caefd1de83ff. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:15:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9ef30f71-ebd7-4569-b621-b2c5f2a82cb5 req-8b0327bd-78e0-4d07-81b9-b39ea7b7444b service nova] Acquiring lock "refresh_cache-2a472af2-b10c-456b-8dba-6c75f3ab806a" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:15:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9ef30f71-ebd7-4569-b621-b2c5f2a82cb5 req-8b0327bd-78e0-4d07-81b9-b39ea7b7444b service nova] Acquired lock "refresh_cache-2a472af2-b10c-456b-8dba-6c75f3ab806a" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:15:03 user nova-compute[73188]: DEBUG nova.network.neutron [req-9ef30f71-ebd7-4569-b621-b2c5f2a82cb5 req-8b0327bd-78e0-4d07-81b9-b39ea7b7444b service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Refreshing network info cache for port fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "2a472af2-b10c-456b-8dba-6c75f3ab806a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG nova.objects.instance [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'flavor' on Instance uuid 2a472af2-b10c-456b-8dba-6c75f3ab806a {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "2a472af2-b10c-456b-8dba-6c75f3ab806a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:04 user nova-compute[73188]: INFO nova.compute.manager [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Attaching volume e82c9517-1d64-441b-b7fe-d8ad4764c476 to /dev/vdb
Aug 15 19:15:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG os_brick.utils [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a9938b-32fb-4661-8459-4aae1141f4c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2e107c-8f71-4e27-9297-3e98eee9f486]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[64985e01-d653-480d-b26a-6bd790c236e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebc142f-5461-460d-b16c-0b6b23bc72a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:15:04 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:15:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c5687a-d157-4801-b4db-24e5b5dbe0f0]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG os_brick.utils [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Updating existing volume attachment record: 4b05204c-768b-49c3-acd6-fe3ce448dc8b {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG nova.network.neutron [req-9ef30f71-ebd7-4569-b621-b2c5f2a82cb5 req-8b0327bd-78e0-4d07-81b9-b39ea7b7444b service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Updated VIF entry in instance network info cache for port fadc6652-e769-4a50-81a4-caefd1de83ff. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG nova.network.neutron [req-9ef30f71-ebd7-4569-b621-b2c5f2a82cb5 req-8b0327bd-78e0-4d07-81b9-b39ea7b7444b service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Updating instance_info_cache with network_info: [{"id": "fadc6652-e769-4a50-81a4-caefd1de83ff", "address": "fa:16:3e:28:1c:a1", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc6652-e7", "ovs_interfaceid": "fadc6652-e769-4a50-81a4-caefd1de83ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:15:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9ef30f71-ebd7-4569-b621-b2c5f2a82cb5 req-8b0327bd-78e0-4d07-81b9-b39ea7b7444b service nova] Releasing lock "refresh_cache-2a472af2-b10c-456b-8dba-6c75f3ab806a" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:15:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:13 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:15:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:15 user nova-compute[73188]: INFO nova.compute.manager [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Rescuing
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "refresh_cache-139ccf1c-4792-4653-9475-c61b1f9c4846" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquired lock "refresh_cache-139ccf1c-4792-4653-9475-c61b1f9c4846" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG nova.network.neutron [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PljsIvzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:15:15 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:15:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:15:15 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:15:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:15:15 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9aa118c-4b6d-4558-8121-72f148077a12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:15:15 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c4e0e0-5e72-4485-b9fd-5c478134f94a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476] added
Aug 15 19:15:15 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f2fa67-8481-4c00-8b10-42b7a6346ba8]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[77695259-0740-4645-a479-aae248d2f3d4]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PljsIvzG {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PljsIvzG" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[36224802-819a-4740-9afd-708657cf20ab]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PljsIvzG'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7baba258-0993-4c5e-a11e-d9ce14f6314d]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a03ccdc-64c4-42de-ad11-b4a95f688e8e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:15:15 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:15:15 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:15:15 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:15:15 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:15:15 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:15:15 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ff1182-9273-41fd-8da0-36d7e178ac85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476, portal: 172.16.0.220,3260]
Aug 15 19:15:15 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476, portal: 172.16.0.220,3260] successful.
Aug 15 19:15:15 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ff6f5f-b015-4a22-af30-11e881575ada]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3033ea9a-9177-4f7f-91e5-c94dbf973ad9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:15:15 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:15:15 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:15:15 user nova-compute[73188]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:15:15 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:15:15 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:15:15 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:15:15 user nova-compute[73188]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:15:15 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[023237bc-c5f3-4c3d-8194-8021cdeeff41]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:15 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: None {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:15:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:16 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:15:16 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:15:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-e00adf53-085f-436d-a09f-e97e92ca79cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:15:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-e00adf53-085f-436d-a09f-e97e92ca79cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:15:16 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:15:16 user nova-compute[73188]: DEBUG nova.network.neutron [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Updating instance_info_cache with network_info: [{"id": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "address": "fa:16:3e:49:14:b8", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2485f75-d3", "ovs_interfaceid": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:15:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Releasing lock "refresh_cache-139ccf1c-4792-4653-9475-c61b1f9c4846" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:15:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:16 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:15:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PljsIvzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:15:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:15:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23766363762383061', 'path': '/dev/sde'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:15:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766363762383061', 'path': '/dev/sde'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:15:16 user nova-compute[73188]: DEBUG nova.objects.instance [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'flavor' on Instance uuid 2a472af2-b10c-456b-8dba-6c75f3ab806a {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:15:17 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:15:17 user nova-compute[73188]:   <source dev="/dev/sde"/>
Aug 15 19:15:17 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:15:17 user nova-compute[73188]:   <serial>e82c9517-1d64-441b-b7fe-d8ad4764c476</serial>
Aug 15 19:15:17 user nova-compute[73188]: </disk>
Aug 15 19:15:17 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-006bac83-6402-4aa6-b906-e18b80ebd015 req-9d3a07fb-676b-4342-b56f-01f677bd3863 service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received event network-vif-unplugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-006bac83-6402-4aa6-b906-e18b80ebd015 req-9d3a07fb-676b-4342-b56f-01f677bd3863 service nova] Acquiring lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-006bac83-6402-4aa6-b906-e18b80ebd015 req-9d3a07fb-676b-4342-b56f-01f677bd3863 service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-006bac83-6402-4aa6-b906-e18b80ebd015 req-9d3a07fb-676b-4342-b56f-01f677bd3863 service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-006bac83-6402-4aa6-b906-e18b80ebd015 req-9d3a07fb-676b-4342-b56f-01f677bd3863 service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] No waiting events found dispatching network-vif-unplugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:15:17 user nova-compute[73188]: WARNING nova.compute.manager [req-006bac83-6402-4aa6-b906-e18b80ebd015 req-9d3a07fb-676b-4342-b56f-01f677bd3863 service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received unexpected event network-vif-unplugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 for instance with vm_state active and task_state rescuing.
Aug 15 19:15:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Updating instance_info_cache with network_info: [{"id": "4646dbfd-e829-4653-9e76-e34901f8ad33", "address": "fa:16:3e:db:be:12", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4646dbfd-e8", "ovs_interfaceid": "4646dbfd-e829-4653-9e76-e34901f8ad33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-e00adf53-085f-436d-a09f-e97e92ca79cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] No VIF found with MAC fa:16:3e:28:1c:a1, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fad8759b-f7b1-45b9-98cc-39dc361166c0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.219s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:17 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Instance destroyed successfully.
Aug 15 19:15:17 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Attempting rescue
Aug 15 19:15:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73188) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Instance directory exists: not creating {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 19:15:17 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Creating image(s)
Aug 15 19:15:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "/opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "/opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "/opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG nova.objects.instance [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'trusted_certs' on Instance uuid 139ccf1c-4792-4653-9475-c61b1f9c4846 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.219s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk.rescue {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk.rescue" returned: 0 in 0.052s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.objects.instance [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'migration_context' on Instance uuid 139ccf1c-4792-4653-9475-c61b1f9c4846 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Start _get_guest_xml network_info=[{"id": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "address": "fa:16:3e:49:14:b8", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "vif_mac": "fa:16:3e:49:14:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2485f75-d3", "ovs_interfaceid": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.objects.instance [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'resources' on Instance uuid 139ccf1c-4792-4653-9475-c61b1f9c4846 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.objects.instance [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'numa_topology' on Instance uuid 139ccf1c-4792-4653-9475-c61b1f9c4846 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:15:18 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:15:18 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.objects.instance [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'vcpu_model' on Instance uuid 139ccf1c-4792-4653-9475-c61b1f9c4846 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-800852989',display_name='tempest-ServerRescueNegativeTestJSON-server-800852989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-800852989',id=18,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:10:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eeb950591a3349908b17b33c0ebca302',ramdisk_id='',reservation_id='r-p4zf3894',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-990996828',owner_user_name='tempest-ServerRescueNegativeTestJSON-990996828-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:10:37Z,user_data=None,user_id='88c0edd2a58744da9497d7c5164f22a2',uuid=139ccf1c-4792-4653-9475-c61b1f9c4846,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "address": "fa:16:3e:49:14:b8", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "vif_mac": "fa:16:3e:49:14:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2485f75-d3", "ovs_interfaceid": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converting VIF {"id": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "address": "fa:16:3e:49:14:b8", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "vif_mac": "fa:16:3e:49:14:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2485f75-d3", "ovs_interfaceid": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:14:b8,bridge_name='br-int',has_traffic_filtering=True,id=b2485f75-d3d0-4b58-9246-8e8f9fd60d49,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2485f75-d3') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.objects.instance [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'pci_devices' on Instance uuid 139ccf1c-4792-4653-9475-c61b1f9c4846 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:15:18 user nova-compute[73188]:   <uuid>139ccf1c-4792-4653-9475-c61b1f9c4846</uuid>
Aug 15 19:15:18 user nova-compute[73188]:   <name>instance-00000012</name>
Aug 15 19:15:18 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:15:18 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:15:18 user nova-compute[73188]:   <metadata>
Aug 15 19:15:18 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:15:18 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:15:18 user nova-compute[73188]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-800852989</nova:name>
Aug 15 19:15:18 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:15:18</nova:creationTime>
Aug 15 19:15:18 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:15:18 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:15:18 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:15:18 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:15:18 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:15:18 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:15:18 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:15:18 user nova-compute[73188]:       <nova:owner>
Aug 15 19:15:18 user nova-compute[73188]:         <nova:user uuid="88c0edd2a58744da9497d7c5164f22a2">tempest-ServerRescueNegativeTestJSON-990996828-project-member</nova:user>
Aug 15 19:15:18 user nova-compute[73188]:         <nova:project uuid="eeb950591a3349908b17b33c0ebca302">tempest-ServerRescueNegativeTestJSON-990996828</nova:project>
Aug 15 19:15:18 user nova-compute[73188]:       </nova:owner>
Aug 15 19:15:18 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:15:18 user nova-compute[73188]:       <nova:ports>
Aug 15 19:15:18 user nova-compute[73188]:         <nova:port uuid="b2485f75-d3d0-4b58-9246-8e8f9fd60d49">
Aug 15 19:15:18 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 19:15:18 user nova-compute[73188]:         </nova:port>
Aug 15 19:15:18 user nova-compute[73188]:       </nova:ports>
Aug 15 19:15:18 user nova-compute[73188]:     </nova:instance>
Aug 15 19:15:18 user nova-compute[73188]:   </metadata>
Aug 15 19:15:18 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:15:18 user nova-compute[73188]:     <system>
Aug 15 19:15:18 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:15:18 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:15:18 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:15:18 user nova-compute[73188]:       <entry name="serial">139ccf1c-4792-4653-9475-c61b1f9c4846</entry>
Aug 15 19:15:18 user nova-compute[73188]:       <entry name="uuid">139ccf1c-4792-4653-9475-c61b1f9c4846</entry>
Aug 15 19:15:18 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:15:18 user nova-compute[73188]:     </system>
Aug 15 19:15:18 user nova-compute[73188]:   </sysinfo>
Aug 15 19:15:18 user nova-compute[73188]:   <os>
Aug 15 19:15:18 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:15:18 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:15:18 user nova-compute[73188]:   </os>
Aug 15 19:15:18 user nova-compute[73188]:   <features>
Aug 15 19:15:18 user nova-compute[73188]:     <acpi/>
Aug 15 19:15:18 user nova-compute[73188]:     <apic/>
Aug 15 19:15:18 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:15:18 user nova-compute[73188]:   </features>
Aug 15 19:15:18 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:15:18 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:15:18 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:15:18 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:15:18 user nova-compute[73188]:   </clock>
Aug 15 19:15:18 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:15:18 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:15:18 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:15:18 user nova-compute[73188]:   </cpu>
Aug 15 19:15:18 user nova-compute[73188]:   <devices>
Aug 15 19:15:18 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:15:18 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:15:18 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk.rescue"/>
Aug 15 19:15:18 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:15:18 user nova-compute[73188]:     </disk>
Aug 15 19:15:18 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:15:18 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:15:18 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk"/>
Aug 15 19:15:18 user nova-compute[73188]:       <target dev="vdb" bus="virtio"/>
Aug 15 19:15:18 user nova-compute[73188]:     </disk>
Aug 15 19:15:18 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:15:18 user nova-compute[73188]:       <mac address="fa:16:3e:49:14:b8"/>
Aug 15 19:15:18 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:15:18 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:15:18 user nova-compute[73188]:       <target dev="tapb2485f75-d3"/>
Aug 15 19:15:18 user nova-compute[73188]:     </interface>
Aug 15 19:15:18 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:15:18 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/console.log" append="off"/>
Aug 15 19:15:18 user nova-compute[73188]:     </serial>
Aug 15 19:15:18 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:15:18 user nova-compute[73188]:     <video>
Aug 15 19:15:18 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:15:18 user nova-compute[73188]:     </video>
Aug 15 19:15:18 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:15:18 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:15:18 user nova-compute[73188]:     </rng>
Aug 15 19:15:18 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:15:18 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:15:18 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:15:18 user nova-compute[73188]:     </memballoon>
Aug 15 19:15:18 user nova-compute[73188]:   </devices>
Aug 15 19:15:18 user nova-compute[73188]: </domain>
Aug 15 19:15:18 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:15:18 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Instance destroyed successfully.
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] No VIF found with MAC fa:16:3e:49:14:b8, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:15:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG nova.compute.manager [req-d05f387c-0249-473a-9391-a949a9c1f18d req-6726fc8a-5aa0-4ba4-b374-8b8e4a082e9e service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received event network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d05f387c-0249-473a-9391-a949a9c1f18d req-6726fc8a-5aa0-4ba4-b374-8b8e4a082e9e service nova] Acquiring lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d05f387c-0249-473a-9391-a949a9c1f18d req-6726fc8a-5aa0-4ba4-b374-8b8e4a082e9e service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d05f387c-0249-473a-9391-a949a9c1f18d req-6726fc8a-5aa0-4ba4-b374-8b8e4a082e9e service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG nova.compute.manager [req-d05f387c-0249-473a-9391-a949a9c1f18d req-6726fc8a-5aa0-4ba4-b374-8b8e4a082e9e service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] No waiting events found dispatching network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:15:19 user nova-compute[73188]: WARNING nova.compute.manager [req-d05f387c-0249-473a-9391-a949a9c1f18d req-6726fc8a-5aa0-4ba4-b374-8b8e4a082e9e service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received unexpected event network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 for instance with vm_state active and task_state rescuing.
Aug 15 19:15:19 user nova-compute[73188]: INFO nova.compute.manager [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Rebuilding instance
Aug 15 19:15:19 user nova-compute[73188]: DEBUG nova.objects.instance [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2a472af2-b10c-456b-8dba-6c75f3ab806a {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG nova.compute.manager [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG nova.objects.instance [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'pci_requests' on Instance uuid 2a472af2-b10c-456b-8dba-6c75f3ab806a {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG nova.objects.instance [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a472af2-b10c-456b-8dba-6c75f3ab806a {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG nova.objects.instance [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'resources' on Instance uuid 2a472af2-b10c-456b-8dba-6c75f3ab806a {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG nova.objects.instance [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'migration_context' on Instance uuid 2a472af2-b10c-456b-8dba-6c75f3ab806a {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG nova.objects.instance [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73188) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG nova.compute.manager [req-3364a838-6a5a-45e2-b6c7-9ad1e75525ec req-789a8e0c-9e6f-40a8-b43c-def68db242f8 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Received event network-vif-unplugged-fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3364a838-6a5a-45e2-b6c7-9ad1e75525ec req-789a8e0c-9e6f-40a8-b43c-def68db242f8 service nova] Acquiring lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3364a838-6a5a-45e2-b6c7-9ad1e75525ec req-789a8e0c-9e6f-40a8-b43c-def68db242f8 service nova] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3364a838-6a5a-45e2-b6c7-9ad1e75525ec req-789a8e0c-9e6f-40a8-b43c-def68db242f8 service nova] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG nova.compute.manager [req-3364a838-6a5a-45e2-b6c7-9ad1e75525ec req-789a8e0c-9e6f-40a8-b43c-def68db242f8 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] No waiting events found dispatching network-vif-unplugged-fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:15:19 user nova-compute[73188]: WARNING nova.compute.manager [req-3364a838-6a5a-45e2-b6c7-9ad1e75525ec req-789a8e0c-9e6f-40a8-b43c-def68db242f8 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Received unexpected event network-vif-unplugged-fadc6652-e769-4a50-81a4-caefd1de83ff for instance with vm_state active and task_state rebuilding.
Aug 15 19:15:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:20 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Instance destroyed successfully.
Aug 15 19:15:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:20 user nova-compute[73188]: INFO nova.compute.manager [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Detaching volume e82c9517-1d64-441b-b7fe-d8ad4764c476
Aug 15 19:15:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:20 user nova-compute[73188]: INFO nova.virt.block_device [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Attempting to driver detach volume e82c9517-1d64-441b-b7fe-d8ad4764c476 from mountpoint /dev/vdb
Aug 15 19:15:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Attempting to detach device vdb from instance 2a472af2-b10c-456b-8dba-6c75f3ab806a from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:15:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:15:20 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:15:20 user nova-compute[73188]:   <source dev="/dev/sde"/>
Aug 15 19:15:20 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:15:20 user nova-compute[73188]:   <serial>e82c9517-1d64-441b-b7fe-d8ad4764c476</serial>
Aug 15 19:15:20 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:15:20 user nova-compute[73188]: </disk>
Aug 15 19:15:20 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:15:20 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Successfully detached device vdb from instance 2a472af2-b10c-456b-8dba-6c75f3ab806a from the persistent domain config.
Aug 15 19:15:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:15:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PljsIvzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:15:20 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 19:15:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:15:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:15:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:15:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:20 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22c2d77-73fa-40c6-bc85-33ed191bea73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:20 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdc07d2-57d0-4493-8d79-a2346e7cd263]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:15:20 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:15:20 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:15:20 user nova-compute[73188]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:15:20 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:15:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:15:20 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:15:20 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:15:20 user nova-compute[73188]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:15:20 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:15:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281018ce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476'): ({'sde'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:15:20 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Removing single pathed devices sde {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:15:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:20 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[795a0397-036a-473e-bd4e-7e3c596ffaba]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c4fa2a-6275-4292-a132-dc676632ef90]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Flushing IO for device /dev/sde {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk.rescue --force-share --output=json" returned: 0 in 0.271s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d91c3ed-7d5e-4584-8ed8-7be5ead03bce]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e22607d-97e2-40e3-ad96-22e908376b26]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] SCSI volumes sde have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d3c5d1-6e13-4f4a-8f94-8b2ec2dbee5d]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af0da1b-720b-43a2-abab-27b81bf20a3e]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476, portal: 172.16.0.220,3260]
Aug 15 19:15:21 user nova-compute[73188]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476, portal: 172.16.0.220,3260] successful.
Aug 15 19:15:21 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e28453-bd8a-4ac4-8d2f-c6411df8a75f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] <== disconnect_volume: return (409ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-79ff257f-17a2-49e8-b381-8c24bbb423bc req-479c11e6-7ab8-4a91-bb9e-d616cc2396eb service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received event network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-79ff257f-17a2-49e8-b381-8c24bbb423bc req-479c11e6-7ab8-4a91-bb9e-d616cc2396eb service nova] Acquiring lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-79ff257f-17a2-49e8-b381-8c24bbb423bc req-479c11e6-7ab8-4a91-bb9e-d616cc2396eb service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-79ff257f-17a2-49e8-b381-8c24bbb423bc req-479c11e6-7ab8-4a91-bb9e-d616cc2396eb service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-79ff257f-17a2-49e8-b381-8c24bbb423bc req-479c11e6-7ab8-4a91-bb9e-d616cc2396eb service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] No waiting events found dispatching network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:15:21 user nova-compute[73188]: WARNING nova.compute.manager [req-79ff257f-17a2-49e8-b381-8c24bbb423bc req-479c11e6-7ab8-4a91-bb9e-d616cc2396eb service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received unexpected event network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 for instance with vm_state active and task_state rescuing.
Aug 15 19:15:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-79ff257f-17a2-49e8-b381-8c24bbb423bc req-479c11e6-7ab8-4a91-bb9e-d616cc2396eb service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received event network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-79ff257f-17a2-49e8-b381-8c24bbb423bc req-479c11e6-7ab8-4a91-bb9e-d616cc2396eb service nova] Acquiring lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-79ff257f-17a2-49e8-b381-8c24bbb423bc req-479c11e6-7ab8-4a91-bb9e-d616cc2396eb service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-79ff257f-17a2-49e8-b381-8c24bbb423bc req-479c11e6-7ab8-4a91-bb9e-d616cc2396eb service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-79ff257f-17a2-49e8-b381-8c24bbb423bc req-479c11e6-7ab8-4a91-bb9e-d616cc2396eb service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] No waiting events found dispatching network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:15:21 user nova-compute[73188]: WARNING nova.compute.manager [req-79ff257f-17a2-49e8-b381-8c24bbb423bc req-479c11e6-7ab8-4a91-bb9e-d616cc2396eb service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received unexpected event network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 for instance with vm_state active and task_state rescuing.
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-72ddeb27-0127-410d-b7f4-633a287b390e req-8e1f20a6-bad7-42cb-ba2d-c9c63819d8bd service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Received event network-vif-plugged-fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-72ddeb27-0127-410d-b7f4-633a287b390e req-8e1f20a6-bad7-42cb-ba2d-c9c63819d8bd service nova] Acquiring lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-72ddeb27-0127-410d-b7f4-633a287b390e req-8e1f20a6-bad7-42cb-ba2d-c9c63819d8bd service nova] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-72ddeb27-0127-410d-b7f4-633a287b390e req-8e1f20a6-bad7-42cb-ba2d-c9c63819d8bd service nova] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-72ddeb27-0127-410d-b7f4-633a287b390e req-8e1f20a6-bad7-42cb-ba2d-c9c63819d8bd service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] No waiting events found dispatching network-vif-plugged-fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:15:21 user nova-compute[73188]: WARNING nova.compute.manager [req-72ddeb27-0127-410d-b7f4-633a287b390e req-8e1f20a6-bad7-42cb-ba2d-c9c63819d8bd service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Received unexpected event network-vif-plugged-fadc6652-e769-4a50-81a4-caefd1de83ff for instance with vm_state active and task_state rebuilding.
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:22 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Instance destroyed successfully.
Aug 15 19:15:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2127906751',display_name='tempest-ServerActionsTestOtherA-server-779595184',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2127906751',id=22,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT7pHtenQdl314usiZ2R/MplkqppVUszRcYtdF8PoT9iwdYNWnlBFP4lclfbI6J8I2Ewyw1annhgge1Ik0u6ps1bdNRiu2LQt8/JVAam6sa0kutoFjAwiPMLeb/O6NAfQ==',key_name='tempest-keypair-1165066426',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:13:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3c085a0ccf841e297d98037c07a7111',ramdisk_id='',reservation_id='r-x091yrli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2026424764',owner_user_name='tempest-ServerActionsTestOtherA-2026424764-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:15:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30de55a2834422c8f6df816899b881e',uuid=2a472af2-b10c-456b-8dba-6c75f3ab806a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fadc6652-e769-4a50-81a4-caefd1de83ff", "address": "fa:16:3e:28:1c:a1", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc6652-e7", "ovs_interfaceid": "fadc6652-e769-4a50-81a4-caefd1de83ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converting VIF {"id": "fadc6652-e769-4a50-81a4-caefd1de83ff", "address": "fa:16:3e:28:1c:a1", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc6652-e7", "ovs_interfaceid": "fadc6652-e769-4a50-81a4-caefd1de83ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:1c:a1,bridge_name='br-int',has_traffic_filtering=True,id=fadc6652-e769-4a50-81a4-caefd1de83ff,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc6652-e7') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG os_vif [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:1c:a1,bridge_name='br-int',has_traffic_filtering=True,id=fadc6652-e769-4a50-81a4-caefd1de83ff,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc6652-e7') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfadc6652-e7, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:15:22 user nova-compute[73188]: INFO os_vif [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:1c:a1,bridge_name='br-int',has_traffic_filtering=True,id=fadc6652-e769-4a50-81a4-caefd1de83ff,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc6652-e7')
Aug 15 19:15:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PljsIvzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:15:22 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 19:15:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[90638935-402e-4bc2-be23-acdebf3e14b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[841bc54f-8953-4bee-b84c-e95f5dc3f21a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Removed pending event for 139ccf1c-4792-4653-9475-c61b1f9c4846 due to event {{(pid=73188) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126922.4403226, 139ccf1c-4792-4653-9475-c61b1f9c4846 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:15:22 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] VM Resumed (Lifecycle Event)
Aug 15 19:15:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:15:22 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:15:22 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:15:22 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:15:22 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:15:22 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:15:22 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f280817a0e0>, {}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Disconnecting from: [] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.098s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] <== disconnect_volume: return (102ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:15:22 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Deleting instance files /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a_del
Aug 15 19:15:22 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Deletion of /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a_del complete
Aug 15 19:15:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-36bb56fd-7f6a-47be-9186-d96c3c55b976 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:15:22 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 19:15:22 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126922.4423726, 139ccf1c-4792-4653-9475-c61b1f9c4846 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:15:22 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] VM Started (Lifecycle Event)
Aug 15 19:15:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:22 user nova-compute[73188]: INFO nova.virt.block_device [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Booting with volume e82c9517-1d64-441b-b7fe-d8ad4764c476 at /dev/vdb
Aug 15 19:15:22 user nova-compute[73188]: DEBUG os_brick.utils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48374cf-7cf1-4e1c-97be-5ffaec02ef93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9cde98-b09f-45d3-a3f8-8aca2ff73b14]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8534a2-a975-4914-9794-dcb4caaddf4d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f46b8c4-2ce9-4b62-9097-83c4cc4c3b01]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:15:22 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:15:22 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15f24d4-ca0d-4d9a-9146-a8cbeac39c58]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG os_brick.utils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:15:22 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Updating existing volume attachment record: 31643f5b-2126-45a1-940e-787e7f6301f9 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:15:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:15:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:15:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:15:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:23 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Error from libvirt while getting description of instance-00000016: [Error Code 42] Domain not found: no domain with matching uuid '2a472af2-b10c-456b-8dba-6c75f3ab806a' (instance-00000016): libvirt.libvirtError: Domain not found: no domain with matching uuid '2a472af2-b10c-456b-8dba-6c75f3ab806a' (instance-00000016)
Aug 15 19:15:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cc14820-2d7d-4779-8d90-b77462f1bfa8/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cc14820-2d7d-4779-8d90-b77462f1bfa8/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cc14820-2d7d-4779-8d90-b77462f1bfa8/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cc14820-2d7d-4779-8d90-b77462f1bfa8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:25 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:15:25 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:15:25 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=7267MB free_disk=25.155536651611328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:15:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:25 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:15:25 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3d713d03-3e60-4dec-a295-a4652ac21842 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:15:25 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e00adf53-085f-436d-a09f-e97e92ca79cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:15:25 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance de6929cd-c95d-4964-b81c-96872a137f90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:15:25 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 139ccf1c-4792-4653-9475-c61b1f9c4846 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:15:25 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 215077af-60a1-4a82-b24e-1545349363d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:15:25 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 2a472af2-b10c-456b-8dba-6c75f3ab806a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:15:25 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 7f96acc3-0856-462e-9a32-879848f60a0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:15:25 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 4cc14820-2d7d-4779-8d90-b77462f1bfa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:15:25 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 0ee7de87-76ad-48ae-8bcd-93b2792a96cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:15:25 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ffccaa95-3c00-4635-989f-ac583171b072 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:15:25 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:15:25 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:15:26 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:15:26 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:15:26 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:15:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.688s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:26 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:15:26 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:15:26 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:15:26 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:15:26 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:15:26 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:15:26 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:15:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:15:33 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Creating image(s)
Aug 15 19:15:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "/opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "/opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.203s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk 1073741824" returned: 0 in 0.065s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.177s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Cannot resize image /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Ensure instance console log exists: /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Start _get_guest_xml network_info=[{"id": "fadc6652-e769-4a50-81a4-caefd1de83ff", "address": "fa:16:3e:28:1c:a1", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc6652-e7", "ovs_interfaceid": "fadc6652-e769-4a50-81a4-caefd1de83ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PljsIvzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2a472af2-b10c-456b-8dba-6c75f3ab806a', 'attached_at': '', 'detached_at': '', 'volume_id': 'e82c9517-1d64-441b-b7fe-d8ad4764c476', 'serial': 'e82c9517-1d64-441b-b7fe-d8ad4764c476'}, 'attachment_id': '31643f5b-2126-45a1-940e-787e7f6301f9', 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:15:34 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 19:15:34 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.objects.instance [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2a472af2-b10c-456b-8dba-6c75f3ab806a {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PljsIvzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:15:34 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:15:34 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:15:34 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda243fc-7629-483d-a65e-f493184e5d94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:15:34 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7e97f5-03bc-4b43-846f-1ecb4801b90f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476] added
Aug 15 19:15:34 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffe65d9-8167-42b6-8701-959b156710cc]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[68204af4-e260-42e5-ba82-bca3ac308d19]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PljsIvzG {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PljsIvzG" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[63764813-c0d9-46c0-8733-f5b34344b20a]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PljsIvzG'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69a31b9-377b-45fd-ad54-cf7ce36b44fb]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[502cc2d4-533d-4573-bc87-0af3a60fa164]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:15:34 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:15:34 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:15:34 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:15:34 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:15:34 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:15:34 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[566ad7fe-3b10-47b5-83dd-4dd766e72a8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476, portal: 172.16.0.220,3260]
Aug 15 19:15:34 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476, portal: 172.16.0.220,3260] successful.
Aug 15 19:15:34 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b05ced5-66ab-4bd4-a234-07b09820c4a7]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[35949bef-4322-4a6d-85ea-a462b57c2fe0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:15:34 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:15:34 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:15:34 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:15:34 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:15:34 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:15:34 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:15:34 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:15:34 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3d1d1e-f57d-4b2e-af2b-840b563c07ba]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:15:34 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PljsIvzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692126920.4977283, 2a472af2-b10c-456b-8dba-6c75f3ab806a => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:15:35 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] VM Stopped (Lifecycle Event)
Aug 15 19:15:35 user nova-compute[73188]: DEBUG nova.compute.manager [None req-9dcd2192-fb07-4f81-91eb-eaa91bb26a68 None None] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23766363762383061', 'path': '/dev/sde'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766363762383061', 'path': '/dev/sde'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T19:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2127906751',display_name='tempest-ServerActionsTestOtherA-server-779595184',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2127906751',id=22,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT7pHtenQdl314usiZ2R/MplkqppVUszRcYtdF8PoT9iwdYNWnlBFP4lclfbI6J8I2Ewyw1annhgge1Ik0u6ps1bdNRiu2LQt8/JVAam6sa0kutoFjAwiPMLeb/O6NAfQ==',key_name='tempest-keypair-1165066426',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:13:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3c085a0ccf841e297d98037c07a7111',ramdisk_id='',reservation_id='r-x091yrli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2026424764',owner_user_name='tempest-ServerActionsTestOtherA-2026424764-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:15:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30de55a2834422c8f6df816899b881e',uuid=2a472af2-b10c-456b-8dba-6c75f3ab806a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fadc6652-e769-4a50-81a4-caefd1de83ff", "address": "fa:16:3e:28:1c:a1", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc6652-e7", "ovs_interfaceid": "fadc6652-e769-4a50-81a4-caefd1de83ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converting VIF {"id": "fadc6652-e769-4a50-81a4-caefd1de83ff", "address": "fa:16:3e:28:1c:a1", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc6652-e7", "ovs_interfaceid": "fadc6652-e769-4a50-81a4-caefd1de83ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:1c:a1,bridge_name='br-int',has_traffic_filtering=True,id=fadc6652-e769-4a50-81a4-caefd1de83ff,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc6652-e7') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:15:35 user nova-compute[73188]:   <uuid>2a472af2-b10c-456b-8dba-6c75f3ab806a</uuid>
Aug 15 19:15:35 user nova-compute[73188]:   <name>instance-00000016</name>
Aug 15 19:15:35 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:15:35 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:15:35 user nova-compute[73188]:   <metadata>
Aug 15 19:15:35 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:15:35 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:15:35 user nova-compute[73188]:       <nova:name>tempest-ServerActionsTestOtherA-server-779595184</nova:name>
Aug 15 19:15:35 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:15:34</nova:creationTime>
Aug 15 19:15:35 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:15:35 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:15:35 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:15:35 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:15:35 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:15:35 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:15:35 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:15:35 user nova-compute[73188]:       <nova:owner>
Aug 15 19:15:35 user nova-compute[73188]:         <nova:user uuid="c30de55a2834422c8f6df816899b881e">tempest-ServerActionsTestOtherA-2026424764-project-member</nova:user>
Aug 15 19:15:35 user nova-compute[73188]:         <nova:project uuid="a3c085a0ccf841e297d98037c07a7111">tempest-ServerActionsTestOtherA-2026424764</nova:project>
Aug 15 19:15:35 user nova-compute[73188]:       </nova:owner>
Aug 15 19:15:35 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:15:35 user nova-compute[73188]:       <nova:ports>
Aug 15 19:15:35 user nova-compute[73188]:         <nova:port uuid="fadc6652-e769-4a50-81a4-caefd1de83ff">
Aug 15 19:15:35 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 19:15:35 user nova-compute[73188]:         </nova:port>
Aug 15 19:15:35 user nova-compute[73188]:       </nova:ports>
Aug 15 19:15:35 user nova-compute[73188]:     </nova:instance>
Aug 15 19:15:35 user nova-compute[73188]:   </metadata>
Aug 15 19:15:35 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:15:35 user nova-compute[73188]:     <system>
Aug 15 19:15:35 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:15:35 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:15:35 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:15:35 user nova-compute[73188]:       <entry name="serial">2a472af2-b10c-456b-8dba-6c75f3ab806a</entry>
Aug 15 19:15:35 user nova-compute[73188]:       <entry name="uuid">2a472af2-b10c-456b-8dba-6c75f3ab806a</entry>
Aug 15 19:15:35 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:15:35 user nova-compute[73188]:     </system>
Aug 15 19:15:35 user nova-compute[73188]:   </sysinfo>
Aug 15 19:15:35 user nova-compute[73188]:   <os>
Aug 15 19:15:35 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:15:35 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:15:35 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:15:35 user nova-compute[73188]:   </os>
Aug 15 19:15:35 user nova-compute[73188]:   <features>
Aug 15 19:15:35 user nova-compute[73188]:     <acpi/>
Aug 15 19:15:35 user nova-compute[73188]:     <apic/>
Aug 15 19:15:35 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:15:35 user nova-compute[73188]:   </features>
Aug 15 19:15:35 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:15:35 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:15:35 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:15:35 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:15:35 user nova-compute[73188]:   </clock>
Aug 15 19:15:35 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:15:35 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:15:35 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:15:35 user nova-compute[73188]:   </cpu>
Aug 15 19:15:35 user nova-compute[73188]:   <devices>
Aug 15 19:15:35 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:15:35 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:15:35 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk"/>
Aug 15 19:15:35 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:15:35 user nova-compute[73188]:     </disk>
Aug 15 19:15:35 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:15:35 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:15:35 user nova-compute[73188]:       <source dev="/dev/sde"/>
Aug 15 19:15:35 user nova-compute[73188]:       <target dev="vdb" bus="virtio"/>
Aug 15 19:15:35 user nova-compute[73188]:       <serial>e82c9517-1d64-441b-b7fe-d8ad4764c476</serial>
Aug 15 19:15:35 user nova-compute[73188]:     </disk>
Aug 15 19:15:35 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:15:35 user nova-compute[73188]:       <mac address="fa:16:3e:28:1c:a1"/>
Aug 15 19:15:35 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:15:35 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:15:35 user nova-compute[73188]:       <target dev="tapfadc6652-e7"/>
Aug 15 19:15:35 user nova-compute[73188]:     </interface>
Aug 15 19:15:35 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:15:35 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/console.log" append="off"/>
Aug 15 19:15:35 user nova-compute[73188]:     </serial>
Aug 15 19:15:35 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:15:35 user nova-compute[73188]:     <video>
Aug 15 19:15:35 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:15:35 user nova-compute[73188]:     </video>
Aug 15 19:15:35 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:15:35 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:15:35 user nova-compute[73188]:     </rng>
Aug 15 19:15:35 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:15:35 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:15:35 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:15:35 user nova-compute[73188]:     </memballoon>
Aug 15 19:15:35 user nova-compute[73188]:   </devices>
Aug 15 19:15:35 user nova-compute[73188]: </domain>
Aug 15 19:15:35 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T19:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2127906751',display_name='tempest-ServerActionsTestOtherA-server-779595184',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2127906751',id=22,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT7pHtenQdl314usiZ2R/MplkqppVUszRcYtdF8PoT9iwdYNWnlBFP4lclfbI6J8I2Ewyw1annhgge1Ik0u6ps1bdNRiu2LQt8/JVAam6sa0kutoFjAwiPMLeb/O6NAfQ==',key_name='tempest-keypair-1165066426',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:13:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3c085a0ccf841e297d98037c07a7111',ramdisk_id='',reservation_id='r-x091yrli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2026424764',owner_user_name='tempest-ServerActionsTestOtherA-2026424764-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:15:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30de55a2834422c8f6df816899b881e',uuid=2a472af2-b10c-456b-8dba-6c75f3ab806a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fadc6652-e769-4a50-81a4-caefd1de83ff", "address": "fa:16:3e:28:1c:a1", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc6652-e7", "ovs_interfaceid": "fadc6652-e769-4a50-81a4-caefd1de83ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converting VIF {"id": "fadc6652-e769-4a50-81a4-caefd1de83ff", "address": "fa:16:3e:28:1c:a1", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc6652-e7", "ovs_interfaceid": "fadc6652-e769-4a50-81a4-caefd1de83ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:1c:a1,bridge_name='br-int',has_traffic_filtering=True,id=fadc6652-e769-4a50-81a4-caefd1de83ff,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc6652-e7') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG os_vif [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:1c:a1,bridge_name='br-int',has_traffic_filtering=True,id=fadc6652-e769-4a50-81a4-caefd1de83ff,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc6652-e7') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfadc6652-e7, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfadc6652-e7, col_values=(('external_ids', {'iface-id': 'fadc6652-e769-4a50-81a4-caefd1de83ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:1c:a1', 'vm-uuid': '2a472af2-b10c-456b-8dba-6c75f3ab806a'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:35 user nova-compute[73188]: INFO os_vif [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:1c:a1,bridge_name='br-int',has_traffic_filtering=True,id=fadc6652-e769-4a50-81a4-caefd1de83ff,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc6652-e7')
Aug 15 19:15:35 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:15:35 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] No VIF found with MAC fa:16:3e:28:1c:a1, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:15:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "7f96acc3-0856-462e-9a32-879848f60a0e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "7f96acc3-0856-462e-9a32-879848f60a0e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG nova.objects.instance [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lazy-loading 'flavor' on Instance uuid 7f96acc3-0856-462e-9a32-879848f60a0e {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "7f96acc3-0856-462e-9a32-879848f60a0e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "7f96acc3-0856-462e-9a32-879848f60a0e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "7f96acc3-0856-462e-9a32-879848f60a0e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:37 user nova-compute[73188]: INFO nova.compute.manager [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Attaching volume 7c1538e1-84d3-4ed6-b3c8-490387dc6e5e to /dev/vdb
Aug 15 19:15:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG os_brick.utils [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG nova.compute.manager [req-2304aed4-e88b-4647-8aa8-8a0953c553e0 req-d956300f-ccfb-420c-bb27-341f0adfae58 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Received event network-vif-plugged-fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2304aed4-e88b-4647-8aa8-8a0953c553e0 req-d956300f-ccfb-420c-bb27-341f0adfae58 service nova] Acquiring lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2304aed4-e88b-4647-8aa8-8a0953c553e0 req-d956300f-ccfb-420c-bb27-341f0adfae58 service nova] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2304aed4-e88b-4647-8aa8-8a0953c553e0 req-d956300f-ccfb-420c-bb27-341f0adfae58 service nova] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG nova.compute.manager [req-2304aed4-e88b-4647-8aa8-8a0953c553e0 req-d956300f-ccfb-420c-bb27-341f0adfae58 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] No waiting events found dispatching network-vif-plugged-fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:15:37 user nova-compute[73188]: WARNING nova.compute.manager [req-2304aed4-e88b-4647-8aa8-8a0953c553e0 req-d956300f-ccfb-420c-bb27-341f0adfae58 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Received unexpected event network-vif-plugged-fadc6652-e769-4a50-81a4-caefd1de83ff for instance with vm_state active and task_state rebuild_spawning.
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5185bd-fdb4-4a78-bd19-46e135cff050]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b263b2cb-8a4b-44cb-9349-92319b7fb1de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8417c67e-2974-47be-bc5b-8ccf97c53f0d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04022aa-750d-4e80-a743-2413c4c39c78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:15:37 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:15:37 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a417b6-000f-410b-9b80-08a4af4171b2]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG os_brick.utils [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:15:37 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Updating existing volume attachment record: ac9a7074-398f-4cc1-ad48-71d0f2c7016f {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:15:39 user nova-compute[73188]: DEBUG nova.compute.manager [req-3d56a90f-13d8-4703-973f-d144c8db7131 req-00dba1b4-f37e-4316-ad92-8a10d05973d2 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Received event network-vif-plugged-fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:15:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3d56a90f-13d8-4703-973f-d144c8db7131 req-00dba1b4-f37e-4316-ad92-8a10d05973d2 service nova] Acquiring lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3d56a90f-13d8-4703-973f-d144c8db7131 req-00dba1b4-f37e-4316-ad92-8a10d05973d2 service nova] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3d56a90f-13d8-4703-973f-d144c8db7131 req-00dba1b4-f37e-4316-ad92-8a10d05973d2 service nova] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:39 user nova-compute[73188]: DEBUG nova.compute.manager [req-3d56a90f-13d8-4703-973f-d144c8db7131 req-00dba1b4-f37e-4316-ad92-8a10d05973d2 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] No waiting events found dispatching network-vif-plugged-fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:15:39 user nova-compute[73188]: WARNING nova.compute.manager [req-3d56a90f-13d8-4703-973f-d144c8db7131 req-00dba1b4-f37e-4316-ad92-8a10d05973d2 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Received unexpected event network-vif-plugged-fadc6652-e769-4a50-81a4-caefd1de83ff for instance with vm_state active and task_state rebuild_spawning.
Aug 15 19:15:39 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126939.9449503, 2a472af2-b10c-456b-8dba-6c75f3ab806a => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:15:39 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] VM Resumed (Lifecycle Event)
Aug 15 19:15:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:15:39 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:15:39 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Instance spawned successfully.
Aug 15 19:15:39 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:15:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:15:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:15:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:15:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:15:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:15:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:15:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:15:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:15:40 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 19:15:40 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126939.9455247, 2a472af2-b10c-456b-8dba-6c75f3ab806a => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:15:40 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] VM Started (Lifecycle Event)
Aug 15 19:15:40 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:15:40 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:15:40 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 19:15:40 user nova-compute[73188]: DEBUG nova.compute.manager [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:15:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:40 user nova-compute[73188]: DEBUG nova.objects.instance [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73188) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 19:15:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2c5dbdf2-7e3b-40f4-8e33-fda7da96dc00 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.084s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Acquiring lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:40 user nova-compute[73188]: DEBUG nova.objects.instance [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lazy-loading 'flavor' on Instance uuid 4cc14820-2d7d-4779-8d90-b77462f1bfa8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:15:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Acquiring lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:41 user nova-compute[73188]: INFO nova.compute.manager [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Attaching volume d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d to /dev/vdb
Aug 15 19:15:41 user nova-compute[73188]: DEBUG os_brick.utils [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1189eb44-badb-4269-942c-954908889087]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5359d59-e026-4091-b871-f13fe2038672]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d0976e-1203-454e-bed5-ddaafdf4e9c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[201ab722-2058-4252-8659-4068fdf0e6b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:15:41 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:15:41 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffeb53e-909f-4fdf-94fe-52c5eadfce34]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG os_brick.utils [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] <== get_connector_properties: return (236ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Updating existing volume attachment record: 21e9c478-4707-44c7-8dbf-ca8d84be1977 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:15:41 user nova-compute[73188]: DEBUG nova.compute.manager [None req-0488d6d9-e4d4-4e58-a490-9dd6b8718b7c tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:15:41 user nova-compute[73188]: INFO nova.compute.manager [None req-0488d6d9-e4d4-4e58-a490-9dd6b8718b7c tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] instance snapshotting
Aug 15 19:15:41 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-0488d6d9-e4d4-4e58-a490-9dd6b8718b7c tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Beginning live snapshot process
Aug 15 19:15:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-0488d6d9-e4d4-4e58-a490-9dd6b8718b7c tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json -f qcow2 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-0488d6d9-e4d4-4e58-a490-9dd6b8718b7c tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json -f qcow2" returned: 0 in 0.220s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-0488d6d9-e4d4-4e58-a490-9dd6b8718b7c tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json -f qcow2 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-0488d6d9-e4d4-4e58-a490-9dd6b8718b7c tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-0488d6d9-e4d4-4e58-a490-9dd6b8718b7c tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-0488d6d9-e4d4-4e58-a490-9dd6b8718b7c tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.213s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-0488d6d9-e4d4-4e58-a490-9dd6b8718b7c tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxvk45fg5/051977008e7c4701a44b0a5de02943e0.delta 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-0488d6d9-e4d4-4e58-a490-9dd6b8718b7c tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxvk45fg5/051977008e7c4701a44b0a5de02943e0.delta 1073741824" returned: 0 in 0.057s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:42 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-0488d6d9-e4d4-4e58-a490-9dd6b8718b7c tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 19:15:43 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-0488d6d9-e4d4-4e58-a490-9dd6b8718b7c tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73188) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 19:15:44 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-0488d6d9-e4d4-4e58-a490-9dd6b8718b7c tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] COPY block job progress, current cursor: 26411008 final cursor: 75497472 {{(pid=73188) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 19:15:44 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-0488d6d9-e4d4-4e58-a490-9dd6b8718b7c tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73188) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 19:15:44 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-0488d6d9-e4d4-4e58-a490-9dd6b8718b7c tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 19:15:44 user nova-compute[73188]: DEBUG nova.privsep.utils [None req-0488d6d9-e4d4-4e58-a490-9dd6b8718b7c tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73188) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 19:15:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-0488d6d9-e4d4-4e58-a490-9dd6b8718b7c tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxvk45fg5/051977008e7c4701a44b0a5de02943e0.delta /opt/stack/data/nova/instances/snapshots/tmpxvk45fg5/051977008e7c4701a44b0a5de02943e0 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-0488d6d9-e4d4-4e58-a490-9dd6b8718b7c tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxvk45fg5/051977008e7c4701a44b0a5de02943e0.delta /opt/stack/data/nova/instances/snapshots/tmpxvk45fg5/051977008e7c4701a44b0a5de02943e0" returned: 0 in 0.788s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:45 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-0488d6d9-e4d4-4e58-a490-9dd6b8718b7c tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Snapshot extracted, beginning image upload
Aug 15 19:15:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:49 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-0488d6d9-e4d4-4e58-a490-9dd6b8718b7c tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Snapshot image upload complete
Aug 15 19:15:49 user nova-compute[73188]: INFO nova.compute.manager [None req-0488d6d9-e4d4-4e58-a490-9dd6b8718b7c tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Took 7.72 seconds to snapshot the instance on the hypervisor.
Aug 15 19:15:50 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ediQvCuF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:15:50 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:15:50 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:15:50 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dedab4-2b2c-4699-8625-52dd6fb5640b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:15:50 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[931e9595-22c5-41a5-807b-8b80d335d4fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e] added
Aug 15 19:15:50 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a979c4de-12a6-48e9-aa39-64d61288cae1]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e7f93f-43ea-4ae9-a6ae-ee7fea3ea954]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ediQvCuF {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ediQvCuF" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[591bf358-5d30-4e4f-a097-def7c0ebbb16]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ediQvCuF'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bcae1e-282a-459a-b3d7-cbe7de0fd020]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a64c8d4-286a-4326-be07-59d21928a046]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:15:50 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:15:50 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:15:50 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:15:50 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:15:50 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:15:50 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:15:50 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:15:50 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a5c670-cecd-4a6e-af31-d0bd0ce50de3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e, portal: 172.16.0.220,3260]
Aug 15 19:15:50 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e, portal: 172.16.0.220,3260] successful.
Aug 15 19:15:50 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b382fee-1200-418d-ae48-55c3b38dce89]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cd2ac0-5eb4-49ea-95bd-14a1f7914dd5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:15:50 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:15:50 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:15:50 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:15:50 user nova-compute[73188]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:15:50 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:15:50 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:15:50 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:15:50 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:15:50 user nova-compute[73188]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:15:50 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] HCTL ('37', '-', '-', 0) found on session 25 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eeb3c4a-a325-4613-a377-4bd2a1999295]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Searching for a device in session 25 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ediQvCuF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:15:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:51 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:15:51 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23862313464666231', 'path': '/dev/sdf'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:15:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862313464666231', 'path': '/dev/sdf'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:15:51 user nova-compute[73188]: DEBUG nova.objects.instance [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lazy-loading 'flavor' on Instance uuid 7f96acc3-0856-462e-9a32-879848f60a0e {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:15:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:15:51 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:15:51 user nova-compute[73188]:   <source dev="/dev/sdf"/>
Aug 15 19:15:51 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:15:51 user nova-compute[73188]:   <serial>7c1538e1-84d3-4ed6-b3c8-490387dc6e5e</serial>
Aug 15 19:15:51 user nova-compute[73188]: </disk>
Aug 15 19:15:51 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:15:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:15:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:15:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] No VIF found with MAC fa:16:3e:9b:51:30, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:15:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b4fd7302-5539-4a57-b368-06afe1e94bc2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "7f96acc3-0856-462e-9a32-879848f60a0e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.552s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MxufzYWk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:15:53 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:15:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:15:53 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:15:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:15:53 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9d93ac-e707-41b8-9ff4-be32c88a7c95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:15:53 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[20668948-3db4-4e3c-a540-0c0f1cbf99bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d] added
Aug 15 19:15:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83488f4-763b-4a60-868f-728355eb30be]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[95798a42-0361-4fed-afae-d18d206f1987]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MxufzYWk {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MxufzYWk" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8bdc80-6130-4529-b966-952ccf640782]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MxufzYWk'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff39e5a8-29d9-4436-acb6-7837b1b4736b]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea4830c-326d-4f59-bfe5-e581ef25bee1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:15:53 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:15:53 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:15:53 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:15:53 user nova-compute[73188]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:15:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:15:53 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:15:53 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:15:53 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:15:53 user nova-compute[73188]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:15:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[98244d7d-11b4-4e1a-8816-72f23ffcdba2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d, portal: 172.16.0.220,3260]
Aug 15 19:15:53 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d, portal: 172.16.0.220,3260] successful.
Aug 15 19:15:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c61139-c432-41fe-bbd5-41183402a073]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[84706a15-7943-40ea-9b9c-6f037a3b8a25]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:15:53 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:15:53 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:15:53 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:15:53 user nova-compute[73188]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:15:53 user nova-compute[73188]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d (non-flash)
Aug 15 19:15:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:15:53 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:15:53 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:15:53 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:15:53 user nova-compute[73188]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:15:53 user nova-compute[73188]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d (non-flash)
Aug 15 19:15:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] HCTL ('38', '-', '-', 0) found on session 26 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14d49c7-e1d9-4f3e-86b2-931e0e56eb60]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:53 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Searching for a device in session 26 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:15:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MxufzYWk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:15:55 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:15:55 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23731373163376231', 'path': '/dev/sdg'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:15:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731373163376231', 'path': '/dev/sdg'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:15:55 user nova-compute[73188]: DEBUG nova.objects.instance [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lazy-loading 'flavor' on Instance uuid 4cc14820-2d7d-4779-8d90-b77462f1bfa8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:15:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:15:55 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:15:55 user nova-compute[73188]:   <source dev="/dev/sdg"/>
Aug 15 19:15:55 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:15:55 user nova-compute[73188]:   <serial>d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d</serial>
Aug 15 19:15:55 user nova-compute[73188]: </disk>
Aug 15 19:15:55 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:15:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:15:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:15:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] No VIF found with MAC fa:16:3e:f9:aa:e7, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:15:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6f41393a-7b2d-46b3-a3c0-dc0724e01daf tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.580s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Acquiring lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Acquiring lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:56 user nova-compute[73188]: INFO nova.compute.manager [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Terminating instance
Aug 15 19:15:56 user nova-compute[73188]: DEBUG nova.compute.manager [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:15:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:56 user nova-compute[73188]: DEBUG nova.compute.manager [req-68c93e12-adae-4e43-aaa6-03650ecc4254 req-80558660-b5a2-4957-a127-fa81ed6a6721 service nova] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Received event network-vif-unplugged-bacf9b02-1d5c-4db2-bf85-aeaefdaa6690 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:15:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-68c93e12-adae-4e43-aaa6-03650ecc4254 req-80558660-b5a2-4957-a127-fa81ed6a6721 service nova] Acquiring lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-68c93e12-adae-4e43-aaa6-03650ecc4254 req-80558660-b5a2-4957-a127-fa81ed6a6721 service nova] Lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-68c93e12-adae-4e43-aaa6-03650ecc4254 req-80558660-b5a2-4957-a127-fa81ed6a6721 service nova] Lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:56 user nova-compute[73188]: DEBUG nova.compute.manager [req-68c93e12-adae-4e43-aaa6-03650ecc4254 req-80558660-b5a2-4957-a127-fa81ed6a6721 service nova] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] No waiting events found dispatching network-vif-unplugged-bacf9b02-1d5c-4db2-bf85-aeaefdaa6690 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:15:56 user nova-compute[73188]: DEBUG nova.compute.manager [req-68c93e12-adae-4e43-aaa6-03650ecc4254 req-80558660-b5a2-4957-a127-fa81ed6a6721 service nova] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Received event network-vif-unplugged-bacf9b02-1d5c-4db2-bf85-aeaefdaa6690 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:15:57 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Instance destroyed successfully.
Aug 15 19:15:57 user nova-compute[73188]: DEBUG nova.objects.instance [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lazy-loading 'resources' on Instance uuid 4cc14820-2d7d-4779-8d90-b77462f1bfa8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-964063720',display_name='tempest-DeleteServersTestJSON-server-964063720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-964063720',id=24,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:13:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73dbae0375534e838d252cbd3f47722a',ramdisk_id='',reservation_id='r-bgda3jho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-606129902',owner_user_name='tempest-DeleteServersTestJSON-606129902-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:13:54Z,user_data=None,user_id='bee4ed91c66d41a791684721e77abc17',uuid=4cc14820-2d7d-4779-8d90-b77462f1bfa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bacf9b02-1d5c-4db2-bf85-aeaefdaa6690", "address": "fa:16:3e:f9:aa:e7", "network": {"id": "c8017021-3911-4579-bb4d-707d3db965e8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1745022888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dbae0375534e838d252cbd3f47722a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf9b02-1d", "ovs_interfaceid": "bacf9b02-1d5c-4db2-bf85-aeaefdaa6690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Converting VIF {"id": "bacf9b02-1d5c-4db2-bf85-aeaefdaa6690", "address": "fa:16:3e:f9:aa:e7", "network": {"id": "c8017021-3911-4579-bb4d-707d3db965e8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1745022888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dbae0375534e838d252cbd3f47722a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbacf9b02-1d", "ovs_interfaceid": "bacf9b02-1d5c-4db2-bf85-aeaefdaa6690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:aa:e7,bridge_name='br-int',has_traffic_filtering=True,id=bacf9b02-1d5c-4db2-bf85-aeaefdaa6690,network=Network(c8017021-3911-4579-bb4d-707d3db965e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacf9b02-1d') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG os_vif [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:aa:e7,bridge_name='br-int',has_traffic_filtering=True,id=bacf9b02-1d5c-4db2-bf85-aeaefdaa6690,network=Network(c8017021-3911-4579-bb4d-707d3db965e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacf9b02-1d') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbacf9b02-1d, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:15:57 user nova-compute[73188]: INFO os_vif [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:aa:e7,bridge_name='br-int',has_traffic_filtering=True,id=bacf9b02-1d5c-4db2-bf85-aeaefdaa6690,network=Network(c8017021-3911-4579-bb4d-707d3db965e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbacf9b02-1d')
Aug 15 19:15:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MxufzYWk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:15:57 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:15:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78b2fc7-329a-43ea-8b8f-33b3f2b0619e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d608d72f-214e-4c84-955a-e49a29244975]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:15:57 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:15:57 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:15:57 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:15:57 user nova-compute[73188]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:15:57 user nova-compute[73188]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d (non-flash)
Aug 15 19:15:57 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:15:57 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:15:57 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:15:57 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:15:57 user nova-compute[73188]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:15:57 user nova-compute[73188]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d (non-flash)
Aug 15 19:15:57 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28101eb250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d'): ({'sdg'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Removing single pathed devices sdg {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83143e2-9a87-4738-955f-a92a4a68a80c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d7cf90-7595-4782-9e1d-898e9df5f35c]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Flushing IO for device /dev/sdg {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4b83db-86dd-4086-9ae4-0ac8bbce251a]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.054s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bee5317-2ce7-422c-96fa-e6a7586d0c8f]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] SCSI volumes sdg have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbc4fea-e017-43fd-bf89-73944e74115b]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a906a9-021f-4cff-9d12-d8364e39269c]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d, portal: 172.16.0.220,3260]
Aug 15 19:15:57 user nova-compute[73188]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d, portal: 172.16.0.220,3260] successful.
Aug 15 19:15:57 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d33d4d3c-9304-41cc-8f2b-ee3371ab5d8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3c05ac-eba9-497d-968a-2519efe5a545]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] <== disconnect_volume: return (346ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:15:57 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Deleting instance files /opt/stack/data/nova/instances/4cc14820-2d7d-4779-8d90-b77462f1bfa8_del
Aug 15 19:15:57 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Deletion of /opt/stack/data/nova/instances/4cc14820-2d7d-4779-8d90-b77462f1bfa8_del complete
Aug 15 19:15:57 user nova-compute[73188]: INFO nova.compute.manager [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 15 19:15:57 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:15:57 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:15:58 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:15:58 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Took 0.58 seconds to deallocate network for instance.
Aug 15 19:15:58 user nova-compute[73188]: INFO nova.compute.manager [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Took 0.81 seconds to detach 1 volumes for instance.
Aug 15 19:15:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:59 user nova-compute[73188]: DEBUG nova.compute.manager [req-8a8d6b85-aa54-4bc2-be64-f064a938b472 req-f06a7a18-65a9-4c7a-944c-8879bd9fcc7a service nova] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Received event network-vif-plugged-bacf9b02-1d5c-4db2-bf85-aeaefdaa6690 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:15:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8a8d6b85-aa54-4bc2-be64-f064a938b472 req-f06a7a18-65a9-4c7a-944c-8879bd9fcc7a service nova] Acquiring lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:15:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8a8d6b85-aa54-4bc2-be64-f064a938b472 req-f06a7a18-65a9-4c7a-944c-8879bd9fcc7a service nova] Lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:15:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8a8d6b85-aa54-4bc2-be64-f064a938b472 req-f06a7a18-65a9-4c7a-944c-8879bd9fcc7a service nova] Lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:59 user nova-compute[73188]: DEBUG nova.compute.manager [req-8a8d6b85-aa54-4bc2-be64-f064a938b472 req-f06a7a18-65a9-4c7a-944c-8879bd9fcc7a service nova] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] No waiting events found dispatching network-vif-plugged-bacf9b02-1d5c-4db2-bf85-aeaefdaa6690 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:15:59 user nova-compute[73188]: WARNING nova.compute.manager [req-8a8d6b85-aa54-4bc2-be64-f064a938b472 req-f06a7a18-65a9-4c7a-944c-8879bd9fcc7a service nova] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Received unexpected event network-vif-plugged-bacf9b02-1d5c-4db2-bf85-aeaefdaa6690 for instance with vm_state deleted and task_state None.
Aug 15 19:15:59 user nova-compute[73188]: DEBUG nova.compute.manager [req-8a8d6b85-aa54-4bc2-be64-f064a938b472 req-f06a7a18-65a9-4c7a-944c-8879bd9fcc7a service nova] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Received event network-vif-deleted-bacf9b02-1d5c-4db2-bf85-aeaefdaa6690 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:15:59 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:15:59 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:15:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:15:59 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Deleted allocations for instance 4cc14820-2d7d-4779-8d90-b77462f1bfa8
Aug 15 19:15:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-df0c7647-2a5e-4d87-905a-29502e8e211c tempest-DeleteServersTestJSON-606129902 tempest-DeleteServersTestJSON-606129902-project-member] Lock "4cc14820-2d7d-4779-8d90-b77462f1bfa8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.252s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:16:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:04 user nova-compute[73188]: DEBUG nova.compute.manager [req-fc3e8562-5167-4469-9df2-ed4b9a70a93f req-3138b773-f552-4216-ac50-c8c9ae255e69 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Received event network-changed-c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:16:04 user nova-compute[73188]: DEBUG nova.compute.manager [req-fc3e8562-5167-4469-9df2-ed4b9a70a93f req-3138b773-f552-4216-ac50-c8c9ae255e69 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Refreshing instance network info cache due to event network-changed-c10933cb-e730-47f0-9b80-fcec4cf6c359. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:16:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fc3e8562-5167-4469-9df2-ed4b9a70a93f req-3138b773-f552-4216-ac50-c8c9ae255e69 service nova] Acquiring lock "refresh_cache-7f96acc3-0856-462e-9a32-879848f60a0e" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:16:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fc3e8562-5167-4469-9df2-ed4b9a70a93f req-3138b773-f552-4216-ac50-c8c9ae255e69 service nova] Acquired lock "refresh_cache-7f96acc3-0856-462e-9a32-879848f60a0e" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:16:04 user nova-compute[73188]: DEBUG nova.network.neutron [req-fc3e8562-5167-4469-9df2-ed4b9a70a93f req-3138b773-f552-4216-ac50-c8c9ae255e69 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Refreshing network info cache for port c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:16:05 user nova-compute[73188]: INFO nova.compute.manager [None req-5a9a2fd9-6dd6-40f3-86d7-0effd59f3b64 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Unrescuing
Aug 15 19:16:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5a9a2fd9-6dd6-40f3-86d7-0effd59f3b64 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquiring lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:16:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5a9a2fd9-6dd6-40f3-86d7-0effd59f3b64 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquired lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:16:05 user nova-compute[73188]: DEBUG nova.network.neutron [None req-5a9a2fd9-6dd6-40f3-86d7-0effd59f3b64 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:16:05 user nova-compute[73188]: DEBUG nova.network.neutron [req-fc3e8562-5167-4469-9df2-ed4b9a70a93f req-3138b773-f552-4216-ac50-c8c9ae255e69 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Updated VIF entry in instance network info cache for port c10933cb-e730-47f0-9b80-fcec4cf6c359. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:16:05 user nova-compute[73188]: DEBUG nova.network.neutron [req-fc3e8562-5167-4469-9df2-ed4b9a70a93f req-3138b773-f552-4216-ac50-c8c9ae255e69 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Updating instance_info_cache with network_info: [{"id": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "address": "fa:16:3e:9b:51:30", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10933cb-e7", "ovs_interfaceid": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:16:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fc3e8562-5167-4469-9df2-ed4b9a70a93f req-3138b773-f552-4216-ac50-c8c9ae255e69 service nova] Releasing lock "refresh_cache-7f96acc3-0856-462e-9a32-879848f60a0e" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:16:05 user nova-compute[73188]: DEBUG nova.network.neutron [None req-5a9a2fd9-6dd6-40f3-86d7-0effd59f3b64 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Updating instance_info_cache with network_info: [{"id": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "address": "fa:16:3e:06:3e:cd", "network": {"id": "72ad2e88-4c2b-4cba-bfa5-801725bc0041", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824390140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b47c13ca2b84149926b814a26148366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf07c7de0-82", "ovs_interfaceid": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:16:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5a9a2fd9-6dd6-40f3-86d7-0effd59f3b64 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Releasing lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:16:05 user nova-compute[73188]: DEBUG nova.objects.instance [None req-5a9a2fd9-6dd6-40f3-86d7-0effd59f3b64 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lazy-loading 'flavor' on Instance uuid de6929cd-c95d-4964-b81c-96872a137f90 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:16:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:06 user nova-compute[73188]: DEBUG nova.compute.manager [req-90c5cb40-c7cd-428e-bac3-b61d28005759 req-ceb7e0cd-5242-4484-ab1d-4cd735a3ce5b service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received event network-vif-unplugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:16:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-90c5cb40-c7cd-428e-bac3-b61d28005759 req-ceb7e0cd-5242-4484-ab1d-4cd735a3ce5b service nova] Acquiring lock "de6929cd-c95d-4964-b81c-96872a137f90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:16:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-90c5cb40-c7cd-428e-bac3-b61d28005759 req-ceb7e0cd-5242-4484-ab1d-4cd735a3ce5b service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:16:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-90c5cb40-c7cd-428e-bac3-b61d28005759 req-ceb7e0cd-5242-4484-ab1d-4cd735a3ce5b service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:16:06 user nova-compute[73188]: DEBUG nova.compute.manager [req-90c5cb40-c7cd-428e-bac3-b61d28005759 req-ceb7e0cd-5242-4484-ab1d-4cd735a3ce5b service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] No waiting events found dispatching network-vif-unplugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:16:06 user nova-compute[73188]: WARNING nova.compute.manager [req-90c5cb40-c7cd-428e-bac3-b61d28005759 req-ceb7e0cd-5242-4484-ab1d-4cd735a3ce5b service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received unexpected event network-vif-unplugged-f07c7de0-8264-42c8-aa30-1a8c7405379a for instance with vm_state rescued and task_state unrescuing.
Aug 15 19:16:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:06 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Instance destroyed successfully.
Aug 15 19:16:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-055ebfb7-b328-4eca-8949-4c34dc0a1d03 req-631f0863-8ab0-4b5a-b587-7bed61e34b3d service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received event network-changed-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:16:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-055ebfb7-b328-4eca-8949-4c34dc0a1d03 req-631f0863-8ab0-4b5a-b587-7bed61e34b3d service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Refreshing instance network info cache due to event network-changed-f07c7de0-8264-42c8-aa30-1a8c7405379a. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:16:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-055ebfb7-b328-4eca-8949-4c34dc0a1d03 req-631f0863-8ab0-4b5a-b587-7bed61e34b3d service nova] Acquiring lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:16:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-055ebfb7-b328-4eca-8949-4c34dc0a1d03 req-631f0863-8ab0-4b5a-b587-7bed61e34b3d service nova] Acquired lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:16:07 user nova-compute[73188]: DEBUG nova.network.neutron [req-055ebfb7-b328-4eca-8949-4c34dc0a1d03 req-631f0863-8ab0-4b5a-b587-7bed61e34b3d service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Refreshing network info cache for port f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:16:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:08 user nova-compute[73188]: DEBUG nova.network.neutron [req-055ebfb7-b328-4eca-8949-4c34dc0a1d03 req-631f0863-8ab0-4b5a-b587-7bed61e34b3d service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Updated VIF entry in instance network info cache for port f07c7de0-8264-42c8-aa30-1a8c7405379a. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:16:08 user nova-compute[73188]: DEBUG nova.network.neutron [req-055ebfb7-b328-4eca-8949-4c34dc0a1d03 req-631f0863-8ab0-4b5a-b587-7bed61e34b3d service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Updating instance_info_cache with network_info: [{"id": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "address": "fa:16:3e:06:3e:cd", "network": {"id": "72ad2e88-4c2b-4cba-bfa5-801725bc0041", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824390140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b47c13ca2b84149926b814a26148366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf07c7de0-82", "ovs_interfaceid": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:16:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-055ebfb7-b328-4eca-8949-4c34dc0a1d03 req-631f0863-8ab0-4b5a-b587-7bed61e34b3d service nova] Releasing lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:16:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-556dc6e0-278a-4f7d-9a2b-f10c5c6e5f7f req-a399d9e9-6412-4baa-b9c5-b588f997684c service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received event network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:16:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-556dc6e0-278a-4f7d-9a2b-f10c5c6e5f7f req-a399d9e9-6412-4baa-b9c5-b588f997684c service nova] Acquiring lock "de6929cd-c95d-4964-b81c-96872a137f90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:16:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-556dc6e0-278a-4f7d-9a2b-f10c5c6e5f7f req-a399d9e9-6412-4baa-b9c5-b588f997684c service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:16:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-556dc6e0-278a-4f7d-9a2b-f10c5c6e5f7f req-a399d9e9-6412-4baa-b9c5-b588f997684c service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:16:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-556dc6e0-278a-4f7d-9a2b-f10c5c6e5f7f req-a399d9e9-6412-4baa-b9c5-b588f997684c service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] No waiting events found dispatching network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:16:08 user nova-compute[73188]: WARNING nova.compute.manager [req-556dc6e0-278a-4f7d-9a2b-f10c5c6e5f7f req-a399d9e9-6412-4baa-b9c5-b588f997684c service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received unexpected event network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a for instance with vm_state rescued and task_state unrescuing.
Aug 15 19:16:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-e163b517-9071-45de-b1de-55eab78da49b req-8afabef7-93d0-4e71-b693-802ccb8bef31 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Received event network-changed-c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:16:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-e163b517-9071-45de-b1de-55eab78da49b req-8afabef7-93d0-4e71-b693-802ccb8bef31 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Refreshing instance network info cache due to event network-changed-c10933cb-e730-47f0-9b80-fcec4cf6c359. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:16:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e163b517-9071-45de-b1de-55eab78da49b req-8afabef7-93d0-4e71-b693-802ccb8bef31 service nova] Acquiring lock "refresh_cache-7f96acc3-0856-462e-9a32-879848f60a0e" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:16:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e163b517-9071-45de-b1de-55eab78da49b req-8afabef7-93d0-4e71-b693-802ccb8bef31 service nova] Acquired lock "refresh_cache-7f96acc3-0856-462e-9a32-879848f60a0e" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:16:08 user nova-compute[73188]: DEBUG nova.network.neutron [req-e163b517-9071-45de-b1de-55eab78da49b req-8afabef7-93d0-4e71-b693-802ccb8bef31 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Refreshing network info cache for port c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:16:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-4af8964e-3729-4c57-b679-4dbf0310fef9 req-a1c7292e-1d02-40df-ac76-f823a882453c service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received event network-changed-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:16:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-4af8964e-3729-4c57-b679-4dbf0310fef9 req-a1c7292e-1d02-40df-ac76-f823a882453c service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Refreshing instance network info cache due to event network-changed-f07c7de0-8264-42c8-aa30-1a8c7405379a. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:16:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4af8964e-3729-4c57-b679-4dbf0310fef9 req-a1c7292e-1d02-40df-ac76-f823a882453c service nova] Acquiring lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:16:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4af8964e-3729-4c57-b679-4dbf0310fef9 req-a1c7292e-1d02-40df-ac76-f823a882453c service nova] Acquired lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:16:09 user nova-compute[73188]: DEBUG nova.network.neutron [req-4af8964e-3729-4c57-b679-4dbf0310fef9 req-a1c7292e-1d02-40df-ac76-f823a882453c service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Refreshing network info cache for port f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:16:09 user nova-compute[73188]: DEBUG nova.network.neutron [req-e163b517-9071-45de-b1de-55eab78da49b req-8afabef7-93d0-4e71-b693-802ccb8bef31 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Updated VIF entry in instance network info cache for port c10933cb-e730-47f0-9b80-fcec4cf6c359. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:16:09 user nova-compute[73188]: DEBUG nova.network.neutron [req-e163b517-9071-45de-b1de-55eab78da49b req-8afabef7-93d0-4e71-b693-802ccb8bef31 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Updating instance_info_cache with network_info: [{"id": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "address": "fa:16:3e:9b:51:30", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10933cb-e7", "ovs_interfaceid": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:16:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e163b517-9071-45de-b1de-55eab78da49b req-8afabef7-93d0-4e71-b693-802ccb8bef31 service nova] Releasing lock "refresh_cache-7f96acc3-0856-462e-9a32-879848f60a0e" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:16:09 user nova-compute[73188]: DEBUG nova.network.neutron [req-4af8964e-3729-4c57-b679-4dbf0310fef9 req-a1c7292e-1d02-40df-ac76-f823a882453c service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Updated VIF entry in instance network info cache for port f07c7de0-8264-42c8-aa30-1a8c7405379a. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:16:09 user nova-compute[73188]: DEBUG nova.network.neutron [req-4af8964e-3729-4c57-b679-4dbf0310fef9 req-a1c7292e-1d02-40df-ac76-f823a882453c service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Updating instance_info_cache with network_info: [{"id": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "address": "fa:16:3e:06:3e:cd", "network": {"id": "72ad2e88-4c2b-4cba-bfa5-801725bc0041", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824390140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b47c13ca2b84149926b814a26148366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf07c7de0-82", "ovs_interfaceid": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:16:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4af8964e-3729-4c57-b679-4dbf0310fef9 req-a1c7292e-1d02-40df-ac76-f823a882453c service nova] Releasing lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:16:10 user nova-compute[73188]: DEBUG nova.compute.manager [req-1d7615e7-b859-45a9-8487-bb36cf0a762a req-003ad0a7-7a48-4f58-b57b-fc1a2773b8ea service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received event network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:16:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1d7615e7-b859-45a9-8487-bb36cf0a762a req-003ad0a7-7a48-4f58-b57b-fc1a2773b8ea service nova] Acquiring lock "de6929cd-c95d-4964-b81c-96872a137f90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:16:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1d7615e7-b859-45a9-8487-bb36cf0a762a req-003ad0a7-7a48-4f58-b57b-fc1a2773b8ea service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:16:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1d7615e7-b859-45a9-8487-bb36cf0a762a req-003ad0a7-7a48-4f58-b57b-fc1a2773b8ea service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:16:10 user nova-compute[73188]: DEBUG nova.compute.manager [req-1d7615e7-b859-45a9-8487-bb36cf0a762a req-003ad0a7-7a48-4f58-b57b-fc1a2773b8ea service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] No waiting events found dispatching network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:16:10 user nova-compute[73188]: WARNING nova.compute.manager [req-1d7615e7-b859-45a9-8487-bb36cf0a762a req-003ad0a7-7a48-4f58-b57b-fc1a2773b8ea service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received unexpected event network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a for instance with vm_state rescued and task_state unrescuing.
Aug 15 19:16:10 user nova-compute[73188]: DEBUG nova.compute.manager [req-1d7615e7-b859-45a9-8487-bb36cf0a762a req-003ad0a7-7a48-4f58-b57b-fc1a2773b8ea service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received event network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:16:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1d7615e7-b859-45a9-8487-bb36cf0a762a req-003ad0a7-7a48-4f58-b57b-fc1a2773b8ea service nova] Acquiring lock "de6929cd-c95d-4964-b81c-96872a137f90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:16:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1d7615e7-b859-45a9-8487-bb36cf0a762a req-003ad0a7-7a48-4f58-b57b-fc1a2773b8ea service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:16:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1d7615e7-b859-45a9-8487-bb36cf0a762a req-003ad0a7-7a48-4f58-b57b-fc1a2773b8ea service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:16:10 user nova-compute[73188]: DEBUG nova.compute.manager [req-1d7615e7-b859-45a9-8487-bb36cf0a762a req-003ad0a7-7a48-4f58-b57b-fc1a2773b8ea service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] No waiting events found dispatching network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:16:10 user nova-compute[73188]: WARNING nova.compute.manager [req-1d7615e7-b859-45a9-8487-bb36cf0a762a req-003ad0a7-7a48-4f58-b57b-fc1a2773b8ea service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received unexpected event network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a for instance with vm_state rescued and task_state unrescuing.
Aug 15 19:16:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Removed pending event for de6929cd-c95d-4964-b81c-96872a137f90 due to event {{(pid=73188) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 19:16:10 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126970.8634415, de6929cd-c95d-4964-b81c-96872a137f90 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:16:10 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] VM Resumed (Lifecycle Event)
Aug 15 19:16:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-5a9a2fd9-6dd6-40f3-86d7-0effd59f3b64 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:16:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:16:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:16:10 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 19:16:10 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126970.8652623, de6929cd-c95d-4964-b81c-96872a137f90 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:16:10 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] VM Started (Lifecycle Event)
Aug 15 19:16:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:16:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:16:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:11 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:16:12 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692126957.1018238, 4cc14820-2d7d-4779-8d90-b77462f1bfa8 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:16:12 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] VM Stopped (Lifecycle Event)
Aug 15 19:16:12 user nova-compute[73188]: DEBUG nova.compute.manager [None req-4fe17baf-e3d5-4f44-bc72-7ebf15c7e2f5 None None] [instance: 4cc14820-2d7d-4779-8d90-b77462f1bfa8] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:16:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:13 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:16:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "7f96acc3-0856-462e-9a32-879848f60a0e" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:16:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "7f96acc3-0856-462e-9a32-879848f60a0e" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:16:16 user nova-compute[73188]: INFO nova.compute.manager [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Rebooting instance
Aug 15 19:16:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "refresh_cache-7f96acc3-0856-462e-9a32-879848f60a0e" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:16:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquired lock "refresh_cache-7f96acc3-0856-462e-9a32-879848f60a0e" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:16:16 user nova-compute[73188]: DEBUG nova.network.neutron [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:16:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:16 user nova-compute[73188]: DEBUG nova.network.neutron [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Updating instance_info_cache with network_info: [{"id": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "address": "fa:16:3e:9b:51:30", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10933cb-e7", "ovs_interfaceid": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:16:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Releasing lock "refresh_cache-7f96acc3-0856-462e-9a32-879848f60a0e" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:16:16 user nova-compute[73188]: DEBUG nova.compute.manager [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:16:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-3e853e7e-b828-4495-b2c5-60d4e2b27daf req-e4234fa0-89a8-48a5-b29e-66d29ec2312a service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Received event network-vif-unplugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3e853e7e-b828-4495-b2c5-60d4e2b27daf req-e4234fa0-89a8-48a5-b29e-66d29ec2312a service nova] Acquiring lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3e853e7e-b828-4495-b2c5-60d4e2b27daf req-e4234fa0-89a8-48a5-b29e-66d29ec2312a service nova] Lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3e853e7e-b828-4495-b2c5-60d4e2b27daf req-e4234fa0-89a8-48a5-b29e-66d29ec2312a service nova] Lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-3e853e7e-b828-4495-b2c5-60d4e2b27daf req-e4234fa0-89a8-48a5-b29e-66d29ec2312a service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] No waiting events found dispatching network-vif-unplugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:16:17 user nova-compute[73188]: WARNING nova.compute.manager [req-3e853e7e-b828-4495-b2c5-60d4e2b27daf req-e4234fa0-89a8-48a5-b29e-66d29ec2312a service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Received unexpected event network-vif-unplugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 for instance with vm_state active and task_state reboot_started_hard.
Aug 15 19:16:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:17 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Instance destroyed successfully.
Aug 15 19:16:17 user nova-compute[73188]: DEBUG nova.objects.instance [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lazy-loading 'resources' on Instance uuid 7f96acc3-0856-462e-9a32-879848f60a0e {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-111252592',display_name='tempest-TestMinimumBasicScenario-server-111252592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-111252592',id=23,image_ref='db09264f-693e-42ea-ab97-9a80e0e3d7f0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzo1j4cBVFAovrT7TfUccrKZwiKQpZGTviawtl6Vd3nA7f6TnDYbJz/KfV9RA6oyc9t51QGzFgTfIWoGj/0yFu5Aw7Xq/O5Z50dyEYYFvMfClGGQzXjpVM891a+E+DfEw==',key_name='tempest-TestMinimumBasicScenario-48362326',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:13:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='575959aac5a1464dac98034bdb3bb948',ramdisk_id='',reservation_id='r-6e5ncuey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='db09264f-693e-42ea-ab97-9a80e0e3d7f0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1939446316',owner_user_name='tempest-TestMinimumBasicScenario-1939446316-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:16:17Z,user_data=None,user_id='9f7c7805c0754c61a5b9f8d16e28b228',uuid=7f96acc3-0856-462e-9a32-879848f60a0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "address": "fa:16:3e:9b:51:30", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10933cb-e7", "ovs_interfaceid": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Converting VIF {"id": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "address": "fa:16:3e:9b:51:30", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10933cb-e7", "ovs_interfaceid": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:51:30,bridge_name='br-int',has_traffic_filtering=True,id=c10933cb-e730-47f0-9b80-fcec4cf6c359,network=Network(a4981d47-8986-4ebf-a0cd-54692da9ff40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc10933cb-e7') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG os_vif [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:51:30,bridge_name='br-int',has_traffic_filtering=True,id=c10933cb-e730-47f0-9b80-fcec4cf6c359,network=Network(a4981d47-8986-4ebf-a0cd-54692da9ff40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc10933cb-e7') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc10933cb-e7, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:16:17 user nova-compute[73188]: INFO os_vif [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:51:30,bridge_name='br-int',has_traffic_filtering=True,id=c10933cb-e730-47f0-9b80-fcec4cf6c359,network=Network(a4981d47-8986-4ebf-a0cd-54692da9ff40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc10933cb-e7')
Aug 15 19:16:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ediQvCuF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:16:17 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:16:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd72930-e1e7-40b4-bca7-1d379799f991]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52009a1-0530-40f2-a8ce-c12f4a45f99d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:16:17 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:16:17 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:16:17 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:16:17 user nova-compute[73188]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:16:17 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:16:17 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:16:17 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:16:17 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:16:17 user nova-compute[73188]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:16:17 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f280817b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e'): ({'sdf'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Removing single pathed devices sdf {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[10651443-978c-44bd-b306-be8bba23c38d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[16aa40e2-1be6-4c00-9441-3b90f9c0942a]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Flushing IO for device /dev/sdf {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[56316b5b-994d-4a40-b1a6-4a2a5e98d827]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80f20ae-9a63-41fb-99a7-4893f1e4dde6]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] SCSI volumes sdf have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[042df547-b016-4eb0-a604-bf1387a1e663]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[92830f84-8e2f-4f76-8b27-6db676dfdd4f]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e, portal: 172.16.0.220,3260]
Aug 15 19:16:17 user nova-compute[73188]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e, portal: 172.16.0.220,3260] successful.
Aug 15 19:16:17 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4b1ad5-1c02-470c-95c8-bc7f4132ff26]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] <== disconnect_volume: return (376ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Start _get_guest_xml network_info=[{"id": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "address": "fa:16:3e:9b:51:30", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10933cb-e7", "ovs_interfaceid": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=db09264f-693e-42ea-ab97-9a80e0e3d7f0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'db09264f-693e-42ea-ab97-9a80e0e3d7f0'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ediQvCuF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '7f96acc3-0856-462e-9a32-879848f60a0e', 'attached_at': '', 'detached_at': '', 'volume_id': '7c1538e1-84d3-4ed6-b3c8-490387dc6e5e', 'serial': '7c1538e1-84d3-4ed6-b3c8-490387dc6e5e'}, 'attachment_id': 'ac9a7074-398f-4cc1-ad48-71d0f2c7016f', 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:16:17 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:16:17 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=db09264f-693e-42ea-ab97-9a80e0e3d7f0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG nova.objects.instance [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7f96acc3-0856-462e-9a32-879848f60a0e {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ediQvCuF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:16:18 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:16:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:16:18 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:16:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:16:18 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9295248-5ac8-461a-960b-9f7910b45d3b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:16:18 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8982148-46e3-448e-8d3f-aaf4a77daf80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e] added
Aug 15 19:16:18 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[549d6551-3363-49bc-afa0-93f6fc80fa84]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91ef331-2628-4bc2-9dca-d49b145bf7f1]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ediQvCuF {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ediQvCuF" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0401af7e-a88d-43c2-8a73-7dea359187cd]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ediQvCuF'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7512012c-e76c-4864-afc0-2359d44b35eb]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[24290485-c658-4c99-ae73-8815ffc5febd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:16:18 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:16:18 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:16:18 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:16:18 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:16:18 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:16:18 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:16:18 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:16:18 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b194eeeb-1089-46ae-bcfc-3b57118e199f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e, portal: 172.16.0.220,3260]
Aug 15 19:16:18 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e, portal: 172.16.0.220,3260] successful.
Aug 15 19:16:18 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[856a3e78-4915-4278-959e-b6e603444927]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[462388d9-c65a-4374-824f-957f5eba4a56]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:16:18 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:16:18 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:16:18 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:16:18 user nova-compute[73188]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:16:18 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:16:18 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:16:18 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:16:18 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:16:18 user nova-compute[73188]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:16:18 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[256dad25-0292-4c02-97b9-7365c9bdd82b]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: None {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:18 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Error from libvirt while getting description of instance-00000017: [Error Code 42] Domain not found: no domain with matching uuid '7f96acc3-0856-462e-9a32-879848f60a0e' (instance-00000017): libvirt.libvirtError: Domain not found: no domain with matching uuid '7f96acc3-0856-462e-9a32-879848f60a0e' (instance-00000017)
Aug 15 19:16:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG nova.compute.manager [req-6f6f1fd4-0500-470f-ab08-44209a661c0e req-e37bb6f8-35bc-4fa8-b16e-a79d3d2711d2 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Received event network-vif-plugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6f6f1fd4-0500-470f-ab08-44209a661c0e req-e37bb6f8-35bc-4fa8-b16e-a79d3d2711d2 service nova] Acquiring lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6f6f1fd4-0500-470f-ab08-44209a661c0e req-e37bb6f8-35bc-4fa8-b16e-a79d3d2711d2 service nova] Lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6f6f1fd4-0500-470f-ab08-44209a661c0e req-e37bb6f8-35bc-4fa8-b16e-a79d3d2711d2 service nova] Lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG nova.compute.manager [req-6f6f1fd4-0500-470f-ab08-44209a661c0e req-e37bb6f8-35bc-4fa8-b16e-a79d3d2711d2 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] No waiting events found dispatching network-vif-plugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:16:19 user nova-compute[73188]: WARNING nova.compute.manager [req-6f6f1fd4-0500-470f-ab08-44209a661c0e req-e37bb6f8-35bc-4fa8-b16e-a79d3d2711d2 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Received unexpected event network-vif-plugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 for instance with vm_state active and task_state reboot_started_hard.
Aug 15 19:16:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ediQvCuF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.431s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '23862313464666231', 'path': '/dev/sdf'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862313464666231', 'path': '/dev/sdf'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-111252592',display_name='tempest-TestMinimumBasicScenario-server-111252592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-111252592',id=23,image_ref='db09264f-693e-42ea-ab97-9a80e0e3d7f0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzo1j4cBVFAovrT7TfUccrKZwiKQpZGTviawtl6Vd3nA7f6TnDYbJz/KfV9RA6oyc9t51QGzFgTfIWoGj/0yFu5Aw7Xq/O5Z50dyEYYFvMfClGGQzXjpVM891a+E+DfEw==',key_name='tempest-TestMinimumBasicScenario-48362326',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:13:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='575959aac5a1464dac98034bdb3bb948',ramdisk_id='',reservation_id='r-6e5ncuey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='db09264f-693e-42ea-ab97-9a80e0e3d7f0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1939446316',owner_user_name='tempest-TestMinimumBasicScenario-1939446316-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:16:17Z,user_data=None,user_id='9f7c7805c0754c61a5b9f8d16e28b228',uuid=7f96acc3-0856-462e-9a32-879848f60a0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "address": "fa:16:3e:9b:51:30", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10933cb-e7", "ovs_interfaceid": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Converting VIF {"id": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "address": "fa:16:3e:9b:51:30", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10933cb-e7", "ovs_interfaceid": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:51:30,bridge_name='br-int',has_traffic_filtering=True,id=c10933cb-e730-47f0-9b80-fcec4cf6c359,network=Network(a4981d47-8986-4ebf-a0cd-54692da9ff40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc10933cb-e7') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG nova.objects.instance [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f96acc3-0856-462e-9a32-879848f60a0e {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:16:19 user nova-compute[73188]:   <uuid>7f96acc3-0856-462e-9a32-879848f60a0e</uuid>
Aug 15 19:16:19 user nova-compute[73188]:   <name>instance-00000017</name>
Aug 15 19:16:19 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:16:19 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:16:19 user nova-compute[73188]:   <metadata>
Aug 15 19:16:19 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:16:19 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:16:19 user nova-compute[73188]:       <nova:name>tempest-TestMinimumBasicScenario-server-111252592</nova:name>
Aug 15 19:16:19 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:16:17</nova:creationTime>
Aug 15 19:16:19 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:16:19 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:16:19 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:16:19 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:16:19 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:16:19 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:16:19 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:16:19 user nova-compute[73188]:       <nova:owner>
Aug 15 19:16:19 user nova-compute[73188]:         <nova:user uuid="9f7c7805c0754c61a5b9f8d16e28b228">tempest-TestMinimumBasicScenario-1939446316-project-member</nova:user>
Aug 15 19:16:19 user nova-compute[73188]:         <nova:project uuid="575959aac5a1464dac98034bdb3bb948">tempest-TestMinimumBasicScenario-1939446316</nova:project>
Aug 15 19:16:19 user nova-compute[73188]:       </nova:owner>
Aug 15 19:16:19 user nova-compute[73188]:       <nova:root type="image" uuid="db09264f-693e-42ea-ab97-9a80e0e3d7f0"/>
Aug 15 19:16:19 user nova-compute[73188]:       <nova:ports>
Aug 15 19:16:19 user nova-compute[73188]:         <nova:port uuid="c10933cb-e730-47f0-9b80-fcec4cf6c359">
Aug 15 19:16:19 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 19:16:19 user nova-compute[73188]:         </nova:port>
Aug 15 19:16:19 user nova-compute[73188]:       </nova:ports>
Aug 15 19:16:19 user nova-compute[73188]:     </nova:instance>
Aug 15 19:16:19 user nova-compute[73188]:   </metadata>
Aug 15 19:16:19 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:16:19 user nova-compute[73188]:     <system>
Aug 15 19:16:19 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:16:19 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:16:19 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:16:19 user nova-compute[73188]:       <entry name="serial">7f96acc3-0856-462e-9a32-879848f60a0e</entry>
Aug 15 19:16:19 user nova-compute[73188]:       <entry name="uuid">7f96acc3-0856-462e-9a32-879848f60a0e</entry>
Aug 15 19:16:19 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:16:19 user nova-compute[73188]:     </system>
Aug 15 19:16:19 user nova-compute[73188]:   </sysinfo>
Aug 15 19:16:19 user nova-compute[73188]:   <os>
Aug 15 19:16:19 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:16:19 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:16:19 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:16:19 user nova-compute[73188]:   </os>
Aug 15 19:16:19 user nova-compute[73188]:   <features>
Aug 15 19:16:19 user nova-compute[73188]:     <acpi/>
Aug 15 19:16:19 user nova-compute[73188]:     <apic/>
Aug 15 19:16:19 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:16:19 user nova-compute[73188]:   </features>
Aug 15 19:16:19 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:16:19 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:16:19 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:16:19 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:16:19 user nova-compute[73188]:   </clock>
Aug 15 19:16:19 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:16:19 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:16:19 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:16:19 user nova-compute[73188]:   </cpu>
Aug 15 19:16:19 user nova-compute[73188]:   <devices>
Aug 15 19:16:19 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:16:19 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:16:19 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk"/>
Aug 15 19:16:19 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:16:19 user nova-compute[73188]:     </disk>
Aug 15 19:16:19 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:16:19 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:16:19 user nova-compute[73188]:       <source dev="/dev/sdf"/>
Aug 15 19:16:19 user nova-compute[73188]:       <target dev="vdb" bus="virtio"/>
Aug 15 19:16:19 user nova-compute[73188]:       <serial>7c1538e1-84d3-4ed6-b3c8-490387dc6e5e</serial>
Aug 15 19:16:19 user nova-compute[73188]:     </disk>
Aug 15 19:16:19 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:16:19 user nova-compute[73188]:       <mac address="fa:16:3e:9b:51:30"/>
Aug 15 19:16:19 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:16:19 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:16:19 user nova-compute[73188]:       <target dev="tapc10933cb-e7"/>
Aug 15 19:16:19 user nova-compute[73188]:     </interface>
Aug 15 19:16:19 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:16:19 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/console.log" append="off"/>
Aug 15 19:16:19 user nova-compute[73188]:     </serial>
Aug 15 19:16:19 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:16:19 user nova-compute[73188]:     <video>
Aug 15 19:16:19 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:16:19 user nova-compute[73188]:     </video>
Aug 15 19:16:19 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:16:19 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:16:19 user nova-compute[73188]:     </rng>
Aug 15 19:16:19 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:16:19 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:16:19 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:16:19 user nova-compute[73188]:     </memballoon>
Aug 15 19:16:19 user nova-compute[73188]:   </devices>
Aug 15 19:16:19 user nova-compute[73188]: </domain>
Aug 15 19:16:19 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG nova.objects.instance [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7f96acc3-0856-462e-9a32-879848f60a0e {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84 --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84 --force-share --output=json" returned: 0 in 0.212s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Cannot resize image /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG nova.objects.instance [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lazy-loading 'migration_context' on Instance uuid 7f96acc3-0856-462e-9a32-879848f60a0e {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-111252592',display_name='tempest-TestMinimumBasicScenario-server-111252592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-111252592',id=23,image_ref='db09264f-693e-42ea-ab97-9a80e0e3d7f0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzo1j4cBVFAovrT7TfUccrKZwiKQpZGTviawtl6Vd3nA7f6TnDYbJz/KfV9RA6oyc9t51QGzFgTfIWoGj/0yFu5Aw7Xq/O5Z50dyEYYFvMfClGGQzXjpVM891a+E+DfEw==',key_name='tempest-TestMinimumBasicScenario-48362326',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:13:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='575959aac5a1464dac98034bdb3bb948',ramdisk_id='',reservation_id='r-6e5ncuey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='db09264f-693e-42ea-ab97-9a80e0e3d7f0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1939446316',owner_user_name='tempest-TestMinimumBasicScenario-1939446316-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:16:17Z,user_data=None,user_id='9f7c7805c0754c61a5b9f8d16e28b228',uuid=7f96acc3-0856-462e-9a32-879848f60a0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "address": "fa:16:3e:9b:51:30", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10933cb-e7", "ovs_interfaceid": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Converting VIF {"id": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "address": "fa:16:3e:9b:51:30", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10933cb-e7", "ovs_interfaceid": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:51:30,bridge_name='br-int',has_traffic_filtering=True,id=c10933cb-e730-47f0-9b80-fcec4cf6c359,network=Network(a4981d47-8986-4ebf-a0cd-54692da9ff40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc10933cb-e7') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG os_vif [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:51:30,bridge_name='br-int',has_traffic_filtering=True,id=c10933cb-e730-47f0-9b80-fcec4cf6c359,network=Network(a4981d47-8986-4ebf-a0cd-54692da9ff40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc10933cb-e7') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc10933cb-e7, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc10933cb-e7, col_values=(('external_ids', {'iface-id': 'c10933cb-e730-47f0-9b80-fcec4cf6c359', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:51:30', 'vm-uuid': '7f96acc3-0856-462e-9a32-879848f60a0e'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:20 user nova-compute[73188]: INFO os_vif [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:51:30,bridge_name='br-int',has_traffic_filtering=True,id=c10933cb-e730-47f0-9b80-fcec4cf6c359,network=Network(a4981d47-8986-4ebf-a0cd-54692da9ff40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc10933cb-e7')
Aug 15 19:16:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:16:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:21 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:16:21 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:16:21 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=7509MB free_disk=25.119049072265625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:16:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:16:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:16:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-3b98c86f-cb6b-4ba4-9982-8f61626a39c8 req-9817db0d-e60d-4fb1-ae7a-5af43778b7fd service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Received event network-vif-plugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3b98c86f-cb6b-4ba4-9982-8f61626a39c8 req-9817db0d-e60d-4fb1-ae7a-5af43778b7fd service nova] Acquiring lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3b98c86f-cb6b-4ba4-9982-8f61626a39c8 req-9817db0d-e60d-4fb1-ae7a-5af43778b7fd service nova] Lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3b98c86f-cb6b-4ba4-9982-8f61626a39c8 req-9817db0d-e60d-4fb1-ae7a-5af43778b7fd service nova] Lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-3b98c86f-cb6b-4ba4-9982-8f61626a39c8 req-9817db0d-e60d-4fb1-ae7a-5af43778b7fd service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] No waiting events found dispatching network-vif-plugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:16:22 user nova-compute[73188]: WARNING nova.compute.manager [req-3b98c86f-cb6b-4ba4-9982-8f61626a39c8 req-9817db0d-e60d-4fb1-ae7a-5af43778b7fd service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Received unexpected event network-vif-plugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 for instance with vm_state active and task_state reboot_started_hard.
Aug 15 19:16:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3d713d03-3e60-4dec-a295-a4652ac21842 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e00adf53-085f-436d-a09f-e97e92ca79cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance de6929cd-c95d-4964-b81c-96872a137f90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 139ccf1c-4792-4653-9475-c61b1f9c4846 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 215077af-60a1-4a82-b24e-1545349363d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 2a472af2-b10c-456b-8dba-6c75f3ab806a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 7f96acc3-0856-462e-9a32-879848f60a0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 0ee7de87-76ad-48ae-8bcd-93b2792a96cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ffccaa95-3c00-4635-989f-ac583171b072 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing inventories for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Updating ProviderTree inventory for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Updating inventory in ProviderTree for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing aggregate associations for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5, aggregates: None {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing trait associations for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:16:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.124s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:16:23 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:16:23 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:16:23 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:16:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:16:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:16:23 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:16:24 user nova-compute[73188]: DEBUG nova.compute.manager [req-b54b1fc9-a964-41be-b1c6-7177c1f8c96c req-498928fe-7537-4376-ae32-ae98f1b8fadd service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Received event network-vif-plugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:16:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b54b1fc9-a964-41be-b1c6-7177c1f8c96c req-498928fe-7537-4376-ae32-ae98f1b8fadd service nova] Acquiring lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:16:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b54b1fc9-a964-41be-b1c6-7177c1f8c96c req-498928fe-7537-4376-ae32-ae98f1b8fadd service nova] Lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:16:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b54b1fc9-a964-41be-b1c6-7177c1f8c96c req-498928fe-7537-4376-ae32-ae98f1b8fadd service nova] Lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:16:24 user nova-compute[73188]: DEBUG nova.compute.manager [req-b54b1fc9-a964-41be-b1c6-7177c1f8c96c req-498928fe-7537-4376-ae32-ae98f1b8fadd service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] No waiting events found dispatching network-vif-plugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:16:24 user nova-compute[73188]: WARNING nova.compute.manager [req-b54b1fc9-a964-41be-b1c6-7177c1f8c96c req-498928fe-7537-4376-ae32-ae98f1b8fadd service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Received unexpected event network-vif-plugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 for instance with vm_state active and task_state reboot_started_hard.
Aug 15 19:16:24 user nova-compute[73188]: DEBUG nova.compute.manager [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:16:24 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Removed pending event for 7f96acc3-0856-462e-9a32-879848f60a0e due to event {{(pid=73188) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 19:16:24 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126984.286276, 7f96acc3-0856-462e-9a32-879848f60a0e => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:16:24 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] VM Resumed (Lifecycle Event)
Aug 15 19:16:24 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Instance rebooted successfully.
Aug 15 19:16:24 user nova-compute[73188]: DEBUG nova.compute.manager [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:16:24 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:16:24 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:16:24 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 15 19:16:24 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692126984.2925327, 7f96acc3-0856-462e-9a32-879848f60a0e => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:16:24 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] VM Started (Lifecycle Event)
Aug 15 19:16:24 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:16:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-eaeafe47-260f-48b7-96ec-24eedcbf90f2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "7f96acc3-0856-462e-9a32-879848f60a0e" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.346s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:16:24 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:16:24 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Updating instance_info_cache with network_info: [{"id": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "address": "fa:16:3e:06:3e:cd", "network": {"id": "72ad2e88-4c2b-4cba-bfa5-801725bc0041", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824390140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b47c13ca2b84149926b814a26148366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf07c7de0-82", "ovs_interfaceid": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:16:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-de6929cd-c95d-4964-b81c-96872a137f90" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:16:24 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:16:24 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:16:24 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:16:24 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:16:24 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:16:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:25 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:16:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Cleaning up deleted instances {{(pid=73188) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 19:16:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] There are 0 instances to clean {{(pid=73188) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 19:16:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:27 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:16:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=73188) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 19:16:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "ffccaa95-3c00-4635-989f-ac583171b072" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:16:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "ffccaa95-3c00-4635-989f-ac583171b072" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:16:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "ffccaa95-3c00-4635-989f-ac583171b072-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:16:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "ffccaa95-3c00-4635-989f-ac583171b072-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:16:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "ffccaa95-3c00-4635-989f-ac583171b072-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:16:29 user nova-compute[73188]: INFO nova.compute.manager [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Terminating instance
Aug 15 19:16:29 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:16:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:29 user nova-compute[73188]: DEBUG nova.compute.manager [req-2edeec8a-03b7-4f7e-9c4b-4dd77fc363f6 req-0a2be4a4-82c4-483a-a2a7-d96994801136 service nova] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Received event network-vif-unplugged-105f246b-e2cf-4741-a8b5-691615cce8e9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:16:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2edeec8a-03b7-4f7e-9c4b-4dd77fc363f6 req-0a2be4a4-82c4-483a-a2a7-d96994801136 service nova] Acquiring lock "ffccaa95-3c00-4635-989f-ac583171b072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:16:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2edeec8a-03b7-4f7e-9c4b-4dd77fc363f6 req-0a2be4a4-82c4-483a-a2a7-d96994801136 service nova] Lock "ffccaa95-3c00-4635-989f-ac583171b072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:16:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2edeec8a-03b7-4f7e-9c4b-4dd77fc363f6 req-0a2be4a4-82c4-483a-a2a7-d96994801136 service nova] Lock "ffccaa95-3c00-4635-989f-ac583171b072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:16:29 user nova-compute[73188]: DEBUG nova.compute.manager [req-2edeec8a-03b7-4f7e-9c4b-4dd77fc363f6 req-0a2be4a4-82c4-483a-a2a7-d96994801136 service nova] [instance: ffccaa95-3c00-4635-989f-ac583171b072] No waiting events found dispatching network-vif-unplugged-105f246b-e2cf-4741-a8b5-691615cce8e9 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:16:29 user nova-compute[73188]: DEBUG nova.compute.manager [req-2edeec8a-03b7-4f7e-9c4b-4dd77fc363f6 req-0a2be4a4-82c4-483a-a2a7-d96994801136 service nova] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Received event network-vif-unplugged-105f246b-e2cf-4741-a8b5-691615cce8e9 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:30 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Instance destroyed successfully.
Aug 15 19:16:30 user nova-compute[73188]: DEBUG nova.objects.instance [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lazy-loading 'resources' on Instance uuid ffccaa95-3c00-4635-989f-ac583171b072 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:14:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-155103971',display_name='tempest-TestVolumeBootPattern-server-155103971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-155103971',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:14:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18eadba32f4547ad9436aca9285b7aad',ramdisk_id='',reservation_id='r-1atdvk8s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2114363476',owner_user_name='tempest-TestVolumeBootPattern-2114363476-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:14:59Z,user_data=None,user_id='9503705066e5402cb569fae3b2bd8976',uuid=ffccaa95-3c00-4635-989f-ac583171b072,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "105f246b-e2cf-4741-a8b5-691615cce8e9", "address": "fa:16:3e:86:6c:6a", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap105f246b-e2", "ovs_interfaceid": "105f246b-e2cf-4741-a8b5-691615cce8e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converting VIF {"id": "105f246b-e2cf-4741-a8b5-691615cce8e9", "address": "fa:16:3e:86:6c:6a", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap105f246b-e2", "ovs_interfaceid": "105f246b-e2cf-4741-a8b5-691615cce8e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:6c:6a,bridge_name='br-int',has_traffic_filtering=True,id=105f246b-e2cf-4741-a8b5-691615cce8e9,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap105f246b-e2') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG os_vif [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:6c:6a,bridge_name='br-int',has_traffic_filtering=True,id=105f246b-e2cf-4741-a8b5-691615cce8e9,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap105f246b-e2') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap105f246b-e2, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:16:30 user nova-compute[73188]: INFO os_vif [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:6c:6a,bridge_name='br-int',has_traffic_filtering=True,id=105f246b-e2cf-4741-a8b5-691615cce8e9,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap105f246b-e2')
Aug 15 19:16:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DyLmXtes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:16:30 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:16:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e64a69-f798-4602-a6e2-1f9f97ced54a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b16c3e-e216-4b5f-b5fc-7e16124c8ede]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:16:30 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:16:30 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:16:30 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:16:30 user nova-compute[73188]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:16:30 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:16:30 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:16:30 user nova-compute[73188]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c (non-flash)
Aug 15 19:16:30 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:16:30 user nova-compute[73188]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:16:30 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28082b8040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c'): ({'sdd'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Removing single pathed devices sdd {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[35eddcf6-b3b8-462a-9ac5-c8d4d81f44af]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f31685d-445b-4ccd-8662-d08fec568d6e]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Flushing IO for device /dev/sdd {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c4d7fb-7959-4654-a3cf-7ee22727deae]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a57056-cceb-499d-96f9-a06f3856970f]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] SCSI volumes sdd have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO5021c887-afb509fb217770cd', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5021c887', '/dev/disk/by-id/scsi-26166623530396662') {{(pid=83967) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c675a82-54af-4bcd-8010-c6eafdd067c5]: (4, None) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[804c140f-cf89-441f-b029-d7109c69f736]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[895e9693-4136-4347-88bf-b2bd6f8a8c12]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c, portal: 172.16.0.220,3260]
Aug 15 19:16:30 user nova-compute[73188]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c, portal: 172.16.0.220,3260] successful.
Aug 15 19:16:30 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab64cf4d-162b-48c4-9117-8add14d4247c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1344ca-1293-4cbe-bc91-d9c0826f5b39]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] <== disconnect_volume: return (329ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:16:30 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Deleting instance files /opt/stack/data/nova/instances/ffccaa95-3c00-4635-989f-ac583171b072_del
Aug 15 19:16:30 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Deletion of /opt/stack/data/nova/instances/ffccaa95-3c00-4635-989f-ac583171b072_del complete
Aug 15 19:16:30 user nova-compute[73188]: INFO nova.compute.manager [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 15 19:16:30 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:16:30 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: ffccaa95-3c00-4635-989f-ac583171b072] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:16:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:31 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:16:31 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Took 0.62 seconds to deallocate network for instance.
Aug 15 19:16:32 user nova-compute[73188]: DEBUG nova.compute.manager [req-18694cfe-9cf3-4abf-b645-30f1786ac59f req-0402f466-279f-43de-9e8c-cdc502dcccae service nova] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Received event network-vif-plugged-105f246b-e2cf-4741-a8b5-691615cce8e9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:16:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-18694cfe-9cf3-4abf-b645-30f1786ac59f req-0402f466-279f-43de-9e8c-cdc502dcccae service nova] Acquiring lock "ffccaa95-3c00-4635-989f-ac583171b072-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:16:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-18694cfe-9cf3-4abf-b645-30f1786ac59f req-0402f466-279f-43de-9e8c-cdc502dcccae service nova] Lock "ffccaa95-3c00-4635-989f-ac583171b072-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:16:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-18694cfe-9cf3-4abf-b645-30f1786ac59f req-0402f466-279f-43de-9e8c-cdc502dcccae service nova] Lock "ffccaa95-3c00-4635-989f-ac583171b072-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:16:32 user nova-compute[73188]: DEBUG nova.compute.manager [req-18694cfe-9cf3-4abf-b645-30f1786ac59f req-0402f466-279f-43de-9e8c-cdc502dcccae service nova] [instance: ffccaa95-3c00-4635-989f-ac583171b072] No waiting events found dispatching network-vif-plugged-105f246b-e2cf-4741-a8b5-691615cce8e9 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:16:32 user nova-compute[73188]: WARNING nova.compute.manager [req-18694cfe-9cf3-4abf-b645-30f1786ac59f req-0402f466-279f-43de-9e8c-cdc502dcccae service nova] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Received unexpected event network-vif-plugged-105f246b-e2cf-4741-a8b5-691615cce8e9 for instance with vm_state active and task_state deleting.
Aug 15 19:16:32 user nova-compute[73188]: DEBUG nova.compute.manager [req-18694cfe-9cf3-4abf-b645-30f1786ac59f req-0402f466-279f-43de-9e8c-cdc502dcccae service nova] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Received event network-vif-deleted-105f246b-e2cf-4741-a8b5-691615cce8e9 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:16:32 user nova-compute[73188]: INFO nova.compute.manager [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Took 1.02 seconds to detach 1 volumes for instance.
Aug 15 19:16:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Deleting volume: ab64cf4d-162b-48c4-9117-8add14d4247c {{(pid=73188) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 19:16:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:16:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:16:32 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:16:32 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:16:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:16:33 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Deleted allocations for instance ffccaa95-3c00-4635-989f-ac583171b072
Aug 15 19:16:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e26260b2-8375-4ed4-a1c6-f11bde9e8b8b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "ffccaa95-3c00-4635-989f-ac583171b072" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.561s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:16:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquiring lock "de6929cd-c95d-4964-b81c-96872a137f90" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:16:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "de6929cd-c95d-4964-b81c-96872a137f90" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:16:38 user nova-compute[73188]: INFO nova.compute.manager [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Detaching volume a79f2e74-d8ef-433b-914a-1f0714b0e6a5
Aug 15 19:16:38 user nova-compute[73188]: INFO nova.virt.block_device [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Attempting to driver detach volume a79f2e74-d8ef-433b-914a-1f0714b0e6a5 from mountpoint /dev/vdb
Aug 15 19:16:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Attempting to detach device vdb from instance de6929cd-c95d-4964-b81c-96872a137f90 from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:16:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:16:38 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:16:38 user nova-compute[73188]:   <source dev="/dev/sdc"/>
Aug 15 19:16:38 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:16:38 user nova-compute[73188]:   <serial>a79f2e74-d8ef-433b-914a-1f0714b0e6a5</serial>
Aug 15 19:16:38 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:16:38 user nova-compute[73188]: </disk>
Aug 15 19:16:38 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:16:38 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Successfully detached device vdb from instance de6929cd-c95d-4964-b81c-96872a137f90 from the persistent domain config.
Aug 15 19:16:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de6929cd-c95d-4964-b81c-96872a137f90 from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:16:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:16:38 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:16:38 user nova-compute[73188]:   <source dev="/dev/sdc"/>
Aug 15 19:16:38 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:16:38 user nova-compute[73188]:   <serial>a79f2e74-d8ef-433b-914a-1f0714b0e6a5</serial>
Aug 15 19:16:38 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:16:38 user nova-compute[73188]: </disk>
Aug 15 19:16:38 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692126999.4214492, de6929cd-c95d-4964-b81c-96872a137f90 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de6929cd-c95d-4964-b81c-96872a137f90 {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:16:39 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Successfully detached device vdb from instance de6929cd-c95d-4964-b81c-96872a137f90 from the live domain config.
Aug 15 19:16:39 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGkZntzH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:16:39 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:16:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4470e1a9-6431-4843-a656-4ff0116949ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[133897fa-3bd7-4cff-876b-5dfa550ffc4c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:16:39 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:16:39 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:16:39 user nova-compute[73188]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:16:39 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:16:39 user nova-compute[73188]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 (non-flash)
Aug 15 19:16:39 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:16:39 user nova-compute[73188]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:16:39 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e47f6e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5'): ({'sdc'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Removing single pathed devices sdc {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9cae95-08df-46b9-bb35-0ab15c9abc71]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5801b562-f7a8-4f97-aafb-dd1292a877a8]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Flushing IO for device /dev/sdc {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6054ac-8075-4021-92aa-689db001b0cb]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ec35c4-ff90-432b-96d8-63010fe64e01]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] SCSI volumes sdc have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d829a0-ee4f-49c8-a139-49f919a3a9f3]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5b8496-8df6-4e5b-85d4-a0b364b300bb]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5, portal: 172.16.0.220,3260]
Aug 15 19:16:39 user nova-compute[73188]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5, portal: 172.16.0.220,3260] successful.
Aug 15 19:16:39 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a79f2e74-d8ef-433b-914a-1f0714b0e6a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce6a52b-097d-4b1b-b894-608c89ccd559]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] <== disconnect_volume: return (262ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:16:39 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:16:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:40 user nova-compute[73188]: DEBUG nova.objects.instance [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lazy-loading 'flavor' on Instance uuid de6929cd-c95d-4964-b81c-96872a137f90 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:16:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5af7a220-ad62-46d2-9b33-ec07396831c5 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "de6929cd-c95d-4964-b81c-96872a137f90" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.649s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:16:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:45 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692126990.3299417, ffccaa95-3c00-4635-989f-ac583171b072 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:16:45 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: ffccaa95-3c00-4635-989f-ac583171b072] VM Stopped (Lifecycle Event)
Aug 15 19:16:45 user nova-compute[73188]: DEBUG nova.compute.manager [None req-78d8e68b-782a-4984-90cf-a36c5d6f9719 None None] [instance: ffccaa95-3c00-4635-989f-ac583171b072] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:16:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:16:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:16:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:16:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:16:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:16:52 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:16:52 user nova-compute[73188]: INFO nova.compute.claims [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Claim successful on node user
Aug 15 19:16:52 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:16:52 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:16:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:16:52 user nova-compute[73188]: DEBUG nova.compute.manager [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:16:52 user nova-compute[73188]: DEBUG nova.compute.manager [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:16:52 user nova-compute[73188]: DEBUG nova.network.neutron [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:16:52 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:16:52 user nova-compute[73188]: DEBUG nova.compute.manager [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:16:52 user nova-compute[73188]: INFO nova.virt.block_device [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Booting with volume-backed-image f00e830a-b2ca-4a70-976f-0b43c7345f1b at /dev/vda
Aug 15 19:16:52 user nova-compute[73188]: DEBUG nova.policy [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bad952eceaec400396fd0a28c438c761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab4e1cccd434f6c83f2f9e4687d274e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:16:53 user nova-compute[73188]: DEBUG nova.network.neutron [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Successfully created port: 6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:16:55 user nova-compute[73188]: DEBUG nova.network.neutron [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Successfully updated port: 6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:16:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "refresh_cache-7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:16:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquired lock "refresh_cache-7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:16:55 user nova-compute[73188]: DEBUG nova.network.neutron [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:16:55 user nova-compute[73188]: DEBUG nova.compute.manager [req-0c772ea4-e50a-4f7d-aaec-018ccbc65bbd req-dee9d7f5-032a-4c4a-ab84-e6a13db1dee1 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received event network-changed-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:16:55 user nova-compute[73188]: DEBUG nova.compute.manager [req-0c772ea4-e50a-4f7d-aaec-018ccbc65bbd req-dee9d7f5-032a-4c4a-ab84-e6a13db1dee1 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Refreshing instance network info cache due to event network-changed-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:16:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0c772ea4-e50a-4f7d-aaec-018ccbc65bbd req-dee9d7f5-032a-4c4a-ab84-e6a13db1dee1 service nova] Acquiring lock "refresh_cache-7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:16:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:55 user nova-compute[73188]: DEBUG nova.network.neutron [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:16:55 user nova-compute[73188]: DEBUG nova.network.neutron [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Updating instance_info_cache with network_info: [{"id": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "address": "fa:16:3e:11:3f:a6", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da073c1-08", "ovs_interfaceid": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:16:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Releasing lock "refresh_cache-7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:16:55 user nova-compute[73188]: DEBUG nova.compute.manager [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Instance network_info: |[{"id": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "address": "fa:16:3e:11:3f:a6", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da073c1-08", "ovs_interfaceid": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:16:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0c772ea4-e50a-4f7d-aaec-018ccbc65bbd req-dee9d7f5-032a-4c4a-ab84-e6a13db1dee1 service nova] Acquired lock "refresh_cache-7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:16:55 user nova-compute[73188]: DEBUG nova.network.neutron [req-0c772ea4-e50a-4f7d-aaec-018ccbc65bbd req-dee9d7f5-032a-4c4a-ab84-e6a13db1dee1 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Refreshing network info cache for port 6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:16:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:16:56 user nova-compute[73188]: DEBUG nova.network.neutron [req-0c772ea4-e50a-4f7d-aaec-018ccbc65bbd req-dee9d7f5-032a-4c4a-ab84-e6a13db1dee1 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Updated VIF entry in instance network info cache for port 6da073c1-0834-4a3c-92e1-9d89e1bc5fe0. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:16:56 user nova-compute[73188]: DEBUG nova.network.neutron [req-0c772ea4-e50a-4f7d-aaec-018ccbc65bbd req-dee9d7f5-032a-4c4a-ab84-e6a13db1dee1 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Updating instance_info_cache with network_info: [{"id": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "address": "fa:16:3e:11:3f:a6", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da073c1-08", "ovs_interfaceid": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:16:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0c772ea4-e50a-4f7d-aaec-018ccbc65bbd req-dee9d7f5-032a-4c4a-ab84-e6a13db1dee1 service nova] Releasing lock "refresh_cache-7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:16:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:03 user nova-compute[73188]: DEBUG os_brick.utils [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:17:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:03 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d53cb0-cf8d-4677-a6b2-261805016eb6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:17:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:03 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[64623cec-5f62-42e3-b76c-dd179d3f04ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:17:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:03 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[586a7d46-1f05-4b7b-9586-c41682288c13]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:17:03 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dca3ee9-3f1a-4ea9-b55c-e0a589486c7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:17:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:17:03 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:17:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:17:03 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:17:03 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dd22aa-6e19-4408-9107-af5a24848a50]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:17:03 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:17:03 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:17:03 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:17:03 user nova-compute[73188]: DEBUG os_brick.utils [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:17:03 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Updating existing volume attachment record: 615331b7-1251-4794-bbd0-624556fbd0be {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:17:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:07 user nova-compute[73188]: INFO nova.compute.manager [None req-72868796-68dc-4a52-886a-05b3d61a80ec tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Unrescuing
Aug 15 19:17:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-72868796-68dc-4a52-886a-05b3d61a80ec tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "refresh_cache-139ccf1c-4792-4653-9475-c61b1f9c4846" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:17:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-72868796-68dc-4a52-886a-05b3d61a80ec tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquired lock "refresh_cache-139ccf1c-4792-4653-9475-c61b1f9c4846" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:17:07 user nova-compute[73188]: DEBUG nova.network.neutron [None req-72868796-68dc-4a52-886a-05b3d61a80ec tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:17:07 user nova-compute[73188]: DEBUG nova.network.neutron [None req-72868796-68dc-4a52-886a-05b3d61a80ec tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Updating instance_info_cache with network_info: [{"id": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "address": "fa:16:3e:49:14:b8", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2485f75-d3", "ovs_interfaceid": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:17:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-72868796-68dc-4a52-886a-05b3d61a80ec tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Releasing lock "refresh_cache-139ccf1c-4792-4653-9475-c61b1f9c4846" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:17:07 user nova-compute[73188]: DEBUG nova.objects.instance [None req-72868796-68dc-4a52-886a-05b3d61a80ec tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'flavor' on Instance uuid 139ccf1c-4792-4653-9475-c61b1f9c4846 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:17:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-2e20eac1-d119-4ff0-baac-2bb9c6ecc828 req-0372858e-24ce-49ca-af32-f3ab9a4edf53 service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received event network-vif-unplugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:17:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2e20eac1-d119-4ff0-baac-2bb9c6ecc828 req-0372858e-24ce-49ca-af32-f3ab9a4edf53 service nova] Acquiring lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2e20eac1-d119-4ff0-baac-2bb9c6ecc828 req-0372858e-24ce-49ca-af32-f3ab9a4edf53 service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2e20eac1-d119-4ff0-baac-2bb9c6ecc828 req-0372858e-24ce-49ca-af32-f3ab9a4edf53 service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-2e20eac1-d119-4ff0-baac-2bb9c6ecc828 req-0372858e-24ce-49ca-af32-f3ab9a4edf53 service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] No waiting events found dispatching network-vif-unplugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:17:08 user nova-compute[73188]: WARNING nova.compute.manager [req-2e20eac1-d119-4ff0-baac-2bb9c6ecc828 req-0372858e-24ce-49ca-af32-f3ab9a4edf53 service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received unexpected event network-vif-unplugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 for instance with vm_state rescued and task_state unrescuing.
Aug 15 19:17:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:08 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Instance destroyed successfully.
Aug 15 19:17:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:09 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:17:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:09 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:17:09 user nova-compute[73188]: INFO nova.compute.claims [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Claim successful on node user
Aug 15 19:17:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:10 user nova-compute[73188]: DEBUG nova.compute.manager [req-c7a74ada-f5da-4a86-abc3-de493192bfe3 req-b07e465b-3875-4d4a-8a66-e1d005533e6e service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received event network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:17:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c7a74ada-f5da-4a86-abc3-de493192bfe3 req-b07e465b-3875-4d4a-8a66-e1d005533e6e service nova] Acquiring lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c7a74ada-f5da-4a86-abc3-de493192bfe3 req-b07e465b-3875-4d4a-8a66-e1d005533e6e service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c7a74ada-f5da-4a86-abc3-de493192bfe3 req-b07e465b-3875-4d4a-8a66-e1d005533e6e service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:10 user nova-compute[73188]: DEBUG nova.compute.manager [req-c7a74ada-f5da-4a86-abc3-de493192bfe3 req-b07e465b-3875-4d4a-8a66-e1d005533e6e service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] No waiting events found dispatching network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:17:10 user nova-compute[73188]: WARNING nova.compute.manager [req-c7a74ada-f5da-4a86-abc3-de493192bfe3 req-b07e465b-3875-4d4a-8a66-e1d005533e6e service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received unexpected event network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 for instance with vm_state rescued and task_state unrescuing.
Aug 15 19:17:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:10 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:17:10 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:17:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.784s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:17:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:17:10 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:17:10 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:17:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:17:11 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:17:11 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:17:11 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Creating image(s)
Aug 15 19:17:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "/opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "/opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.237s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:11 user nova-compute[73188]: DEBUG nova.policy [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae5b2b05980944af80c4ffe09cd20de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399c3c31298f41dbb11ae1c0bc593e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:17:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk 1073741824" returned: 0 in 0.057s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.185s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:11 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:17:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:12 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Cannot resize image /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:17:12 user nova-compute[73188]: DEBUG nova.objects.instance [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'migration_context' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:17:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:17:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Ensure instance console log exists: /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:17:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:12 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Successfully created port: 0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:17:12 user nova-compute[73188]: DEBUG nova.compute.manager [req-37c4c9a9-1c2c-4c2a-9907-40e389dc62bc req-269eca84-fa0e-4f11-a464-fb48ca0878fa service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received event network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:17:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-37c4c9a9-1c2c-4c2a-9907-40e389dc62bc req-269eca84-fa0e-4f11-a464-fb48ca0878fa service nova] Acquiring lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-37c4c9a9-1c2c-4c2a-9907-40e389dc62bc req-269eca84-fa0e-4f11-a464-fb48ca0878fa service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-37c4c9a9-1c2c-4c2a-9907-40e389dc62bc req-269eca84-fa0e-4f11-a464-fb48ca0878fa service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:12 user nova-compute[73188]: DEBUG nova.compute.manager [req-37c4c9a9-1c2c-4c2a-9907-40e389dc62bc req-269eca84-fa0e-4f11-a464-fb48ca0878fa service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] No waiting events found dispatching network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:17:12 user nova-compute[73188]: WARNING nova.compute.manager [req-37c4c9a9-1c2c-4c2a-9907-40e389dc62bc req-269eca84-fa0e-4f11-a464-fb48ca0878fa service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received unexpected event network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 for instance with vm_state rescued and task_state unrescuing.
Aug 15 19:17:12 user nova-compute[73188]: DEBUG nova.compute.manager [req-37c4c9a9-1c2c-4c2a-9907-40e389dc62bc req-269eca84-fa0e-4f11-a464-fb48ca0878fa service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received event network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:17:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-37c4c9a9-1c2c-4c2a-9907-40e389dc62bc req-269eca84-fa0e-4f11-a464-fb48ca0878fa service nova] Acquiring lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-37c4c9a9-1c2c-4c2a-9907-40e389dc62bc req-269eca84-fa0e-4f11-a464-fb48ca0878fa service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-37c4c9a9-1c2c-4c2a-9907-40e389dc62bc req-269eca84-fa0e-4f11-a464-fb48ca0878fa service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:12 user nova-compute[73188]: DEBUG nova.compute.manager [req-37c4c9a9-1c2c-4c2a-9907-40e389dc62bc req-269eca84-fa0e-4f11-a464-fb48ca0878fa service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] No waiting events found dispatching network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:17:12 user nova-compute[73188]: WARNING nova.compute.manager [req-37c4c9a9-1c2c-4c2a-9907-40e389dc62bc req-269eca84-fa0e-4f11-a464-fb48ca0878fa service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received unexpected event network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 for instance with vm_state rescued and task_state unrescuing.
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Removed pending event for 139ccf1c-4792-4653-9475-c61b1f9c4846 due to event {{(pid=73188) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127033.180669, 139ccf1c-4792-4653-9475-c61b1f9c4846 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:17:13 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] VM Resumed (Lifecycle Event)
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-72868796-68dc-4a52-886a-05b3d61a80ec tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:17:13 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127033.1812887, 139ccf1c-4792-4653-9475-c61b1f9c4846 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:17:13 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] VM Started (Lifecycle Event)
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Successfully updated port: 0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "refresh_cache-b3dd183e-7ab1-40ae-b282-40575a9e47df" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquired lock "refresh_cache-b3dd183e-7ab1-40ae-b282-40575a9e47df" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.compute.manager [req-ccd43ae0-e6a9-40d2-a466-805ad8b7e01c req-1073d628-9209-44d4-8b41-c1345c6e3e6f service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received event network-changed-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.compute.manager [req-ccd43ae0-e6a9-40d2-a466-805ad8b7e01c req-1073d628-9209-44d4-8b41-c1345c6e3e6f service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Refreshing instance network info cache due to event network-changed-0546e618-e785-46c7-aa82-d527ec295deb. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ccd43ae0-e6a9-40d2-a466-805ad8b7e01c req-1073d628-9209-44d4-8b41-c1345c6e3e6f service nova] Acquiring lock "refresh_cache-b3dd183e-7ab1-40ae-b282-40575a9e47df" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Updating instance_info_cache with network_info: [{"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Releasing lock "refresh_cache-b3dd183e-7ab1-40ae-b282-40575a9e47df" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Instance network_info: |[{"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ccd43ae0-e6a9-40d2-a466-805ad8b7e01c req-1073d628-9209-44d4-8b41-c1345c6e3e6f service nova] Acquired lock "refresh_cache-b3dd183e-7ab1-40ae-b282-40575a9e47df" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.network.neutron [req-ccd43ae0-e6a9-40d2-a466-805ad8b7e01c req-1073d628-9209-44d4-8b41-c1345c6e3e6f service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Refreshing network info cache for port 0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Start _get_guest_xml network_info=[{"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:17:13 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:17:13 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-10055614',display_name='tempest-AttachVolumeTestJSON-server-10055614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-10055614',id=28,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMQScQjuREEUf8BduiZ5KX0osvQ5QWZEC23alXhUk4mA8l8fA2zn02jcheLrGtQU0hVs1wuTRm/gfQIlRP/+vodTg9/qG3oTDrK2DQcQ9kCcFR8/YFg4QfP/P5iwNCjNg==',key_name='tempest-keypair-229082612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='399c3c31298f41dbb11ae1c0bc593e1f',ramdisk_id='',reservation_id='r-jd0udn2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-953696987',owner_user_name='tempest-AttachVolumeTestJSON-953696987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:17:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae5b2b05980944af80c4ffe09cd20de1',uuid=b3dd183e-7ab1-40ae-b282-40575a9e47df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converting VIF {"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:98,bridge_name='br-int',has_traffic_filtering=True,id=0546e618-e785-46c7-aa82-d527ec295deb,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0546e618-e7') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.objects.instance [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'pci_devices' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:17:13 user nova-compute[73188]:   <uuid>b3dd183e-7ab1-40ae-b282-40575a9e47df</uuid>
Aug 15 19:17:13 user nova-compute[73188]:   <name>instance-0000001c</name>
Aug 15 19:17:13 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:17:13 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:17:13 user nova-compute[73188]:   <metadata>
Aug 15 19:17:13 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:17:13 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:17:13 user nova-compute[73188]:       <nova:name>tempest-AttachVolumeTestJSON-server-10055614</nova:name>
Aug 15 19:17:13 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:17:13</nova:creationTime>
Aug 15 19:17:13 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:17:13 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:17:13 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:17:13 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:17:13 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:17:13 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:17:13 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:17:13 user nova-compute[73188]:       <nova:owner>
Aug 15 19:17:13 user nova-compute[73188]:         <nova:user uuid="ae5b2b05980944af80c4ffe09cd20de1">tempest-AttachVolumeTestJSON-953696987-project-member</nova:user>
Aug 15 19:17:13 user nova-compute[73188]:         <nova:project uuid="399c3c31298f41dbb11ae1c0bc593e1f">tempest-AttachVolumeTestJSON-953696987</nova:project>
Aug 15 19:17:13 user nova-compute[73188]:       </nova:owner>
Aug 15 19:17:13 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:17:13 user nova-compute[73188]:       <nova:ports>
Aug 15 19:17:13 user nova-compute[73188]:         <nova:port uuid="0546e618-e785-46c7-aa82-d527ec295deb">
Aug 15 19:17:13 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 19:17:13 user nova-compute[73188]:         </nova:port>
Aug 15 19:17:13 user nova-compute[73188]:       </nova:ports>
Aug 15 19:17:13 user nova-compute[73188]:     </nova:instance>
Aug 15 19:17:13 user nova-compute[73188]:   </metadata>
Aug 15 19:17:13 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:17:13 user nova-compute[73188]:     <system>
Aug 15 19:17:13 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:17:13 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:17:13 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:17:13 user nova-compute[73188]:       <entry name="serial">b3dd183e-7ab1-40ae-b282-40575a9e47df</entry>
Aug 15 19:17:13 user nova-compute[73188]:       <entry name="uuid">b3dd183e-7ab1-40ae-b282-40575a9e47df</entry>
Aug 15 19:17:13 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:17:13 user nova-compute[73188]:     </system>
Aug 15 19:17:13 user nova-compute[73188]:   </sysinfo>
Aug 15 19:17:13 user nova-compute[73188]:   <os>
Aug 15 19:17:13 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:17:13 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:17:13 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:17:13 user nova-compute[73188]:   </os>
Aug 15 19:17:13 user nova-compute[73188]:   <features>
Aug 15 19:17:13 user nova-compute[73188]:     <acpi/>
Aug 15 19:17:13 user nova-compute[73188]:     <apic/>
Aug 15 19:17:13 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:17:13 user nova-compute[73188]:   </features>
Aug 15 19:17:13 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:17:13 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:17:13 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:17:13 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:17:13 user nova-compute[73188]:   </clock>
Aug 15 19:17:13 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:17:13 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:17:13 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:17:13 user nova-compute[73188]:   </cpu>
Aug 15 19:17:13 user nova-compute[73188]:   <devices>
Aug 15 19:17:13 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:17:13 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:17:13 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk"/>
Aug 15 19:17:13 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:17:13 user nova-compute[73188]:     </disk>
Aug 15 19:17:13 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:17:13 user nova-compute[73188]:       <mac address="fa:16:3e:d9:51:98"/>
Aug 15 19:17:13 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:17:13 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:17:13 user nova-compute[73188]:       <target dev="tap0546e618-e7"/>
Aug 15 19:17:13 user nova-compute[73188]:     </interface>
Aug 15 19:17:13 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:17:13 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/console.log" append="off"/>
Aug 15 19:17:13 user nova-compute[73188]:     </serial>
Aug 15 19:17:13 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:17:13 user nova-compute[73188]:     <video>
Aug 15 19:17:13 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:17:13 user nova-compute[73188]:     </video>
Aug 15 19:17:13 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:17:13 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:17:13 user nova-compute[73188]:     </rng>
Aug 15 19:17:13 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:17:13 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:17:13 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:17:13 user nova-compute[73188]:     </memballoon>
Aug 15 19:17:13 user nova-compute[73188]:   </devices>
Aug 15 19:17:13 user nova-compute[73188]: </domain>
Aug 15 19:17:13 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-10055614',display_name='tempest-AttachVolumeTestJSON-server-10055614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-10055614',id=28,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMQScQjuREEUf8BduiZ5KX0osvQ5QWZEC23alXhUk4mA8l8fA2zn02jcheLrGtQU0hVs1wuTRm/gfQIlRP/+vodTg9/qG3oTDrK2DQcQ9kCcFR8/YFg4QfP/P5iwNCjNg==',key_name='tempest-keypair-229082612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='399c3c31298f41dbb11ae1c0bc593e1f',ramdisk_id='',reservation_id='r-jd0udn2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-953696987',owner_user_name='tempest-AttachVolumeTestJSON-953696987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:17:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae5b2b05980944af80c4ffe09cd20de1',uuid=b3dd183e-7ab1-40ae-b282-40575a9e47df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converting VIF {"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:98,bridge_name='br-int',has_traffic_filtering=True,id=0546e618-e785-46c7-aa82-d527ec295deb,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0546e618-e7') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG os_vif [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:98,bridge_name='br-int',has_traffic_filtering=True,id=0546e618-e785-46c7-aa82-d527ec295deb,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0546e618-e7') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0546e618-e7, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0546e618-e7, col_values=(('external_ids', {'iface-id': '0546e618-e785-46c7-aa82-d527ec295deb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:51:98', 'vm-uuid': 'b3dd183e-7ab1-40ae-b282-40575a9e47df'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:13 user nova-compute[73188]: INFO os_vif [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:98,bridge_name='br-int',has_traffic_filtering=True,id=0546e618-e785-46c7-aa82-d527ec295deb,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0546e618-e7')
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:17:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] No VIF found with MAC fa:16:3e:d9:51:98, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.network.neutron [req-ccd43ae0-e6a9-40d2-a466-805ad8b7e01c req-1073d628-9209-44d4-8b41-c1345c6e3e6f service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Updated VIF entry in instance network info cache for port 0546e618-e785-46c7-aa82-d527ec295deb. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.network.neutron [req-ccd43ae0-e6a9-40d2-a466-805ad8b7e01c req-1073d628-9209-44d4-8b41-c1345c6e3e6f service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Updating instance_info_cache with network_info: [{"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ccd43ae0-e6a9-40d2-a466-805ad8b7e01c req-1073d628-9209-44d4-8b41-c1345c6e3e6f service nova] Releasing lock "refresh_cache-b3dd183e-7ab1-40ae-b282-40575a9e47df" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:17:14 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Creating image(s)
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Did not create local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Ensure instance console log exists: /opt/stack/data/nova/instances/7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Start _get_guest_xml network_info=[{"id": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "address": "fa:16:3e:11:3f:a6", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da073c1-08", "ovs_interfaceid": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AJRehkFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430', 'attached_at': '', 'detached_at': '', 'volume_id': '757d7792-2f2c-4169-b1d1-c818a7576c54', 'serial': '757d7792-2f2c-4169-b1d1-c818a7576c54'}, 'attachment_id': '615331b7-1251-4794-bbd0-624556fbd0be', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:17:14 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:17:14 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AJRehkFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:17:14 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:17:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:17:14 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:17:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:17:14 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d5cc08-f9c1-4d01-9e2a-4b58c748feb2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:17:14 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64b6af0-5cff-451d-a517-956f5c2767d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54] added
Aug 15 19:17:14 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e157fb3-d282-4ec7-a98a-5b58973aab53]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a6a73d-fee8-4110-abe9-87aef97645fc]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AJRehkFf {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AJRehkFf" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[be29f035-48e8-43f9-8cd0-31b04baff0a0]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AJRehkFf'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a78f42-2c1a-42f5-b78a-15dbbed4a85a]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:17:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2474086-e254-4c5f-baec-e3a38c34925e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:17:15 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:17:15 user nova-compute[73188]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:17:15 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:17:15 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:17:15 user nova-compute[73188]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:17:15 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebf024f-b96d-44ff-b3a1-202bc28210cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54, portal: 172.16.0.220,3260]
Aug 15 19:17:15 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54, portal: 172.16.0.220,3260] successful.
Aug 15 19:17:15 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[62474faa-f378-4083-a6eb-365cb480728f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca9f442-0918-4558-af0c-31c5ae8fda07]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:17:15 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:17:15 user nova-compute[73188]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:17:15 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:17:15 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:17:15 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:17:15 user nova-compute[73188]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:17:15 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:17:15 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[722694b1-d564-4ab0-85e9-39c6a697dad9]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AJRehkFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG nova.compute.manager [req-16c2f0cc-12c5-40e8-a986-b16cc11ad937 req-cbd36630-50a6-4610-8bb8-77ca1b6ae2c4 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received event network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-16c2f0cc-12c5-40e8-a986-b16cc11ad937 req-cbd36630-50a6-4610-8bb8-77ca1b6ae2c4 service nova] Acquiring lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-16c2f0cc-12c5-40e8-a986-b16cc11ad937 req-cbd36630-50a6-4610-8bb8-77ca1b6ae2c4 service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-16c2f0cc-12c5-40e8-a986-b16cc11ad937 req-cbd36630-50a6-4610-8bb8-77ca1b6ae2c4 service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:15 user nova-compute[73188]: DEBUG nova.compute.manager [req-16c2f0cc-12c5-40e8-a986-b16cc11ad937 req-cbd36630-50a6-4610-8bb8-77ca1b6ae2c4 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] No waiting events found dispatching network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:17:15 user nova-compute[73188]: WARNING nova.compute.manager [req-16c2f0cc-12c5-40e8-a986-b16cc11ad937 req-cbd36630-50a6-4610-8bb8-77ca1b6ae2c4 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received unexpected event network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb for instance with vm_state building and task_state spawning.
Aug 15 19:17:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '26434333235633631', 'path': '/dev/sdc'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434333235633631', 'path': '/dev/sdc'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-689162011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-689162011',id=27,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ab4e1cccd434f6c83f2f9e4687d274e',ramdisk_id='',reservation_id='r-uzmnlu74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:16:53Z,user_data=None,user_id='bad952eceaec400396fd0a28c438c761',uuid=7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "address": "fa:16:3e:11:3f:a6", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da073c1-08", "ovs_interfaceid": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converting VIF {"id": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "address": "fa:16:3e:11:3f:a6", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da073c1-08", "ovs_interfaceid": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:3f:a6,bridge_name='br-int',has_traffic_filtering=True,id=6da073c1-0834-4a3c-92e1-9d89e1bc5fe0,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da073c1-08') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG nova.objects.instance [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'pci_devices' on Instance uuid 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:17:16 user nova-compute[73188]:   <uuid>7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430</uuid>
Aug 15 19:17:16 user nova-compute[73188]:   <name>instance-0000001b</name>
Aug 15 19:17:16 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:17:16 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:17:16 user nova-compute[73188]:   <metadata>
Aug 15 19:17:16 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:17:16 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:17:16 user nova-compute[73188]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-689162011</nova:name>
Aug 15 19:17:16 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:17:14</nova:creationTime>
Aug 15 19:17:16 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:17:16 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:17:16 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:17:16 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:17:16 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:17:16 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:17:16 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:17:16 user nova-compute[73188]:       <nova:owner>
Aug 15 19:17:16 user nova-compute[73188]:         <nova:user uuid="bad952eceaec400396fd0a28c438c761">tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member</nova:user>
Aug 15 19:17:16 user nova-compute[73188]:         <nova:project uuid="0ab4e1cccd434f6c83f2f9e4687d274e">tempest-ServerBootFromVolumeStableRescueTest-1886926549</nova:project>
Aug 15 19:17:16 user nova-compute[73188]:       </nova:owner>
Aug 15 19:17:16 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:17:16 user nova-compute[73188]:       <nova:ports>
Aug 15 19:17:16 user nova-compute[73188]:         <nova:port uuid="6da073c1-0834-4a3c-92e1-9d89e1bc5fe0">
Aug 15 19:17:16 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 19:17:16 user nova-compute[73188]:         </nova:port>
Aug 15 19:17:16 user nova-compute[73188]:       </nova:ports>
Aug 15 19:17:16 user nova-compute[73188]:     </nova:instance>
Aug 15 19:17:16 user nova-compute[73188]:   </metadata>
Aug 15 19:17:16 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:17:16 user nova-compute[73188]:     <system>
Aug 15 19:17:16 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:17:16 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:17:16 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:17:16 user nova-compute[73188]:       <entry name="serial">7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430</entry>
Aug 15 19:17:16 user nova-compute[73188]:       <entry name="uuid">7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430</entry>
Aug 15 19:17:16 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:17:16 user nova-compute[73188]:     </system>
Aug 15 19:17:16 user nova-compute[73188]:   </sysinfo>
Aug 15 19:17:16 user nova-compute[73188]:   <os>
Aug 15 19:17:16 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:17:16 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:17:16 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:17:16 user nova-compute[73188]:   </os>
Aug 15 19:17:16 user nova-compute[73188]:   <features>
Aug 15 19:17:16 user nova-compute[73188]:     <acpi/>
Aug 15 19:17:16 user nova-compute[73188]:     <apic/>
Aug 15 19:17:16 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:17:16 user nova-compute[73188]:   </features>
Aug 15 19:17:16 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:17:16 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:17:16 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:17:16 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:17:16 user nova-compute[73188]:   </clock>
Aug 15 19:17:16 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:17:16 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:17:16 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:17:16 user nova-compute[73188]:   </cpu>
Aug 15 19:17:16 user nova-compute[73188]:   <devices>
Aug 15 19:17:16 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:17:16 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:17:16 user nova-compute[73188]:       <source dev="/dev/sdc"/>
Aug 15 19:17:16 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:17:16 user nova-compute[73188]:       <serial>757d7792-2f2c-4169-b1d1-c818a7576c54</serial>
Aug 15 19:17:16 user nova-compute[73188]:     </disk>
Aug 15 19:17:16 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:17:16 user nova-compute[73188]:       <mac address="fa:16:3e:11:3f:a6"/>
Aug 15 19:17:16 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:17:16 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:17:16 user nova-compute[73188]:       <target dev="tap6da073c1-08"/>
Aug 15 19:17:16 user nova-compute[73188]:     </interface>
Aug 15 19:17:16 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:17:16 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430/console.log" append="off"/>
Aug 15 19:17:16 user nova-compute[73188]:     </serial>
Aug 15 19:17:16 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:17:16 user nova-compute[73188]:     <video>
Aug 15 19:17:16 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:17:16 user nova-compute[73188]:     </video>
Aug 15 19:17:16 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:17:16 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:17:16 user nova-compute[73188]:     </rng>
Aug 15 19:17:16 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:17:16 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:17:16 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:17:16 user nova-compute[73188]:     </memballoon>
Aug 15 19:17:16 user nova-compute[73188]:   </devices>
Aug 15 19:17:16 user nova-compute[73188]: </domain>
Aug 15 19:17:16 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-689162011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-689162011',id=27,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ab4e1cccd434f6c83f2f9e4687d274e',ramdisk_id='',reservation_id='r-uzmnlu74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:16:53Z,user_data=None,user_id='bad952eceaec400396fd0a28c438c761',uuid=7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "address": "fa:16:3e:11:3f:a6", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da073c1-08", "ovs_interfaceid": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converting VIF {"id": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "address": "fa:16:3e:11:3f:a6", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da073c1-08", "ovs_interfaceid": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:3f:a6,bridge_name='br-int',has_traffic_filtering=True,id=6da073c1-0834-4a3c-92e1-9d89e1bc5fe0,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da073c1-08') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG os_vif [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:3f:a6,bridge_name='br-int',has_traffic_filtering=True,id=6da073c1-0834-4a3c-92e1-9d89e1bc5fe0,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da073c1-08') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6da073c1-08, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6da073c1-08, col_values=(('external_ids', {'iface-id': '6da073c1-0834-4a3c-92e1-9d89e1bc5fe0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:3f:a6', 'vm-uuid': '7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:16 user nova-compute[73188]: INFO os_vif [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:3f:a6,bridge_name='br-int',has_traffic_filtering=True,id=6da073c1-0834-4a3c-92e1-9d89e1bc5fe0,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da073c1-08')
Aug 15 19:17:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:17:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] No VIF found with MAC fa:16:3e:11:3f:a6, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-9ca388b8-c1c5-4952-855e-e717c168486f req-a9412d68-0b97-447a-99c7-b29b5569a021 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received event network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9ca388b8-c1c5-4952-855e-e717c168486f req-a9412d68-0b97-447a-99c7-b29b5569a021 service nova] Acquiring lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9ca388b8-c1c5-4952-855e-e717c168486f req-a9412d68-0b97-447a-99c7-b29b5569a021 service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9ca388b8-c1c5-4952-855e-e717c168486f req-a9412d68-0b97-447a-99c7-b29b5569a021 service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-9ca388b8-c1c5-4952-855e-e717c168486f req-a9412d68-0b97-447a-99c7-b29b5569a021 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] No waiting events found dispatching network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:17:17 user nova-compute[73188]: WARNING nova.compute.manager [req-9ca388b8-c1c5-4952-855e-e717c168486f req-a9412d68-0b97-447a-99c7-b29b5569a021 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received unexpected event network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb for instance with vm_state building and task_state spawning.
Aug 15 19:17:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127037.8801363, b3dd183e-7ab1-40ae-b282-40575a9e47df => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:17:17 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] VM Resumed (Lifecycle Event)
Aug 15 19:17:17 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Instance spawned successfully.
Aug 15 19:17:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:17:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:17:17 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:17:17 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127037.8817146, b3dd183e-7ab1-40ae-b282-40575a9e47df => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:17:17 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] VM Started (Lifecycle Event)
Aug 15 19:17:18 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:17:18 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:17:18 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:17:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:18 user nova-compute[73188]: INFO nova.compute.manager [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Took 6.99 seconds to spawn the instance on the hypervisor.
Aug 15 19:17:18 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:17:18 user nova-compute[73188]: INFO nova.compute.manager [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Took 8.33 seconds to build instance.
Aug 15 19:17:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1554e666-3203-475c-bd1a-a83367647457 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.486s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:19 user nova-compute[73188]: DEBUG nova.compute.manager [req-b73c92ce-99d4-478e-9e0a-8c5a6c68eef9 req-00183c29-342c-477e-b18c-32869776e1e0 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received event network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:17:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b73c92ce-99d4-478e-9e0a-8c5a6c68eef9 req-00183c29-342c-477e-b18c-32869776e1e0 service nova] Acquiring lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b73c92ce-99d4-478e-9e0a-8c5a6c68eef9 req-00183c29-342c-477e-b18c-32869776e1e0 service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b73c92ce-99d4-478e-9e0a-8c5a6c68eef9 req-00183c29-342c-477e-b18c-32869776e1e0 service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:19 user nova-compute[73188]: DEBUG nova.compute.manager [req-b73c92ce-99d4-478e-9e0a-8c5a6c68eef9 req-00183c29-342c-477e-b18c-32869776e1e0 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] No waiting events found dispatching network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:17:19 user nova-compute[73188]: WARNING nova.compute.manager [req-b73c92ce-99d4-478e-9e0a-8c5a6c68eef9 req-00183c29-342c-477e-b18c-32869776e1e0 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received unexpected event network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 for instance with vm_state building and task_state spawning.
Aug 15 19:17:19 user nova-compute[73188]: DEBUG nova.compute.manager [req-b73c92ce-99d4-478e-9e0a-8c5a6c68eef9 req-00183c29-342c-477e-b18c-32869776e1e0 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received event network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:17:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b73c92ce-99d4-478e-9e0a-8c5a6c68eef9 req-00183c29-342c-477e-b18c-32869776e1e0 service nova] Acquiring lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b73c92ce-99d4-478e-9e0a-8c5a6c68eef9 req-00183c29-342c-477e-b18c-32869776e1e0 service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b73c92ce-99d4-478e-9e0a-8c5a6c68eef9 req-00183c29-342c-477e-b18c-32869776e1e0 service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:19 user nova-compute[73188]: DEBUG nova.compute.manager [req-b73c92ce-99d4-478e-9e0a-8c5a6c68eef9 req-00183c29-342c-477e-b18c-32869776e1e0 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] No waiting events found dispatching network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:17:19 user nova-compute[73188]: WARNING nova.compute.manager [req-b73c92ce-99d4-478e-9e0a-8c5a6c68eef9 req-00183c29-342c-477e-b18c-32869776e1e0 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received unexpected event network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 for instance with vm_state building and task_state spawning.
Aug 15 19:17:20 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127040.2687063, 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:17:20 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] VM Resumed (Lifecycle Event)
Aug 15 19:17:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:17:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:17:20 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Instance spawned successfully.
Aug 15 19:17:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:17:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:17:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:17:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:17:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:17:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:17:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:17:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:17:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:17:20 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:17:20 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127040.270848, 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:17:20 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] VM Started (Lifecycle Event)
Aug 15 19:17:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:17:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:17:20 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:17:20 user nova-compute[73188]: INFO nova.compute.manager [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Took 5.74 seconds to spawn the instance on the hypervisor.
Aug 15 19:17:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:17:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:20 user nova-compute[73188]: INFO nova.compute.manager [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Took 28.59 seconds to build instance.
Aug 15 19:17:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-490fd106-c3fa-4ab7-ac99-210834be122d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.689s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:21 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:17:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:21 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:17:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.281s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:17:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:24 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:17:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:25 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:17:25 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:17:25 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=7352MB free_disk=25.10324478149414GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:17:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:26 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:17:26 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3d713d03-3e60-4dec-a295-a4652ac21842 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:17:26 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e00adf53-085f-436d-a09f-e97e92ca79cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:17:26 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance de6929cd-c95d-4964-b81c-96872a137f90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:17:26 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 139ccf1c-4792-4653-9475-c61b1f9c4846 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:17:26 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 215077af-60a1-4a82-b24e-1545349363d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:17:26 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 2a472af2-b10c-456b-8dba-6c75f3ab806a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:17:26 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 7f96acc3-0856-462e-9a32-879848f60a0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:17:26 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 0ee7de87-76ad-48ae-8bcd-93b2792a96cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:17:26 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:17:26 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance b3dd183e-7ab1-40ae-b282-40575a9e47df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:17:26 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:17:26 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:17:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:17:26 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:17:26 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:17:26 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:17:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:27 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:17:27 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:17:27 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:17:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:17:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-139ccf1c-4792-4653-9475-c61b1f9c4846" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:17:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-139ccf1c-4792-4653-9475-c61b1f9c4846" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:17:27 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:17:28 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Updating instance_info_cache with network_info: [{"id": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "address": "fa:16:3e:49:14:b8", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2485f75-d3", "ovs_interfaceid": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:17:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-139ccf1c-4792-4653-9475-c61b1f9c4846" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:17:28 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:17:28 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:17:28 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:17:28 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:17:28 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:17:28 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:17:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquiring lock "de6929cd-c95d-4964-b81c-96872a137f90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "de6929cd-c95d-4964-b81c-96872a137f90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquiring lock "de6929cd-c95d-4964-b81c-96872a137f90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:29 user nova-compute[73188]: INFO nova.compute.manager [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Terminating instance
Aug 15 19:17:29 user nova-compute[73188]: DEBUG nova.compute.manager [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:17:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:29 user nova-compute[73188]: DEBUG nova.compute.manager [req-ac903e74-4f61-479e-a3a1-07b14032ff4b req-40cbacb6-6cc1-437d-8cb5-19ee0a740db1 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received event network-vif-unplugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:17:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ac903e74-4f61-479e-a3a1-07b14032ff4b req-40cbacb6-6cc1-437d-8cb5-19ee0a740db1 service nova] Acquiring lock "de6929cd-c95d-4964-b81c-96872a137f90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ac903e74-4f61-479e-a3a1-07b14032ff4b req-40cbacb6-6cc1-437d-8cb5-19ee0a740db1 service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ac903e74-4f61-479e-a3a1-07b14032ff4b req-40cbacb6-6cc1-437d-8cb5-19ee0a740db1 service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:29 user nova-compute[73188]: DEBUG nova.compute.manager [req-ac903e74-4f61-479e-a3a1-07b14032ff4b req-40cbacb6-6cc1-437d-8cb5-19ee0a740db1 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] No waiting events found dispatching network-vif-unplugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:17:29 user nova-compute[73188]: DEBUG nova.compute.manager [req-ac903e74-4f61-479e-a3a1-07b14032ff4b req-40cbacb6-6cc1-437d-8cb5-19ee0a740db1 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received event network-vif-unplugged-f07c7de0-8264-42c8-aa30-1a8c7405379a for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:17:30 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Instance destroyed successfully.
Aug 15 19:17:30 user nova-compute[73188]: DEBUG nova.objects.instance [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lazy-loading 'resources' on Instance uuid de6929cd-c95d-4964-b81c-96872a137f90 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:17:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:10:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1685172374',display_name='tempest-ServerStableDeviceRescueTest-server-1685172374',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1685172374',id=17,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZV2ZZ1PcyzXMuO4AObOOzlp+MD17bBbGreeYVcVHD8T7QwHW/JFWvZsik8+8K9lMujg7+2eVXXA7EFfclfRtmg+u/m1UQSUhNeDCmDVQ3LSOmEpIIFi4mYV6zZe1VY4Q==',key_name='tempest-keypair-313035603',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:14:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b47c13ca2b84149926b814a26148366',ramdisk_id='',reservation_id='r-06ruxa0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1845666905',owner_user_name='tempest-ServerStableDeviceRescueTest-1845666905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:16:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47716a2e151a44c0a09e8bc538a8316f',uuid=de6929cd-c95d-4964-b81c-96872a137f90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "address": "fa:16:3e:06:3e:cd", "network": {"id": "72ad2e88-4c2b-4cba-bfa5-801725bc0041", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824390140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b47c13ca2b84149926b814a26148366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf07c7de0-82", "ovs_interfaceid": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:17:30 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Converting VIF {"id": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "address": "fa:16:3e:06:3e:cd", "network": {"id": "72ad2e88-4c2b-4cba-bfa5-801725bc0041", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1824390140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b47c13ca2b84149926b814a26148366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf07c7de0-82", "ovs_interfaceid": "f07c7de0-8264-42c8-aa30-1a8c7405379a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:17:30 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:3e:cd,bridge_name='br-int',has_traffic_filtering=True,id=f07c7de0-8264-42c8-aa30-1a8c7405379a,network=Network(72ad2e88-4c2b-4cba-bfa5-801725bc0041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf07c7de0-82') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:17:30 user nova-compute[73188]: DEBUG os_vif [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:3e:cd,bridge_name='br-int',has_traffic_filtering=True,id=f07c7de0-8264-42c8-aa30-1a8c7405379a,network=Network(72ad2e88-4c2b-4cba-bfa5-801725bc0041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf07c7de0-82') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:17:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf07c7de0-82, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:17:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:17:30 user nova-compute[73188]: INFO os_vif [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:3e:cd,bridge_name='br-int',has_traffic_filtering=True,id=f07c7de0-8264-42c8-aa30-1a8c7405379a,network=Network(72ad2e88-4c2b-4cba-bfa5-801725bc0041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf07c7de0-82')
Aug 15 19:17:30 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Deleting instance files /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90_del
Aug 15 19:17:30 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Deletion of /opt/stack/data/nova/instances/de6929cd-c95d-4964-b81c-96872a137f90_del complete
Aug 15 19:17:30 user nova-compute[73188]: INFO nova.compute.manager [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 15 19:17:30 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:17:30 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:17:30 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: de6929cd-c95d-4964-b81c-96872a137f90] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:17:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:31 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:17:31 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Took 0.97 seconds to deallocate network for instance.
Aug 15 19:17:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:31 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:17:31 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:17:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:31 user nova-compute[73188]: DEBUG nova.compute.manager [req-7bdba667-3577-4e19-9d31-e0f976d2897e req-e221d1ad-4cb0-4f6d-8f94-fa1bce61d495 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received event network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:17:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7bdba667-3577-4e19-9d31-e0f976d2897e req-e221d1ad-4cb0-4f6d-8f94-fa1bce61d495 service nova] Acquiring lock "de6929cd-c95d-4964-b81c-96872a137f90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7bdba667-3577-4e19-9d31-e0f976d2897e req-e221d1ad-4cb0-4f6d-8f94-fa1bce61d495 service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7bdba667-3577-4e19-9d31-e0f976d2897e req-e221d1ad-4cb0-4f6d-8f94-fa1bce61d495 service nova] Lock "de6929cd-c95d-4964-b81c-96872a137f90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:31 user nova-compute[73188]: DEBUG nova.compute.manager [req-7bdba667-3577-4e19-9d31-e0f976d2897e req-e221d1ad-4cb0-4f6d-8f94-fa1bce61d495 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] No waiting events found dispatching network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:17:31 user nova-compute[73188]: WARNING nova.compute.manager [req-7bdba667-3577-4e19-9d31-e0f976d2897e req-e221d1ad-4cb0-4f6d-8f94-fa1bce61d495 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received unexpected event network-vif-plugged-f07c7de0-8264-42c8-aa30-1a8c7405379a for instance with vm_state deleted and task_state None.
Aug 15 19:17:31 user nova-compute[73188]: DEBUG nova.compute.manager [req-7bdba667-3577-4e19-9d31-e0f976d2897e req-e221d1ad-4cb0-4f6d-8f94-fa1bce61d495 service nova] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Received event network-vif-deleted-f07c7de0-8264-42c8-aa30-1a8c7405379a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:17:32 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Deleted allocations for instance de6929cd-c95d-4964-b81c-96872a137f90
Aug 15 19:17:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6cd44fb2-e44f-493a-9602-997b61732bd2 tempest-ServerStableDeviceRescueTest-1845666905 tempest-ServerStableDeviceRescueTest-1845666905-project-member] Lock "de6929cd-c95d-4964-b81c-96872a137f90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.561s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:45 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127050.346991, de6929cd-c95d-4964-b81c-96872a137f90 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:17:45 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: de6929cd-c95d-4964-b81c-96872a137f90] VM Stopped (Lifecycle Event)
Aug 15 19:17:45 user nova-compute[73188]: DEBUG nova.compute.manager [None req-67ec5be9-7e51-4de6-896f-ccd9928ec250 None None] [instance: de6929cd-c95d-4964-b81c-96872a137f90] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:17:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:49 user nova-compute[73188]: DEBUG nova.compute.manager [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:17:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:17:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:17:49 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:17:49 user nova-compute[73188]: INFO nova.compute.claims [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Claim successful on node user
Aug 15 19:17:49 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:17:49 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG nova.network.neutron [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:17:50 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:17:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:17:50 user nova-compute[73188]: INFO nova.virt.block_device [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Booting with volume a60ae2c3-8dfc-437a-ad71-0caf688c19f5 at /dev/vda
Aug 15 19:17:50 user nova-compute[73188]: DEBUG nova.policy [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9503705066e5402cb569fae3b2bd8976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18eadba32f4547ad9436aca9285b7aad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG os_brick.utils [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6614c2-a966-4ca5-813e-24a9ec607b9c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[491c8852-8211-4478-bd97-c55c42fe044e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[94df20db-bb37-4c1c-8c7b-e0d2a9c12988]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4554b9-a15d-496a-abb9-171651c45e9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:17:50 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:17:50 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b2d295-8365-4187-8767-d9097b249cf7]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG os_brick.utils [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Updating existing volume attachment record: 59306a77-f49f-455c-bd09-f2c3c6e35d1b {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:50 user nova-compute[73188]: DEBUG nova.network.neutron [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Successfully created port: 0cbee9cd-128c-4c6d-ae87-7368a786fc4a {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:17:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:51 user nova-compute[73188]: DEBUG nova.network.neutron [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Successfully updated port: 0cbee9cd-128c-4c6d-ae87-7368a786fc4a {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:17:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "refresh_cache-182d8fc2-0246-4164-9d1b-f970cec4dd1f" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:17:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquired lock "refresh_cache-182d8fc2-0246-4164-9d1b-f970cec4dd1f" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:17:51 user nova-compute[73188]: DEBUG nova.network.neutron [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:17:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-1e968966-8da4-49ed-ae47-30ca000678a2 req-9795a537-646c-4386-93c8-4cc3847fea73 service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Received event network-changed-0cbee9cd-128c-4c6d-ae87-7368a786fc4a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:17:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-1e968966-8da4-49ed-ae47-30ca000678a2 req-9795a537-646c-4386-93c8-4cc3847fea73 service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Refreshing instance network info cache due to event network-changed-0cbee9cd-128c-4c6d-ae87-7368a786fc4a. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:17:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1e968966-8da4-49ed-ae47-30ca000678a2 req-9795a537-646c-4386-93c8-4cc3847fea73 service nova] Acquiring lock "refresh_cache-182d8fc2-0246-4164-9d1b-f970cec4dd1f" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:17:51 user nova-compute[73188]: DEBUG nova.network.neutron [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:17:52 user nova-compute[73188]: DEBUG nova.network.neutron [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Updating instance_info_cache with network_info: [{"id": "0cbee9cd-128c-4c6d-ae87-7368a786fc4a", "address": "fa:16:3e:b8:b6:ca", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cbee9cd-12", "ovs_interfaceid": "0cbee9cd-128c-4c6d-ae87-7368a786fc4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:17:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Releasing lock "refresh_cache-182d8fc2-0246-4164-9d1b-f970cec4dd1f" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:17:52 user nova-compute[73188]: DEBUG nova.compute.manager [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Instance network_info: |[{"id": "0cbee9cd-128c-4c6d-ae87-7368a786fc4a", "address": "fa:16:3e:b8:b6:ca", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cbee9cd-12", "ovs_interfaceid": "0cbee9cd-128c-4c6d-ae87-7368a786fc4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:17:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1e968966-8da4-49ed-ae47-30ca000678a2 req-9795a537-646c-4386-93c8-4cc3847fea73 service nova] Acquired lock "refresh_cache-182d8fc2-0246-4164-9d1b-f970cec4dd1f" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:17:52 user nova-compute[73188]: DEBUG nova.network.neutron [req-1e968966-8da4-49ed-ae47-30ca000678a2 req-9795a537-646c-4386-93c8-4cc3847fea73 service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Refreshing network info cache for port 0cbee9cd-128c-4c6d-ae87-7368a786fc4a {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:17:52 user nova-compute[73188]: DEBUG nova.network.neutron [req-1e968966-8da4-49ed-ae47-30ca000678a2 req-9795a537-646c-4386-93c8-4cc3847fea73 service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Updated VIF entry in instance network info cache for port 0cbee9cd-128c-4c6d-ae87-7368a786fc4a. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:17:52 user nova-compute[73188]: DEBUG nova.network.neutron [req-1e968966-8da4-49ed-ae47-30ca000678a2 req-9795a537-646c-4386-93c8-4cc3847fea73 service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Updating instance_info_cache with network_info: [{"id": "0cbee9cd-128c-4c6d-ae87-7368a786fc4a", "address": "fa:16:3e:b8:b6:ca", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cbee9cd-12", "ovs_interfaceid": "0cbee9cd-128c-4c6d-ae87-7368a786fc4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:17:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1e968966-8da4-49ed-ae47-30ca000678a2 req-9795a537-646c-4386-93c8-4cc3847fea73 service nova] Releasing lock "refresh_cache-182d8fc2-0246-4164-9d1b-f970cec4dd1f" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:17:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:17:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG nova.compute.manager [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:18:00 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Creating image(s)
Aug 15 19:18:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Did not create local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Ensure instance console log exists: /opt/stack/data/nova/instances/182d8fc2-0246-4164-9d1b-f970cec4dd1f/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Start _get_guest_xml network_info=[{"id": "0cbee9cd-128c-4c6d-ae87-7368a786fc4a", "address": "fa:16:3e:b8:b6:ca", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cbee9cd-12", "ovs_interfaceid": "0cbee9cd-128c-4c6d-ae87-7368a786fc4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYUJsDQH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '182d8fc2-0246-4164-9d1b-f970cec4dd1f', 'attached_at': '', 'detached_at': '', 'volume_id': 'a60ae2c3-8dfc-437a-ad71-0caf688c19f5', 'serial': 'a60ae2c3-8dfc-437a-ad71-0caf688c19f5'}, 'attachment_id': '59306a77-f49f-455c-bd09-f2c3c6e35d1b', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:18:00 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:18:00 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:18:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYUJsDQH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:18:00 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:18:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:18:00 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:18:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:18:00 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f578b7e-a97c-45a7-8a79-66892250eb73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:18:00 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[379d6c5c-e5a9-4e57-a706-4b8123274dfd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5] added
Aug 15 19:18:00 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada6bff4-432c-4f6c-8b6d-68a4ea87c0ec]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09f9d2d-1a79-48b2-9477-45fc36168e2e]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AYUJsDQH {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AYUJsDQH" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a28b0c-f5ad-4dc9-a0fc-c88d75a8ffdb]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AYUJsDQH'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[16610261-edcc-425b-ba88-0300e61d2521]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1238be2b-01c7-4e65-a9e7-70339fb5c87f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:18:00 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:18:00 user nova-compute[73188]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:18:00 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:18:00 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:18:00 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:18:00 user nova-compute[73188]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:18:00 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:18:00 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c5f9c6-0378-48c2-8d3d-482968e27f89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5, portal: 172.16.0.220,3260]
Aug 15 19:18:00 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5, portal: 172.16.0.220,3260] successful.
Aug 15 19:18:00 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.088s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd4c198-f6fa-4534-9cd6-3005f9a1b9ee]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[34950f67-8703-42c4-b36f-0e92ee7b8966]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:18:00 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:18:00 user nova-compute[73188]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:18:00 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:18:00 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:18:00 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:18:00 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:18:00 user nova-compute[73188]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:18:00 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:18:00 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:18:00 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9907ed2-367a-4f8a-b2b2-202e6e523680]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:00 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: None {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYUJsDQH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '23737663263646634', 'path': '/dev/sdd'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737663263646634', 'path': '/dev/sdd'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:17:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1194111157',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1194111157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1194111157',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPm9uRwYTSBr41Ixw3dA9zOUiH+SXU/WNc83Riw/EuxfKCbSUKOM/Rk3SNnV+mTZTHOX/QJ7Q/VUhKG65xfkeV7xJzkhCvXhhNedknho65gyrjSf6wYu6j707o+CzVPGBQ==',key_name='tempest-keypair-1108957145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18eadba32f4547ad9436aca9285b7aad',ramdisk_id='',reservation_id='r-9rw82irz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2114363476',owner_user_name='tempest-TestVolumeBootPattern-2114363476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:17:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9503705066e5402cb569fae3b2bd8976',uuid=182d8fc2-0246-4164-9d1b-f970cec4dd1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cbee9cd-128c-4c6d-ae87-7368a786fc4a", "address": "fa:16:3e:b8:b6:ca", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cbee9cd-12", "ovs_interfaceid": "0cbee9cd-128c-4c6d-ae87-7368a786fc4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converting VIF {"id": "0cbee9cd-128c-4c6d-ae87-7368a786fc4a", "address": "fa:16:3e:b8:b6:ca", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cbee9cd-12", "ovs_interfaceid": "0cbee9cd-128c-4c6d-ae87-7368a786fc4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:b6:ca,bridge_name='br-int',has_traffic_filtering=True,id=0cbee9cd-128c-4c6d-ae87-7368a786fc4a,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cbee9cd-12') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG nova.objects.instance [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lazy-loading 'pci_devices' on Instance uuid 182d8fc2-0246-4164-9d1b-f970cec4dd1f {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:18:01 user nova-compute[73188]:   <uuid>182d8fc2-0246-4164-9d1b-f970cec4dd1f</uuid>
Aug 15 19:18:01 user nova-compute[73188]:   <name>instance-0000001d</name>
Aug 15 19:18:01 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:18:01 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:18:01 user nova-compute[73188]:   <metadata>
Aug 15 19:18:01 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:18:01 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:18:01 user nova-compute[73188]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1194111157</nova:name>
Aug 15 19:18:01 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:18:00</nova:creationTime>
Aug 15 19:18:01 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:18:01 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:18:01 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:18:01 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:18:01 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:18:01 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:18:01 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:18:01 user nova-compute[73188]:       <nova:owner>
Aug 15 19:18:01 user nova-compute[73188]:         <nova:user uuid="9503705066e5402cb569fae3b2bd8976">tempest-TestVolumeBootPattern-2114363476-project-member</nova:user>
Aug 15 19:18:01 user nova-compute[73188]:         <nova:project uuid="18eadba32f4547ad9436aca9285b7aad">tempest-TestVolumeBootPattern-2114363476</nova:project>
Aug 15 19:18:01 user nova-compute[73188]:       </nova:owner>
Aug 15 19:18:01 user nova-compute[73188]:       <nova:ports>
Aug 15 19:18:01 user nova-compute[73188]:         <nova:port uuid="0cbee9cd-128c-4c6d-ae87-7368a786fc4a">
Aug 15 19:18:01 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 19:18:01 user nova-compute[73188]:         </nova:port>
Aug 15 19:18:01 user nova-compute[73188]:       </nova:ports>
Aug 15 19:18:01 user nova-compute[73188]:     </nova:instance>
Aug 15 19:18:01 user nova-compute[73188]:   </metadata>
Aug 15 19:18:01 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:18:01 user nova-compute[73188]:     <system>
Aug 15 19:18:01 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:18:01 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:18:01 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:18:01 user nova-compute[73188]:       <entry name="serial">182d8fc2-0246-4164-9d1b-f970cec4dd1f</entry>
Aug 15 19:18:01 user nova-compute[73188]:       <entry name="uuid">182d8fc2-0246-4164-9d1b-f970cec4dd1f</entry>
Aug 15 19:18:01 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:18:01 user nova-compute[73188]:     </system>
Aug 15 19:18:01 user nova-compute[73188]:   </sysinfo>
Aug 15 19:18:01 user nova-compute[73188]:   <os>
Aug 15 19:18:01 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:18:01 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:18:01 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:18:01 user nova-compute[73188]:   </os>
Aug 15 19:18:01 user nova-compute[73188]:   <features>
Aug 15 19:18:01 user nova-compute[73188]:     <acpi/>
Aug 15 19:18:01 user nova-compute[73188]:     <apic/>
Aug 15 19:18:01 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:18:01 user nova-compute[73188]:   </features>
Aug 15 19:18:01 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:18:01 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:18:01 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:18:01 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:18:01 user nova-compute[73188]:   </clock>
Aug 15 19:18:01 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:18:01 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:18:01 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:18:01 user nova-compute[73188]:   </cpu>
Aug 15 19:18:01 user nova-compute[73188]:   <devices>
Aug 15 19:18:01 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:18:01 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:18:01 user nova-compute[73188]:       <source dev="/dev/sdd"/>
Aug 15 19:18:01 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:18:01 user nova-compute[73188]:       <serial>a60ae2c3-8dfc-437a-ad71-0caf688c19f5</serial>
Aug 15 19:18:01 user nova-compute[73188]:     </disk>
Aug 15 19:18:01 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:18:01 user nova-compute[73188]:       <mac address="fa:16:3e:b8:b6:ca"/>
Aug 15 19:18:01 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:18:01 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:18:01 user nova-compute[73188]:       <target dev="tap0cbee9cd-12"/>
Aug 15 19:18:01 user nova-compute[73188]:     </interface>
Aug 15 19:18:01 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:18:01 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/182d8fc2-0246-4164-9d1b-f970cec4dd1f/console.log" append="off"/>
Aug 15 19:18:01 user nova-compute[73188]:     </serial>
Aug 15 19:18:01 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:18:01 user nova-compute[73188]:     <video>
Aug 15 19:18:01 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:18:01 user nova-compute[73188]:     </video>
Aug 15 19:18:01 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:18:01 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:18:01 user nova-compute[73188]:     </rng>
Aug 15 19:18:01 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:18:01 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:18:01 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:18:01 user nova-compute[73188]:     </memballoon>
Aug 15 19:18:01 user nova-compute[73188]:   </devices>
Aug 15 19:18:01 user nova-compute[73188]: </domain>
Aug 15 19:18:01 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:17:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1194111157',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1194111157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1194111157',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPm9uRwYTSBr41Ixw3dA9zOUiH+SXU/WNc83Riw/EuxfKCbSUKOM/Rk3SNnV+mTZTHOX/QJ7Q/VUhKG65xfkeV7xJzkhCvXhhNedknho65gyrjSf6wYu6j707o+CzVPGBQ==',key_name='tempest-keypair-1108957145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18eadba32f4547ad9436aca9285b7aad',ramdisk_id='',reservation_id='r-9rw82irz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2114363476',owner_user_name='tempest-TestVolumeBootPattern-2114363476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:17:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9503705066e5402cb569fae3b2bd8976',uuid=182d8fc2-0246-4164-9d1b-f970cec4dd1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cbee9cd-128c-4c6d-ae87-7368a786fc4a", "address": "fa:16:3e:b8:b6:ca", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cbee9cd-12", "ovs_interfaceid": "0cbee9cd-128c-4c6d-ae87-7368a786fc4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converting VIF {"id": "0cbee9cd-128c-4c6d-ae87-7368a786fc4a", "address": "fa:16:3e:b8:b6:ca", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cbee9cd-12", "ovs_interfaceid": "0cbee9cd-128c-4c6d-ae87-7368a786fc4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:b6:ca,bridge_name='br-int',has_traffic_filtering=True,id=0cbee9cd-128c-4c6d-ae87-7368a786fc4a,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cbee9cd-12') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG os_vif [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:b6:ca,bridge_name='br-int',has_traffic_filtering=True,id=0cbee9cd-128c-4c6d-ae87-7368a786fc4a,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cbee9cd-12') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0cbee9cd-12, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0cbee9cd-12, col_values=(('external_ids', {'iface-id': '0cbee9cd-128c-4c6d-ae87-7368a786fc4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:b6:ca', 'vm-uuid': '182d8fc2-0246-4164-9d1b-f970cec4dd1f'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:01 user nova-compute[73188]: INFO os_vif [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:b6:ca,bridge_name='br-int',has_traffic_filtering=True,id=0cbee9cd-128c-4c6d-ae87-7368a786fc4a,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cbee9cd-12')
Aug 15 19:18:01 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:18:01 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] No VIF found with MAC fa:16:3e:b8:b6:ca, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:18:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:03 user nova-compute[73188]: DEBUG nova.compute.manager [req-99ce786e-86f2-48f5-b7b0-debeac89558a req-e304351f-6eba-472b-8499-dc5a7996347d service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Received event network-vif-plugged-0cbee9cd-128c-4c6d-ae87-7368a786fc4a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:18:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-99ce786e-86f2-48f5-b7b0-debeac89558a req-e304351f-6eba-472b-8499-dc5a7996347d service nova] Acquiring lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:18:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-99ce786e-86f2-48f5-b7b0-debeac89558a req-e304351f-6eba-472b-8499-dc5a7996347d service nova] Lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:18:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-99ce786e-86f2-48f5-b7b0-debeac89558a req-e304351f-6eba-472b-8499-dc5a7996347d service nova] Lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:18:03 user nova-compute[73188]: DEBUG nova.compute.manager [req-99ce786e-86f2-48f5-b7b0-debeac89558a req-e304351f-6eba-472b-8499-dc5a7996347d service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] No waiting events found dispatching network-vif-plugged-0cbee9cd-128c-4c6d-ae87-7368a786fc4a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:18:03 user nova-compute[73188]: WARNING nova.compute.manager [req-99ce786e-86f2-48f5-b7b0-debeac89558a req-e304351f-6eba-472b-8499-dc5a7996347d service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Received unexpected event network-vif-plugged-0cbee9cd-128c-4c6d-ae87-7368a786fc4a for instance with vm_state building and task_state spawning.
Aug 15 19:18:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:05 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127085.1163125, 182d8fc2-0246-4164-9d1b-f970cec4dd1f => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:18:05 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] VM Resumed (Lifecycle Event)
Aug 15 19:18:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:18:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:18:05 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Instance spawned successfully.
Aug 15 19:18:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:18:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:18:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:18:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:18:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:18:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:18:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:18:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:18:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:18:05 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:18:05 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127085.1176414, 182d8fc2-0246-4164-9d1b-f970cec4dd1f => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:18:05 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] VM Started (Lifecycle Event)
Aug 15 19:18:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:18:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:18:05 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:18:05 user nova-compute[73188]: INFO nova.compute.manager [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Took 5.17 seconds to spawn the instance on the hypervisor.
Aug 15 19:18:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:18:05 user nova-compute[73188]: DEBUG nova.compute.manager [req-39896dd3-bdb4-4241-ac9d-9cce128c4604 req-98537d8c-899a-4dbc-9b85-c774e48f084b service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Received event network-vif-plugged-0cbee9cd-128c-4c6d-ae87-7368a786fc4a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:18:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-39896dd3-bdb4-4241-ac9d-9cce128c4604 req-98537d8c-899a-4dbc-9b85-c774e48f084b service nova] Acquiring lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:18:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-39896dd3-bdb4-4241-ac9d-9cce128c4604 req-98537d8c-899a-4dbc-9b85-c774e48f084b service nova] Lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:18:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-39896dd3-bdb4-4241-ac9d-9cce128c4604 req-98537d8c-899a-4dbc-9b85-c774e48f084b service nova] Lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:18:05 user nova-compute[73188]: DEBUG nova.compute.manager [req-39896dd3-bdb4-4241-ac9d-9cce128c4604 req-98537d8c-899a-4dbc-9b85-c774e48f084b service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] No waiting events found dispatching network-vif-plugged-0cbee9cd-128c-4c6d-ae87-7368a786fc4a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:18:05 user nova-compute[73188]: WARNING nova.compute.manager [req-39896dd3-bdb4-4241-ac9d-9cce128c4604 req-98537d8c-899a-4dbc-9b85-c774e48f084b service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Received unexpected event network-vif-plugged-0cbee9cd-128c-4c6d-ae87-7368a786fc4a for instance with vm_state building and task_state spawning.
Aug 15 19:18:05 user nova-compute[73188]: INFO nova.compute.manager [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Took 15.79 seconds to build instance.
Aug 15 19:18:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-60322d67-b4d8-43dd-ac99-7364a9f00dd0 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.886s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:18:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-15e64a65-aff8-4d65-b6c3-a981cc713ca1 req-526a5d33-8d3b-4083-8850-b7bb97522dc2 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Received event network-changed-c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:18:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-15e64a65-aff8-4d65-b6c3-a981cc713ca1 req-526a5d33-8d3b-4083-8850-b7bb97522dc2 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Refreshing instance network info cache due to event network-changed-c10933cb-e730-47f0-9b80-fcec4cf6c359. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:18:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-15e64a65-aff8-4d65-b6c3-a981cc713ca1 req-526a5d33-8d3b-4083-8850-b7bb97522dc2 service nova] Acquiring lock "refresh_cache-7f96acc3-0856-462e-9a32-879848f60a0e" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:18:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-15e64a65-aff8-4d65-b6c3-a981cc713ca1 req-526a5d33-8d3b-4083-8850-b7bb97522dc2 service nova] Acquired lock "refresh_cache-7f96acc3-0856-462e-9a32-879848f60a0e" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:18:08 user nova-compute[73188]: DEBUG nova.network.neutron [req-15e64a65-aff8-4d65-b6c3-a981cc713ca1 req-526a5d33-8d3b-4083-8850-b7bb97522dc2 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Refreshing network info cache for port c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG nova.network.neutron [req-15e64a65-aff8-4d65-b6c3-a981cc713ca1 req-526a5d33-8d3b-4083-8850-b7bb97522dc2 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Updated VIF entry in instance network info cache for port c10933cb-e730-47f0-9b80-fcec4cf6c359. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG nova.network.neutron [req-15e64a65-aff8-4d65-b6c3-a981cc713ca1 req-526a5d33-8d3b-4083-8850-b7bb97522dc2 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Updating instance_info_cache with network_info: [{"id": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "address": "fa:16:3e:9b:51:30", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10933cb-e7", "ovs_interfaceid": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-15e64a65-aff8-4d65-b6c3-a981cc713ca1 req-526a5d33-8d3b-4083-8850-b7bb97522dc2 service nova] Releasing lock "refresh_cache-7f96acc3-0856-462e-9a32-879848f60a0e" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "7f96acc3-0856-462e-9a32-879848f60a0e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "7f96acc3-0856-462e-9a32-879848f60a0e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:18:09 user nova-compute[73188]: INFO nova.compute.manager [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Detaching volume 7c1538e1-84d3-4ed6-b3c8-490387dc6e5e
Aug 15 19:18:09 user nova-compute[73188]: INFO nova.virt.block_device [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Attempting to driver detach volume 7c1538e1-84d3-4ed6-b3c8-490387dc6e5e from mountpoint /dev/vdb
Aug 15 19:18:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Attempting to detach device vdb from instance 7f96acc3-0856-462e-9a32-879848f60a0e from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:18:09 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:18:09 user nova-compute[73188]:   <source dev="/dev/sdf"/>
Aug 15 19:18:09 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:18:09 user nova-compute[73188]:   <serial>7c1538e1-84d3-4ed6-b3c8-490387dc6e5e</serial>
Aug 15 19:18:09 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 19:18:09 user nova-compute[73188]: </disk>
Aug 15 19:18:09 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:18:09 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Successfully detached device vdb from instance 7f96acc3-0856-462e-9a32-879848f60a0e from the persistent domain config.
Aug 15 19:18:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7f96acc3-0856-462e-9a32-879848f60a0e from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:18:09 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:18:09 user nova-compute[73188]:   <source dev="/dev/sdf"/>
Aug 15 19:18:09 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:18:09 user nova-compute[73188]:   <serial>7c1538e1-84d3-4ed6-b3c8-490387dc6e5e</serial>
Aug 15 19:18:09 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 19:18:09 user nova-compute[73188]: </disk>
Aug 15 19:18:09 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692127089.8508718, 7f96acc3-0856-462e-9a32-879848f60a0e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7f96acc3-0856-462e-9a32-879848f60a0e {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:18:09 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Successfully detached device vdb from instance 7f96acc3-0856-462e-9a32-879848f60a0e from the live domain config.
Aug 15 19:18:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ediQvCuF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:18:09 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:18:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f7a041-b8cc-4241-8ba7-355968c8a15c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ed6beb-dbc1-42c9-8653-5702f7bea8ed]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:18:09 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:18:09 user nova-compute[73188]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:18:09 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:18:09 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:18:09 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:18:09 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:18:09 user nova-compute[73188]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e (non-flash)
Aug 15 19:18:09 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:18:09 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:18:09 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28086e1120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e'): ({'sdf'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Removing single pathed devices sdf {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21ac3b0-0b55-48a8-a1ca-c97361d68885]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.032s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9837343-bc99-42f1-9963-2c2a237480b6]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Flushing IO for device /dev/sdf {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f96b60-aa8e-4730-bfa2-25945653d760]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8870ee39-51db-4d8e-a1fe-f487655ce7ac]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] SCSI volumes sdf have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a6c26a-52af-4af8-94b8-f98df273cbca]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[39152369-b97b-4d19-be93-7aeae2dcacc1]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e, portal: 172.16.0.220,3260]
Aug 15 19:18:10 user nova-compute[73188]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e, portal: 172.16.0.220,3260] successful.
Aug 15 19:18:10 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c1538e1-84d3-4ed6-b3c8-490387dc6e5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d839184e-bfcc-4978-9c27-4ac910b0ea6f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] <== disconnect_volume: return (357ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG nova.compute.manager [req-584f55a3-bc19-45bb-8425-b8bb78bcbbb2 req-3756de5b-7931-413b-951c-43738f44f017 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Received event network-changed-c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG nova.compute.manager [req-584f55a3-bc19-45bb-8425-b8bb78bcbbb2 req-3756de5b-7931-413b-951c-43738f44f017 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Refreshing instance network info cache due to event network-changed-c10933cb-e730-47f0-9b80-fcec4cf6c359. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-584f55a3-bc19-45bb-8425-b8bb78bcbbb2 req-3756de5b-7931-413b-951c-43738f44f017 service nova] Acquiring lock "refresh_cache-7f96acc3-0856-462e-9a32-879848f60a0e" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-584f55a3-bc19-45bb-8425-b8bb78bcbbb2 req-3756de5b-7931-413b-951c-43738f44f017 service nova] Acquired lock "refresh_cache-7f96acc3-0856-462e-9a32-879848f60a0e" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG nova.network.neutron [req-584f55a3-bc19-45bb-8425-b8bb78bcbbb2 req-3756de5b-7931-413b-951c-43738f44f017 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Refreshing network info cache for port c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG nova.network.neutron [req-584f55a3-bc19-45bb-8425-b8bb78bcbbb2 req-3756de5b-7931-413b-951c-43738f44f017 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Updated VIF entry in instance network info cache for port c10933cb-e730-47f0-9b80-fcec4cf6c359. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG nova.network.neutron [req-584f55a3-bc19-45bb-8425-b8bb78bcbbb2 req-3756de5b-7931-413b-951c-43738f44f017 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Updating instance_info_cache with network_info: [{"id": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "address": "fa:16:3e:9b:51:30", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10933cb-e7", "ovs_interfaceid": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:18:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-584f55a3-bc19-45bb-8425-b8bb78bcbbb2 req-3756de5b-7931-413b-951c-43738f44f017 service nova] Releasing lock "refresh_cache-7f96acc3-0856-462e-9a32-879848f60a0e" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:18:11 user nova-compute[73188]: DEBUG nova.objects.instance [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lazy-loading 'flavor' on Instance uuid 7f96acc3-0856-462e-9a32-879848f60a0e {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:18:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-09bffb6c-32ad-4de7-992a-68901848e876 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "7f96acc3-0856-462e-9a32-879848f60a0e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.929s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:18:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "2a472af2-b10c-456b-8dba-6c75f3ab806a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:18:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:18:11 user nova-compute[73188]: INFO nova.compute.manager [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Detaching volume e82c9517-1d64-441b-b7fe-d8ad4764c476
Aug 15 19:18:11 user nova-compute[73188]: INFO nova.virt.block_device [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Attempting to driver detach volume e82c9517-1d64-441b-b7fe-d8ad4764c476 from mountpoint /dev/vdb
Aug 15 19:18:11 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Attempting to detach device vdb from instance 2a472af2-b10c-456b-8dba-6c75f3ab806a from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:18:11 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:18:11 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:18:11 user nova-compute[73188]:   <source dev="/dev/sde"/>
Aug 15 19:18:11 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:18:11 user nova-compute[73188]:   <serial>e82c9517-1d64-441b-b7fe-d8ad4764c476</serial>
Aug 15 19:18:11 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 19:18:11 user nova-compute[73188]: </disk>
Aug 15 19:18:11 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:18:11 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Successfully detached device vdb from instance 2a472af2-b10c-456b-8dba-6c75f3ab806a from the persistent domain config.
Aug 15 19:18:11 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2a472af2-b10c-456b-8dba-6c75f3ab806a from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:18:11 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:18:11 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:18:11 user nova-compute[73188]:   <source dev="/dev/sde"/>
Aug 15 19:18:11 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:18:11 user nova-compute[73188]:   <serial>e82c9517-1d64-441b-b7fe-d8ad4764c476</serial>
Aug 15 19:18:11 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 19:18:11 user nova-compute[73188]: </disk>
Aug 15 19:18:11 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:18:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:11 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692127091.915098, 2a472af2-b10c-456b-8dba-6c75f3ab806a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:18:11 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2a472af2-b10c-456b-8dba-6c75f3ab806a {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:18:11 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Successfully detached device vdb from instance 2a472af2-b10c-456b-8dba-6c75f3ab806a from the live domain config.
Aug 15 19:18:11 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:18:11 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PljsIvzG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:18:11 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:18:11 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:18:11 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:18:11 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:18:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:11 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21eb459-6c8f-4b64-aa78-d672ced6b9af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:11 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[502a0c8b-66c5-461d-9792-4b458a14744d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:11 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:18:11 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:18:11 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:18:11 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:18:11 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:18:11 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:18:11 user nova-compute[73188]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 (non-flash)
Aug 15 19:18:11 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:18:11 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:18:11 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281018c3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476'): ({'sde'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Removing single pathed devices sde {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba42c3b-753e-4742-b352-566bcce363cf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de73f77-acff-4e69-9c6c-abc92dc87263]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Flushing IO for device /dev/sde {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc74e705-3f17-47af-af06-9516b8719da6]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2f773d-c31e-4714-961c-dc6749cdd45d]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] SCSI volumes sde have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3813872f-f20a-4e27-9233-a554d89cd286]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f657ce-adaa-4660-b44c-19ee9ba7faba]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476, portal: 172.16.0.220,3260]
Aug 15 19:18:12 user nova-compute[73188]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476, portal: 172.16.0.220,3260] successful.
Aug 15 19:18:12 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82c9517-1d64-441b-b7fe-d8ad4764c476 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4809c6e4-e20c-40f4-8959-3a9f47e9cff9]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] <== disconnect_volume: return (302ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:18:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:18:13 user nova-compute[73188]: DEBUG nova.objects.instance [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'flavor' on Instance uuid 2a472af2-b10c-456b-8dba-6c75f3ab806a {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:18:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0e4ac925-9737-4e5e-89e9-c4ba74a3bf10 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.720s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:18:15 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:18:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:18:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:18:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:18:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:18:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:18:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:18 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:18:19 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:18:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:18:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:18:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:18:19 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:18:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:18:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:18:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:18:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:23 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:18:23 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:18:23 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=7175MB free_disk=25.18765640258789GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:18:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:18:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:18:23 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:18:23 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3d713d03-3e60-4dec-a295-a4652ac21842 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:18:23 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e00adf53-085f-436d-a09f-e97e92ca79cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:18:23 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 139ccf1c-4792-4653-9475-c61b1f9c4846 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:18:23 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 215077af-60a1-4a82-b24e-1545349363d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:18:23 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 2a472af2-b10c-456b-8dba-6c75f3ab806a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:18:23 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 7f96acc3-0856-462e-9a32-879848f60a0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:18:23 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 0ee7de87-76ad-48ae-8bcd-93b2792a96cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:18:23 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:18:23 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance b3dd183e-7ab1-40ae-b282-40575a9e47df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:18:23 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 182d8fc2-0246-4164-9d1b-f970cec4dd1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:18:23 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:18:23 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:18:24 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:18:24 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:18:24 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:18:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:18:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:25 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:18:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:18:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-215077af-60a1-4a82-b24e-1545349363d0" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:18:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-215077af-60a1-4a82-b24e-1545349363d0" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:18:25 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:18:25 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Updating instance_info_cache with network_info: [{"id": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "address": "fa:16:3e:d0:70:59", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38266cdc-3c", "ovs_interfaceid": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:18:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-215077af-60a1-4a82-b24e-1545349363d0" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:18:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:18:25 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:18:25 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:18:25 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:18:25 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:18:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:18:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:27 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:18:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "9940ced5-da22-4d30-8895-a1fbe03821c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:18:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "9940ced5-da22-4d30-8895-a1fbe03821c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:18:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:18:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:18:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:18:39 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:18:39 user nova-compute[73188]: INFO nova.compute.claims [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Claim successful on node user
Aug 15 19:18:40 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG nova.network.neutron [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:18:40 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:18:40 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG nova.policy [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b8737b83c944ab2bed468f6ea5cd8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72b50bc97b84e3dac8161b6a36f50ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:18:40 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Creating image(s)
Aug 15 19:18:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "/opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "/opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "/opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.168s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.169s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/disk 1073741824" returned: 0 in 0.058s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.174s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:40 user nova-compute[73188]: DEBUG nova.network.neutron [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Successfully created port: 7bcc30ef-9465-417f-9400-3c8135ca58d2 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:18:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:41 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Cannot resize image /opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:18:41 user nova-compute[73188]: DEBUG nova.objects.instance [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lazy-loading 'migration_context' on Instance uuid 9940ced5-da22-4d30-8895-a1fbe03821c8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:18:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:18:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Ensure instance console log exists: /opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:18:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:18:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:18:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:18:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:41 user nova-compute[73188]: DEBUG nova.network.neutron [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Successfully updated port: 7bcc30ef-9465-417f-9400-3c8135ca58d2 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:18:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "refresh_cache-9940ced5-da22-4d30-8895-a1fbe03821c8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:18:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquired lock "refresh_cache-9940ced5-da22-4d30-8895-a1fbe03821c8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:18:41 user nova-compute[73188]: DEBUG nova.network.neutron [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:18:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-aa11e83d-69e3-434d-a68c-37692947e33a req-d5959c11-53fc-410a-8097-d00fb46abe7f service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Received event network-changed-7bcc30ef-9465-417f-9400-3c8135ca58d2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:18:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-aa11e83d-69e3-434d-a68c-37692947e33a req-d5959c11-53fc-410a-8097-d00fb46abe7f service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Refreshing instance network info cache due to event network-changed-7bcc30ef-9465-417f-9400-3c8135ca58d2. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:18:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-aa11e83d-69e3-434d-a68c-37692947e33a req-d5959c11-53fc-410a-8097-d00fb46abe7f service nova] Acquiring lock "refresh_cache-9940ced5-da22-4d30-8895-a1fbe03821c8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:18:41 user nova-compute[73188]: DEBUG nova.network.neutron [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.network.neutron [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Updating instance_info_cache with network_info: [{"id": "7bcc30ef-9465-417f-9400-3c8135ca58d2", "address": "fa:16:3e:48:d8:ca", "network": {"id": "852c135b-1d66-4329-8090-3770310ffce0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1628017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72b50bc97b84e3dac8161b6a36f50ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcc30ef-94", "ovs_interfaceid": "7bcc30ef-9465-417f-9400-3c8135ca58d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Releasing lock "refresh_cache-9940ced5-da22-4d30-8895-a1fbe03821c8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Instance network_info: |[{"id": "7bcc30ef-9465-417f-9400-3c8135ca58d2", "address": "fa:16:3e:48:d8:ca", "network": {"id": "852c135b-1d66-4329-8090-3770310ffce0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1628017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72b50bc97b84e3dac8161b6a36f50ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcc30ef-94", "ovs_interfaceid": "7bcc30ef-9465-417f-9400-3c8135ca58d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-aa11e83d-69e3-434d-a68c-37692947e33a req-d5959c11-53fc-410a-8097-d00fb46abe7f service nova] Acquired lock "refresh_cache-9940ced5-da22-4d30-8895-a1fbe03821c8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.network.neutron [req-aa11e83d-69e3-434d-a68c-37692947e33a req-d5959c11-53fc-410a-8097-d00fb46abe7f service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Refreshing network info cache for port 7bcc30ef-9465-417f-9400-3c8135ca58d2 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Start _get_guest_xml network_info=[{"id": "7bcc30ef-9465-417f-9400-3c8135ca58d2", "address": "fa:16:3e:48:d8:ca", "network": {"id": "852c135b-1d66-4329-8090-3770310ffce0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1628017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72b50bc97b84e3dac8161b6a36f50ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcc30ef-94", "ovs_interfaceid": "7bcc30ef-9465-417f-9400-3c8135ca58d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:18:42 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:18:42 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-242031766',display_name='tempest-VolumesSnapshotTestJSON-instance-242031766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-242031766',id=30,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfxj4JDnpghGORnSVuJLRN6X6hshHY6ka06lKhRqN9JRLo1kT68CrPn2Y5onzVU6oI5cAsgvpHkhcYWkd5SvqFqGgAsMgdNu2Cv7f421ik6/hJjNEVVfnOeAORpsr7KLQ==',key_name='tempest-keypair-340063242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f72b50bc97b84e3dac8161b6a36f50ab',ramdisk_id='',reservation_id='r-cbq7h05v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-564329204',owner_user_name='tempest-VolumesSnapshotTestJSON-564329204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:18:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b8737b83c944ab2bed468f6ea5cd8ee',uuid=9940ced5-da22-4d30-8895-a1fbe03821c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bcc30ef-9465-417f-9400-3c8135ca58d2", "address": "fa:16:3e:48:d8:ca", "network": {"id": "852c135b-1d66-4329-8090-3770310ffce0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1628017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72b50bc97b84e3dac8161b6a36f50ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcc30ef-94", "ovs_interfaceid": "7bcc30ef-9465-417f-9400-3c8135ca58d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Converting VIF {"id": "7bcc30ef-9465-417f-9400-3c8135ca58d2", "address": "fa:16:3e:48:d8:ca", "network": {"id": "852c135b-1d66-4329-8090-3770310ffce0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1628017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72b50bc97b84e3dac8161b6a36f50ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcc30ef-94", "ovs_interfaceid": "7bcc30ef-9465-417f-9400-3c8135ca58d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:d8:ca,bridge_name='br-int',has_traffic_filtering=True,id=7bcc30ef-9465-417f-9400-3c8135ca58d2,network=Network(852c135b-1d66-4329-8090-3770310ffce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcc30ef-94') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.objects.instance [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lazy-loading 'pci_devices' on Instance uuid 9940ced5-da22-4d30-8895-a1fbe03821c8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:18:42 user nova-compute[73188]:   <uuid>9940ced5-da22-4d30-8895-a1fbe03821c8</uuid>
Aug 15 19:18:42 user nova-compute[73188]:   <name>instance-0000001e</name>
Aug 15 19:18:42 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:18:42 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:18:42 user nova-compute[73188]:   <metadata>
Aug 15 19:18:42 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:18:42 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:18:42 user nova-compute[73188]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-242031766</nova:name>
Aug 15 19:18:42 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:18:42</nova:creationTime>
Aug 15 19:18:42 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:18:42 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:18:42 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:18:42 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:18:42 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:18:42 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:18:42 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:18:42 user nova-compute[73188]:       <nova:owner>
Aug 15 19:18:42 user nova-compute[73188]:         <nova:user uuid="0b8737b83c944ab2bed468f6ea5cd8ee">tempest-VolumesSnapshotTestJSON-564329204-project-member</nova:user>
Aug 15 19:18:42 user nova-compute[73188]:         <nova:project uuid="f72b50bc97b84e3dac8161b6a36f50ab">tempest-VolumesSnapshotTestJSON-564329204</nova:project>
Aug 15 19:18:42 user nova-compute[73188]:       </nova:owner>
Aug 15 19:18:42 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:18:42 user nova-compute[73188]:       <nova:ports>
Aug 15 19:18:42 user nova-compute[73188]:         <nova:port uuid="7bcc30ef-9465-417f-9400-3c8135ca58d2">
Aug 15 19:18:42 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 19:18:42 user nova-compute[73188]:         </nova:port>
Aug 15 19:18:42 user nova-compute[73188]:       </nova:ports>
Aug 15 19:18:42 user nova-compute[73188]:     </nova:instance>
Aug 15 19:18:42 user nova-compute[73188]:   </metadata>
Aug 15 19:18:42 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:18:42 user nova-compute[73188]:     <system>
Aug 15 19:18:42 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:18:42 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:18:42 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:18:42 user nova-compute[73188]:       <entry name="serial">9940ced5-da22-4d30-8895-a1fbe03821c8</entry>
Aug 15 19:18:42 user nova-compute[73188]:       <entry name="uuid">9940ced5-da22-4d30-8895-a1fbe03821c8</entry>
Aug 15 19:18:42 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:18:42 user nova-compute[73188]:     </system>
Aug 15 19:18:42 user nova-compute[73188]:   </sysinfo>
Aug 15 19:18:42 user nova-compute[73188]:   <os>
Aug 15 19:18:42 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:18:42 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:18:42 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:18:42 user nova-compute[73188]:   </os>
Aug 15 19:18:42 user nova-compute[73188]:   <features>
Aug 15 19:18:42 user nova-compute[73188]:     <acpi/>
Aug 15 19:18:42 user nova-compute[73188]:     <apic/>
Aug 15 19:18:42 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:18:42 user nova-compute[73188]:   </features>
Aug 15 19:18:42 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:18:42 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:18:42 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:18:42 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:18:42 user nova-compute[73188]:   </clock>
Aug 15 19:18:42 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:18:42 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:18:42 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:18:42 user nova-compute[73188]:   </cpu>
Aug 15 19:18:42 user nova-compute[73188]:   <devices>
Aug 15 19:18:42 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:18:42 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:18:42 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/disk"/>
Aug 15 19:18:42 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:18:42 user nova-compute[73188]:     </disk>
Aug 15 19:18:42 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:18:42 user nova-compute[73188]:       <mac address="fa:16:3e:48:d8:ca"/>
Aug 15 19:18:42 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:18:42 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:18:42 user nova-compute[73188]:       <target dev="tap7bcc30ef-94"/>
Aug 15 19:18:42 user nova-compute[73188]:     </interface>
Aug 15 19:18:42 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:18:42 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/console.log" append="off"/>
Aug 15 19:18:42 user nova-compute[73188]:     </serial>
Aug 15 19:18:42 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:18:42 user nova-compute[73188]:     <video>
Aug 15 19:18:42 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:18:42 user nova-compute[73188]:     </video>
Aug 15 19:18:42 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:18:42 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:18:42 user nova-compute[73188]:     </rng>
Aug 15 19:18:42 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:18:42 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:18:42 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:18:42 user nova-compute[73188]:     </memballoon>
Aug 15 19:18:42 user nova-compute[73188]:   </devices>
Aug 15 19:18:42 user nova-compute[73188]: </domain>
Aug 15 19:18:42 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-242031766',display_name='tempest-VolumesSnapshotTestJSON-instance-242031766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-242031766',id=30,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfxj4JDnpghGORnSVuJLRN6X6hshHY6ka06lKhRqN9JRLo1kT68CrPn2Y5onzVU6oI5cAsgvpHkhcYWkd5SvqFqGgAsMgdNu2Cv7f421ik6/hJjNEVVfnOeAORpsr7KLQ==',key_name='tempest-keypair-340063242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f72b50bc97b84e3dac8161b6a36f50ab',ramdisk_id='',reservation_id='r-cbq7h05v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-564329204',owner_user_name='tempest-VolumesSnapshotTestJSON-564329204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:18:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b8737b83c944ab2bed468f6ea5cd8ee',uuid=9940ced5-da22-4d30-8895-a1fbe03821c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bcc30ef-9465-417f-9400-3c8135ca58d2", "address": "fa:16:3e:48:d8:ca", "network": {"id": "852c135b-1d66-4329-8090-3770310ffce0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1628017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72b50bc97b84e3dac8161b6a36f50ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcc30ef-94", "ovs_interfaceid": "7bcc30ef-9465-417f-9400-3c8135ca58d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Converting VIF {"id": "7bcc30ef-9465-417f-9400-3c8135ca58d2", "address": "fa:16:3e:48:d8:ca", "network": {"id": "852c135b-1d66-4329-8090-3770310ffce0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1628017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72b50bc97b84e3dac8161b6a36f50ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcc30ef-94", "ovs_interfaceid": "7bcc30ef-9465-417f-9400-3c8135ca58d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:d8:ca,bridge_name='br-int',has_traffic_filtering=True,id=7bcc30ef-9465-417f-9400-3c8135ca58d2,network=Network(852c135b-1d66-4329-8090-3770310ffce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcc30ef-94') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG os_vif [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:d8:ca,bridge_name='br-int',has_traffic_filtering=True,id=7bcc30ef-9465-417f-9400-3c8135ca58d2,network=Network(852c135b-1d66-4329-8090-3770310ffce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcc30ef-94') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bcc30ef-94, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7bcc30ef-94, col_values=(('external_ids', {'iface-id': '7bcc30ef-9465-417f-9400-3c8135ca58d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:d8:ca', 'vm-uuid': '9940ced5-da22-4d30-8895-a1fbe03821c8'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:42 user nova-compute[73188]: INFO os_vif [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:d8:ca,bridge_name='br-int',has_traffic_filtering=True,id=7bcc30ef-9465-417f-9400-3c8135ca58d2,network=Network(852c135b-1d66-4329-8090-3770310ffce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcc30ef-94')
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] No VIF found with MAC fa:16:3e:48:d8:ca, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.network.neutron [req-aa11e83d-69e3-434d-a68c-37692947e33a req-d5959c11-53fc-410a-8097-d00fb46abe7f service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Updated VIF entry in instance network info cache for port 7bcc30ef-9465-417f-9400-3c8135ca58d2. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.network.neutron [req-aa11e83d-69e3-434d-a68c-37692947e33a req-d5959c11-53fc-410a-8097-d00fb46abe7f service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Updating instance_info_cache with network_info: [{"id": "7bcc30ef-9465-417f-9400-3c8135ca58d2", "address": "fa:16:3e:48:d8:ca", "network": {"id": "852c135b-1d66-4329-8090-3770310ffce0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1628017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72b50bc97b84e3dac8161b6a36f50ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcc30ef-94", "ovs_interfaceid": "7bcc30ef-9465-417f-9400-3c8135ca58d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-aa11e83d-69e3-434d-a68c-37692947e33a req-d5959c11-53fc-410a-8097-d00fb46abe7f service nova] Releasing lock "refresh_cache-9940ced5-da22-4d30-8895-a1fbe03821c8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:18:42 user nova-compute[73188]: INFO nova.compute.manager [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Rescuing
Aug 15 19:18:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "refresh_cache-7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquired lock "refresh_cache-7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:18:42 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:18:43 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Updating instance_info_cache with network_info: [{"id": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "address": "fa:16:3e:11:3f:a6", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da073c1-08", "ovs_interfaceid": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:18:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Releasing lock "refresh_cache-7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:18:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:43 user nova-compute[73188]: DEBUG nova.compute.manager [req-275c9039-1414-4a8f-a311-e0fe4698cda0 req-259a1b36-befa-45ad-8336-e8f28a666d02 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received event network-vif-unplugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:18:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-275c9039-1414-4a8f-a311-e0fe4698cda0 req-259a1b36-befa-45ad-8336-e8f28a666d02 service nova] Acquiring lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:18:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-275c9039-1414-4a8f-a311-e0fe4698cda0 req-259a1b36-befa-45ad-8336-e8f28a666d02 service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:18:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-275c9039-1414-4a8f-a311-e0fe4698cda0 req-259a1b36-befa-45ad-8336-e8f28a666d02 service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:18:43 user nova-compute[73188]: DEBUG nova.compute.manager [req-275c9039-1414-4a8f-a311-e0fe4698cda0 req-259a1b36-befa-45ad-8336-e8f28a666d02 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] No waiting events found dispatching network-vif-unplugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:18:43 user nova-compute[73188]: WARNING nova.compute.manager [req-275c9039-1414-4a8f-a311-e0fe4698cda0 req-259a1b36-befa-45ad-8336-e8f28a666d02 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received unexpected event network-vif-unplugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 for instance with vm_state active and task_state rescuing.
Aug 15 19:18:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:44 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Instance destroyed successfully.
Aug 15 19:18:44 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Attempting a stable device rescue
Aug 15 19:18:44 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73188) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 19:18:44 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Instance directory exists: not creating {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 19:18:44 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Creating image(s)
Aug 15 19:18:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "/opt/stack/data/nova/instances/7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:18:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "/opt/stack/data/nova/instances/7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:18:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "/opt/stack/data/nova/instances/7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:18:44 user nova-compute[73188]: DEBUG nova.objects.instance [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:18:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "a90f38dd850e9266964344af8413670f672fe9db" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:18:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "a90f38dd850e9266964344af8413670f672fe9db" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:18:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a90f38dd850e9266964344af8413670f672fe9db.part --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:45 user nova-compute[73188]: DEBUG nova.compute.manager [req-83b95b44-4d84-4103-a35a-046b9c0a3c68 req-30db5723-1c0c-4d68-92da-28be2c509d3e service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received event network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:18:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-83b95b44-4d84-4103-a35a-046b9c0a3c68 req-30db5723-1c0c-4d68-92da-28be2c509d3e service nova] Acquiring lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:18:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-83b95b44-4d84-4103-a35a-046b9c0a3c68 req-30db5723-1c0c-4d68-92da-28be2c509d3e service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:18:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-83b95b44-4d84-4103-a35a-046b9c0a3c68 req-30db5723-1c0c-4d68-92da-28be2c509d3e service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:18:45 user nova-compute[73188]: DEBUG nova.compute.manager [req-83b95b44-4d84-4103-a35a-046b9c0a3c68 req-30db5723-1c0c-4d68-92da-28be2c509d3e service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] No waiting events found dispatching network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:18:45 user nova-compute[73188]: WARNING nova.compute.manager [req-83b95b44-4d84-4103-a35a-046b9c0a3c68 req-30db5723-1c0c-4d68-92da-28be2c509d3e service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received unexpected event network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 for instance with vm_state active and task_state rescuing.
Aug 15 19:18:45 user nova-compute[73188]: DEBUG nova.compute.manager [req-83b95b44-4d84-4103-a35a-046b9c0a3c68 req-30db5723-1c0c-4d68-92da-28be2c509d3e service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Received event network-vif-plugged-7bcc30ef-9465-417f-9400-3c8135ca58d2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:18:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-83b95b44-4d84-4103-a35a-046b9c0a3c68 req-30db5723-1c0c-4d68-92da-28be2c509d3e service nova] Acquiring lock "9940ced5-da22-4d30-8895-a1fbe03821c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:18:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-83b95b44-4d84-4103-a35a-046b9c0a3c68 req-30db5723-1c0c-4d68-92da-28be2c509d3e service nova] Lock "9940ced5-da22-4d30-8895-a1fbe03821c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:18:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-83b95b44-4d84-4103-a35a-046b9c0a3c68 req-30db5723-1c0c-4d68-92da-28be2c509d3e service nova] Lock "9940ced5-da22-4d30-8895-a1fbe03821c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:18:45 user nova-compute[73188]: DEBUG nova.compute.manager [req-83b95b44-4d84-4103-a35a-046b9c0a3c68 req-30db5723-1c0c-4d68-92da-28be2c509d3e service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] No waiting events found dispatching network-vif-plugged-7bcc30ef-9465-417f-9400-3c8135ca58d2 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:18:45 user nova-compute[73188]: WARNING nova.compute.manager [req-83b95b44-4d84-4103-a35a-046b9c0a3c68 req-30db5723-1c0c-4d68-92da-28be2c509d3e service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Received unexpected event network-vif-plugged-7bcc30ef-9465-417f-9400-3c8135ca58d2 for instance with vm_state building and task_state spawning.
Aug 15 19:18:45 user nova-compute[73188]: DEBUG nova.compute.manager [req-83b95b44-4d84-4103-a35a-046b9c0a3c68 req-30db5723-1c0c-4d68-92da-28be2c509d3e service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Received event network-vif-plugged-7bcc30ef-9465-417f-9400-3c8135ca58d2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:18:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-83b95b44-4d84-4103-a35a-046b9c0a3c68 req-30db5723-1c0c-4d68-92da-28be2c509d3e service nova] Acquiring lock "9940ced5-da22-4d30-8895-a1fbe03821c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:18:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-83b95b44-4d84-4103-a35a-046b9c0a3c68 req-30db5723-1c0c-4d68-92da-28be2c509d3e service nova] Lock "9940ced5-da22-4d30-8895-a1fbe03821c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:18:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-83b95b44-4d84-4103-a35a-046b9c0a3c68 req-30db5723-1c0c-4d68-92da-28be2c509d3e service nova] Lock "9940ced5-da22-4d30-8895-a1fbe03821c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:18:45 user nova-compute[73188]: DEBUG nova.compute.manager [req-83b95b44-4d84-4103-a35a-046b9c0a3c68 req-30db5723-1c0c-4d68-92da-28be2c509d3e service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] No waiting events found dispatching network-vif-plugged-7bcc30ef-9465-417f-9400-3c8135ca58d2 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:18:45 user nova-compute[73188]: WARNING nova.compute.manager [req-83b95b44-4d84-4103-a35a-046b9c0a3c68 req-30db5723-1c0c-4d68-92da-28be2c509d3e service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Received unexpected event network-vif-plugged-7bcc30ef-9465-417f-9400-3c8135ca58d2 for instance with vm_state building and task_state spawning.
Aug 15 19:18:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a90f38dd850e9266964344af8413670f672fe9db.part --force-share --output=json" returned: 0 in 0.174s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:45 user nova-compute[73188]: DEBUG nova.virt.images [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] e343d690-835c-4896-9ef3-256da377989f was qcow2, converting to raw {{(pid=73188) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 19:18:45 user nova-compute[73188]: DEBUG nova.privsep.utils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73188) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 19:18:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a90f38dd850e9266964344af8413670f672fe9db.part /opt/stack/data/nova/instances/_base/a90f38dd850e9266964344af8413670f672fe9db.converted {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a90f38dd850e9266964344af8413670f672fe9db.part /opt/stack/data/nova/instances/_base/a90f38dd850e9266964344af8413670f672fe9db.converted" returned: 0 in 0.264s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a90f38dd850e9266964344af8413670f672fe9db.converted --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a90f38dd850e9266964344af8413670f672fe9db.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "a90f38dd850e9266964344af8413670f672fe9db" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.668s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "a90f38dd850e9266964344af8413670f672fe9db" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "a90f38dd850e9266964344af8413670f672fe9db" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a90f38dd850e9266964344af8413670f672fe9db --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a90f38dd850e9266964344af8413670f672fe9db --force-share --output=json" returned: 0 in 0.187s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a90f38dd850e9266964344af8413670f672fe9db,backing_fmt=raw /opt/stack/data/nova/instances/7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430/disk.rescue {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127126.2421043, 9940ced5-da22-4d30-8895-a1fbe03821c8 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:18:46 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] VM Resumed (Lifecycle Event)
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a90f38dd850e9266964344af8413670f672fe9db,backing_fmt=raw /opt/stack/data/nova/instances/7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430/disk.rescue" returned: 0 in 0.047s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "a90f38dd850e9266964344af8413670f672fe9db" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.objects.instance [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'migration_context' on Instance uuid 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:18:46 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Instance spawned successfully.
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Start _get_guest_xml network_info=[{"id": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "address": "fa:16:3e:11:3f:a6", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "vif_mac": "fa:16:3e:11:3f:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da073c1-08", "ovs_interfaceid": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e343d690-835c-4896-9ef3-256da377989f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AJRehkFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430', 'attached_at': '', 'detached_at': '', 'volume_id': '757d7792-2f2c-4169-b1d1-c818a7576c54', 'serial': '757d7792-2f2c-4169-b1d1-c818a7576c54'}, 'attachment_id': '615331b7-1251-4794-bbd0-624556fbd0be', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.objects.instance [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'resources' on Instance uuid 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.objects.instance [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'numa_topology' on Instance uuid 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:18:46 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127126.2439027, 9940ced5-da22-4d30-8895-a1fbe03821c8 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:18:46 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] VM Started (Lifecycle Event)
Aug 15 19:18:46 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:18:46 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.objects.instance [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AJRehkFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:18:46 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:18:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:18:46 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:18:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:18:46 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:18:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:46 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:18:46 user nova-compute[73188]: INFO nova.compute.manager [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Took 6.09 seconds to spawn the instance on the hypervisor.
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d646c7-a964-4111-aeb9-528a3acc0115]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = AJRehkFf\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 19:18:46 user nova-compute[73188]: node.name = iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54
Aug 15 19:18:46 user nova-compute[73188]: node.tpgt = -1
Aug 15 19:18:46 user nova-compute[73188]: node.startup = automatic
Aug 15 19:18:46 user nova-compute[73188]: node.leading_login = No
Aug 15 19:18:46 user nova-compute[73188]: iface.iscsi_ifacename = default
Aug 15 19:18:46 user nova-compute[73188]: iface.net_ifacename = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.ipaddress = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.prefix_len = 0
Aug 15 19:18:46 user nova-compute[73188]: iface.hwaddress = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.transport_name = tcp
Aug 15 19:18:46 user nova-compute[73188]: iface.initiatorname = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.state = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.vlan_id = 0
Aug 15 19:18:46 user nova-compute[73188]: iface.vlan_priority = 0
Aug 15 19:18:46 user nova-compute[73188]: iface.vlan_state = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.iface_num = 0
Aug 15 19:18:46 user nova-compute[73188]: iface.mtu = 0
Aug 15 19:18:46 user nova-compute[73188]: iface.port = 0
Aug 15 19:18:46 user nova-compute[73188]: iface.bootproto = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.subnet_mask = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.gateway = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.dhcp_alt_client_id = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.dhcp_dns = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.dhcp_learn_iqn = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.dhcp_vendor_id_state = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.dhcp_vendor_id = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.dhcp_slp_da = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.fragmentation = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.gratuitous_arp = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.incoming_forwarding = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.tos_state = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.tos = 0
Aug 15 19:18:46 user nova-compute[73188]: iface.ttl = 0
Aug 15 19:18:46 user nova-compute[73188]: iface.delayed_ack = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.tcp_nagle = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.tcp_wsf_state = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.tcp_wsf = 0
Aug 15 19:18:46 user nova-compute[73188]: iface.tcp_timer_scale = 0
Aug 15 19:18:46 user nova-compute[73188]: iface.tcp_timestamp = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.redirect = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.def_task_mgmt_timeout = 0
Aug 15 19:18:46 user nova-compute[73188]: iface.header_digest = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.data_digest = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.immediate_data = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.initial_r2t = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.data_seq_inorder = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.data_pdu_inorder = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.erl = 0
Aug 15 19:18:46 user nova-compute[73188]: iface.max_receive_data_len = 0
Aug 15 19:18:46 user nova-compute[73188]: iface.first_burst_len = 0
Aug 15 19:18:46 user nova-compute[73188]: iface.max_outstanding_r2t = 0
Aug 15 19:18:46 user nova-compute[73188]: iface.max_burst_len = 0
Aug 15 19:18:46 user nova-compute[73188]: iface.chap_auth = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.bidi_chap = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.strict_login_compliance = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.discovery_auth = <empty>
Aug 15 19:18:46 user nova-compute[73188]: iface.discovery_logout = <empty>
Aug 15 19:18:46 user nova-compute[73188]: node.discovery_address = <empty>
Aug 15 19:18:46 user nova-compute[73188]: node.discovery_port = 0
Aug 15 19:18:46 user nova-compute[73188]: node.discovery_type = static
Aug 15 19:18:46 user nova-compute[73188]: node.session.initial_cmdsn = 0
Aug 15 19:18:46 user nova-compute[73188]: node.session.initial_login_retry_max = 8
Aug 15 19:18:46 user nova-compute[73188]: node.session.xmit_thread_priority = -20
Aug 15 19:18:46 user nova-compute[73188]: node.session.cmds_max = 128
Aug 15 19:18:46 user nova-compute[73188]: node.session.queue_depth = 32
Aug 15 19:18:46 user nova-compute[73188]: node.session.nr_sessions = 1
Aug 15 19:18:46 user nova-compute[73188]: node.session.auth.authmethod = CHAP
Aug 15 19:18:46 user nova-compute[73188]: node.session.auth.username = AJRehkFf
Aug 15 19:18:46 user nova-compute[73188]: node.session.auth.password = ***
Aug 15 19:18:46 user nova-compute[73188]: node.session.auth.username_in = <empty>
Aug 15 19:18:46 user nova-compute[73188]: node.session.auth.password_in = <empty>
Aug 15 19:18:46 user nova-compute[73188]: node.session.auth.chap_algs = MD5
Aug 15 19:18:46 user nova-compute[73188]: node.session.timeo.replacement_timeout = 120
Aug 15 19:18:46 user nova-compute[73188]: node.session.err_timeo.abort_timeout = 15
Aug 15 19:18:46 user nova-compute[73188]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 19:18:46 user nova-compute[73188]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 19:18:46 user nova-compute[73188]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 19:18:46 user nova-compute[73188]: node.session.iscsi.FastAbort = Yes
Aug 15 19:18:46 user nova-compute[73188]: node.session.iscsi.InitialR2T = No
Aug 15 19:18:46 user nova-compute[73188]: node.session.iscsi.ImmediateData = Yes
Aug 15 19:18:46 user nova-compute[73188]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 19:18:46 user nova-compute[73188]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 19:18:46 user nova-compute[73188]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 19:18:46 user nova-compute[73188]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 19:18:46 user nova-compute[73188]: node.session.iscsi.MaxConnections = 1
Aug 15 19:18:46 user nova-compute[73188]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 19:18:46 user nova-compute[73188]: node.session.iscsi.ERL = 0
Aug 15 19:18:46 user nova-compute[73188]: node.session.scan = manual
Aug 15 19:18:46 user nova-compute[73188]: node.session.reopen_max = 0
Aug 15 19:18:46 user nova-compute[73188]: node.conn[0].address = 172.16.0.220
Aug 15 19:18:46 user nova-compute[73188]: node.conn[0].port = 3260
Aug 15 19:18:46 user nova-compute[73188]: node.conn[0].startup = manual
Aug 15 19:18:46 user nova-compute[73188]: node.conn[0].tcp.window_size = 524288
Aug 15 19:18:46 user nova-compute[73188]: node.conn[0].tcp.type_of_service = 0
Aug 15 19:18:46 user nova-compute[73188]: node.conn[0].timeo.logout_timeout = 15
Aug 15 19:18:46 user nova-compute[73188]: node.conn[0].timeo.login_timeout = 15
Aug 15 19:18:46 user nova-compute[73188]: node.conn[0].timeo.auth_timeout = 45
Aug 15 19:18:46 user nova-compute[73188]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 19:18:46 user nova-compute[73188]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 19:18:46 user nova-compute[73188]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 19:18:46 user nova-compute[73188]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 19:18:46 user nova-compute[73188]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 19:18:46 user nova-compute[73188]: node.conn[0].iscsi.DataDigest = None
Aug 15 19:18:46 user nova-compute[73188]: node.conn[0].iscsi.IFMarker = No
Aug 15 19:18:46 user nova-compute[73188]: node.conn[0].iscsi.OFMarker = No
Aug 15 19:18:46 user nova-compute[73188]: # END RECORD
Aug 15 19:18:46 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f380578b-ee8d-4568-80f7-f2f749509eb7]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82d8c3c-d01c-459a-8224-8a47a11ab4df]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AJRehkFf {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:46 user nova-compute[73188]: INFO nova.compute.manager [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Took 6.92 seconds to build instance.
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AJRehkFf" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de32266-49f8-41d7-8953-4ddabef28b55]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AJRehkFf'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3a4ae951-3ff2-474f-83b5-024eadd8396b tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "9940ced5-da22-4d30-8895-a1fbe03821c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.014s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ec1938-2fc1-45f9-87f4-d13874a60031]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5dd5ac-006a-45f6-94e7-5488e24b80aa]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:18:46 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:18:46 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:18:46 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:18:46 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:18:46 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:18:46 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.141s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] HCTL ('34', '0', '0', 0) found on session 28 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[de39e883-5168-4cc0-a318-21ec5764cd97]: (4, ('0 0 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Searching for a device in session 28 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AJRehkFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.164s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] <== connect_volume: return (165ms) {'type': 'block', 'scsi_wwn': '26434333235633631', 'path': '/dev/sdc'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434333235633631', 'path': '/dev/sdc'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-689162011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-689162011',id=27,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:17:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ab4e1cccd434f6c83f2f9e4687d274e',ramdisk_id='',reservation_id='r-uzmnlu74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:17:21Z,user_data=None,user_id='bad952eceaec400396fd0a28c438c761',uuid=7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "address": "fa:16:3e:11:3f:a6", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "vif_mac": "fa:16:3e:11:3f:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da073c1-08", "ovs_interfaceid": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converting VIF {"id": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "address": "fa:16:3e:11:3f:a6", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "vif_mac": "fa:16:3e:11:3f:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da073c1-08", "ovs_interfaceid": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:3f:a6,bridge_name='br-int',has_traffic_filtering=True,id=6da073c1-0834-4a3c-92e1-9d89e1bc5fe0,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da073c1-08') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.objects.instance [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'pci_devices' on Instance uuid 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:18:46 user nova-compute[73188]:   <uuid>7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430</uuid>
Aug 15 19:18:46 user nova-compute[73188]:   <name>instance-0000001b</name>
Aug 15 19:18:46 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:18:46 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:18:46 user nova-compute[73188]:   <metadata>
Aug 15 19:18:46 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:18:46 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:18:46 user nova-compute[73188]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-689162011</nova:name>
Aug 15 19:18:46 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:18:46</nova:creationTime>
Aug 15 19:18:46 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:18:46 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:18:46 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:18:46 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:18:46 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:18:46 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:18:46 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:18:46 user nova-compute[73188]:       <nova:owner>
Aug 15 19:18:46 user nova-compute[73188]:         <nova:user uuid="bad952eceaec400396fd0a28c438c761">tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member</nova:user>
Aug 15 19:18:46 user nova-compute[73188]:         <nova:project uuid="0ab4e1cccd434f6c83f2f9e4687d274e">tempest-ServerBootFromVolumeStableRescueTest-1886926549</nova:project>
Aug 15 19:18:46 user nova-compute[73188]:       </nova:owner>
Aug 15 19:18:46 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:18:46 user nova-compute[73188]:       <nova:ports>
Aug 15 19:18:46 user nova-compute[73188]:         <nova:port uuid="6da073c1-0834-4a3c-92e1-9d89e1bc5fe0">
Aug 15 19:18:46 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 19:18:46 user nova-compute[73188]:         </nova:port>
Aug 15 19:18:46 user nova-compute[73188]:       </nova:ports>
Aug 15 19:18:46 user nova-compute[73188]:     </nova:instance>
Aug 15 19:18:46 user nova-compute[73188]:   </metadata>
Aug 15 19:18:46 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:18:46 user nova-compute[73188]:     <system>
Aug 15 19:18:46 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:18:46 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:18:46 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:18:46 user nova-compute[73188]:       <entry name="serial">7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430</entry>
Aug 15 19:18:46 user nova-compute[73188]:       <entry name="uuid">7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430</entry>
Aug 15 19:18:46 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:18:46 user nova-compute[73188]:     </system>
Aug 15 19:18:46 user nova-compute[73188]:   </sysinfo>
Aug 15 19:18:46 user nova-compute[73188]:   <os>
Aug 15 19:18:46 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:18:46 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:18:46 user nova-compute[73188]:   </os>
Aug 15 19:18:46 user nova-compute[73188]:   <features>
Aug 15 19:18:46 user nova-compute[73188]:     <acpi/>
Aug 15 19:18:46 user nova-compute[73188]:     <apic/>
Aug 15 19:18:46 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:18:46 user nova-compute[73188]:   </features>
Aug 15 19:18:46 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:18:46 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:18:46 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:18:46 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:18:46 user nova-compute[73188]:   </clock>
Aug 15 19:18:46 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:18:46 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:18:46 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:18:46 user nova-compute[73188]:   </cpu>
Aug 15 19:18:46 user nova-compute[73188]:   <devices>
Aug 15 19:18:46 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:18:46 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:18:46 user nova-compute[73188]:       <source dev="/dev/sdc"/>
Aug 15 19:18:46 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:18:46 user nova-compute[73188]:       <serial>757d7792-2f2c-4169-b1d1-c818a7576c54</serial>
Aug 15 19:18:46 user nova-compute[73188]:     </disk>
Aug 15 19:18:46 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:18:46 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:18:46 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430/disk.rescue"/>
Aug 15 19:18:46 user nova-compute[73188]:       <target dev="vdb" bus="virtio"/>
Aug 15 19:18:46 user nova-compute[73188]:       <boot order="1"/>
Aug 15 19:18:46 user nova-compute[73188]:     </disk>
Aug 15 19:18:46 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:18:46 user nova-compute[73188]:       <mac address="fa:16:3e:11:3f:a6"/>
Aug 15 19:18:46 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:18:46 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:18:46 user nova-compute[73188]:       <target dev="tap6da073c1-08"/>
Aug 15 19:18:46 user nova-compute[73188]:     </interface>
Aug 15 19:18:46 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:18:46 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430/console.log" append="off"/>
Aug 15 19:18:46 user nova-compute[73188]:     </serial>
Aug 15 19:18:46 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:18:46 user nova-compute[73188]:     <video>
Aug 15 19:18:46 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:18:46 user nova-compute[73188]:     </video>
Aug 15 19:18:46 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:18:46 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:18:46 user nova-compute[73188]:     </rng>
Aug 15 19:18:46 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:18:46 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:18:46 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:18:46 user nova-compute[73188]:     </memballoon>
Aug 15 19:18:46 user nova-compute[73188]:   </devices>
Aug 15 19:18:46 user nova-compute[73188]: </domain>
Aug 15 19:18:46 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:18:46 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Instance destroyed successfully.
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:18:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] No VIF found with MAC fa:16:3e:11:3f:a6, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:18:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:48 user nova-compute[73188]: DEBUG nova.compute.manager [req-ab29c01c-93b6-4a92-875a-780791a27e52 req-5d6cca95-a130-4204-81d6-71bfb82af0f8 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received event network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:18:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ab29c01c-93b6-4a92-875a-780791a27e52 req-5d6cca95-a130-4204-81d6-71bfb82af0f8 service nova] Acquiring lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:18:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ab29c01c-93b6-4a92-875a-780791a27e52 req-5d6cca95-a130-4204-81d6-71bfb82af0f8 service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:18:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ab29c01c-93b6-4a92-875a-780791a27e52 req-5d6cca95-a130-4204-81d6-71bfb82af0f8 service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:18:48 user nova-compute[73188]: DEBUG nova.compute.manager [req-ab29c01c-93b6-4a92-875a-780791a27e52 req-5d6cca95-a130-4204-81d6-71bfb82af0f8 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] No waiting events found dispatching network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:18:48 user nova-compute[73188]: WARNING nova.compute.manager [req-ab29c01c-93b6-4a92-875a-780791a27e52 req-5d6cca95-a130-4204-81d6-71bfb82af0f8 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received unexpected event network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 for instance with vm_state active and task_state rescuing.
Aug 15 19:18:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-e3e0e6b5-b949-4cdc-a22b-7f5127cd4eb1 req-d3d2c0b2-9b96-4c82-9b22-41b6d3997360 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received event network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:18:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e3e0e6b5-b949-4cdc-a22b-7f5127cd4eb1 req-d3d2c0b2-9b96-4c82-9b22-41b6d3997360 service nova] Acquiring lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:18:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e3e0e6b5-b949-4cdc-a22b-7f5127cd4eb1 req-d3d2c0b2-9b96-4c82-9b22-41b6d3997360 service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:18:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e3e0e6b5-b949-4cdc-a22b-7f5127cd4eb1 req-d3d2c0b2-9b96-4c82-9b22-41b6d3997360 service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:18:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-e3e0e6b5-b949-4cdc-a22b-7f5127cd4eb1 req-d3d2c0b2-9b96-4c82-9b22-41b6d3997360 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] No waiting events found dispatching network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:18:50 user nova-compute[73188]: WARNING nova.compute.manager [req-e3e0e6b5-b949-4cdc-a22b-7f5127cd4eb1 req-d3d2c0b2-9b96-4c82-9b22-41b6d3997360 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received unexpected event network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 for instance with vm_state active and task_state rescuing.
Aug 15 19:18:50 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Removed pending event for 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 due to event {{(pid=73188) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 19:18:50 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127130.3030996, 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:18:50 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] VM Resumed (Lifecycle Event)
Aug 15 19:18:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-cd645a91-8f70-4b52-ad0e-b7383e9b63d4 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:18:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:18:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:18:50 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 19:18:50 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127130.3099551, 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:18:50 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] VM Started (Lifecycle Event)
Aug 15 19:18:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:18:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:18:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:18:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:01 user nova-compute[73188]: DEBUG nova.compute.manager [req-8b0e2d6e-6001-49ce-b511-bdf3420bc4dc req-fcfbeb8a-d0cc-45e6-a315-319ab3b332d0 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received event network-changed-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:19:01 user nova-compute[73188]: DEBUG nova.compute.manager [req-8b0e2d6e-6001-49ce-b511-bdf3420bc4dc req-fcfbeb8a-d0cc-45e6-a315-319ab3b332d0 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Refreshing instance network info cache due to event network-changed-0546e618-e785-46c7-aa82-d527ec295deb. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:19:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8b0e2d6e-6001-49ce-b511-bdf3420bc4dc req-fcfbeb8a-d0cc-45e6-a315-319ab3b332d0 service nova] Acquiring lock "refresh_cache-b3dd183e-7ab1-40ae-b282-40575a9e47df" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:19:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8b0e2d6e-6001-49ce-b511-bdf3420bc4dc req-fcfbeb8a-d0cc-45e6-a315-319ab3b332d0 service nova] Acquired lock "refresh_cache-b3dd183e-7ab1-40ae-b282-40575a9e47df" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:19:01 user nova-compute[73188]: DEBUG nova.network.neutron [req-8b0e2d6e-6001-49ce-b511-bdf3420bc4dc req-fcfbeb8a-d0cc-45e6-a315-319ab3b332d0 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Refreshing network info cache for port 0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:19:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "2a472af2-b10c-456b-8dba-6c75f3ab806a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:01 user nova-compute[73188]: INFO nova.compute.manager [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Terminating instance
Aug 15 19:19:01 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:19:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:19:02 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Instance destroyed successfully.
Aug 15 19:19:02 user nova-compute[73188]: DEBUG nova.objects.instance [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'resources' on Instance uuid 2a472af2-b10c-456b-8dba-6c75f3ab806a {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:19:02 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T19:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2127906751',display_name='tempest-ServerActionsTestOtherA-server-779595184',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2127906751',id=22,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT7pHtenQdl314usiZ2R/MplkqppVUszRcYtdF8PoT9iwdYNWnlBFP4lclfbI6J8I2Ewyw1annhgge1Ik0u6ps1bdNRiu2LQt8/JVAam6sa0kutoFjAwiPMLeb/O6NAfQ==',key_name='tempest-keypair-1165066426',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:15:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3c085a0ccf841e297d98037c07a7111',ramdisk_id='',reservation_id='r-x091yrli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2026424764',owner_user_name='tempest-ServerActionsTestOtherA-2026424764-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:15:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30de55a2834422c8f6df816899b881e',uuid=2a472af2-b10c-456b-8dba-6c75f3ab806a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fadc6652-e769-4a50-81a4-caefd1de83ff", "address": "fa:16:3e:28:1c:a1", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc6652-e7", "ovs_interfaceid": "fadc6652-e769-4a50-81a4-caefd1de83ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:19:02 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converting VIF {"id": "fadc6652-e769-4a50-81a4-caefd1de83ff", "address": "fa:16:3e:28:1c:a1", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc6652-e7", "ovs_interfaceid": "fadc6652-e769-4a50-81a4-caefd1de83ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:19:02 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:1c:a1,bridge_name='br-int',has_traffic_filtering=True,id=fadc6652-e769-4a50-81a4-caefd1de83ff,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc6652-e7') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:19:02 user nova-compute[73188]: DEBUG os_vif [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:1c:a1,bridge_name='br-int',has_traffic_filtering=True,id=fadc6652-e769-4a50-81a4-caefd1de83ff,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc6652-e7') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:19:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfadc6652-e7, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:19:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:02 user nova-compute[73188]: INFO os_vif [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:1c:a1,bridge_name='br-int',has_traffic_filtering=True,id=fadc6652-e769-4a50-81a4-caefd1de83ff,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc6652-e7')
Aug 15 19:19:02 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Deleting instance files /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a_del
Aug 15 19:19:02 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Deletion of /opt/stack/data/nova/instances/2a472af2-b10c-456b-8dba-6c75f3ab806a_del complete
Aug 15 19:19:02 user nova-compute[73188]: INFO nova.compute.manager [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 15 19:19:02 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:19:02 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:19:02 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:19:02 user nova-compute[73188]: DEBUG nova.compute.manager [req-83e7776c-d7ef-491d-94eb-a1c8aab1410a req-ce078957-651a-4159-81ca-6566c3e124a5 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Received event network-vif-unplugged-fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:19:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-83e7776c-d7ef-491d-94eb-a1c8aab1410a req-ce078957-651a-4159-81ca-6566c3e124a5 service nova] Acquiring lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-83e7776c-d7ef-491d-94eb-a1c8aab1410a req-ce078957-651a-4159-81ca-6566c3e124a5 service nova] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-83e7776c-d7ef-491d-94eb-a1c8aab1410a req-ce078957-651a-4159-81ca-6566c3e124a5 service nova] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:02 user nova-compute[73188]: DEBUG nova.compute.manager [req-83e7776c-d7ef-491d-94eb-a1c8aab1410a req-ce078957-651a-4159-81ca-6566c3e124a5 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] No waiting events found dispatching network-vif-unplugged-fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:19:02 user nova-compute[73188]: DEBUG nova.compute.manager [req-83e7776c-d7ef-491d-94eb-a1c8aab1410a req-ce078957-651a-4159-81ca-6566c3e124a5 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Received event network-vif-unplugged-fadc6652-e769-4a50-81a4-caefd1de83ff for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:19:03 user nova-compute[73188]: DEBUG nova.network.neutron [req-8b0e2d6e-6001-49ce-b511-bdf3420bc4dc req-fcfbeb8a-d0cc-45e6-a315-319ab3b332d0 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Updated VIF entry in instance network info cache for port 0546e618-e785-46c7-aa82-d527ec295deb. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:19:03 user nova-compute[73188]: DEBUG nova.network.neutron [req-8b0e2d6e-6001-49ce-b511-bdf3420bc4dc req-fcfbeb8a-d0cc-45e6-a315-319ab3b332d0 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Updating instance_info_cache with network_info: [{"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:19:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8b0e2d6e-6001-49ce-b511-bdf3420bc4dc req-fcfbeb8a-d0cc-45e6-a315-319ab3b332d0 service nova] Releasing lock "refresh_cache-b3dd183e-7ab1-40ae-b282-40575a9e47df" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:19:04 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:19:04 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Took 1.73 seconds to deallocate network for instance.
Aug 15 19:19:04 user nova-compute[73188]: DEBUG nova.compute.manager [req-97e1815f-204d-40fe-851f-daf501b09fd9 req-bc62499e-5471-40ae-92a0-2112f0c65a57 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Received event network-vif-deleted-fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:19:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:04 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:19:04 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:19:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:04 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:19:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.057s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:19:04 user nova-compute[73188]: INFO nova.compute.claims [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Claim successful on node user
Aug 15 19:19:04 user nova-compute[73188]: DEBUG nova.compute.manager [req-027acf8e-f615-466e-ae40-65f0bdd58695 req-ddd4c684-ecc3-4c11-84aa-339b6e7804b0 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Received event network-vif-plugged-fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:19:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-027acf8e-f615-466e-ae40-65f0bdd58695 req-ddd4c684-ecc3-4c11-84aa-339b6e7804b0 service nova] Acquiring lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-027acf8e-f615-466e-ae40-65f0bdd58695 req-ddd4c684-ecc3-4c11-84aa-339b6e7804b0 service nova] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-027acf8e-f615-466e-ae40-65f0bdd58695 req-ddd4c684-ecc3-4c11-84aa-339b6e7804b0 service nova] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:04 user nova-compute[73188]: DEBUG nova.compute.manager [req-027acf8e-f615-466e-ae40-65f0bdd58695 req-ddd4c684-ecc3-4c11-84aa-339b6e7804b0 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] No waiting events found dispatching network-vif-plugged-fadc6652-e769-4a50-81a4-caefd1de83ff {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:19:04 user nova-compute[73188]: WARNING nova.compute.manager [req-027acf8e-f615-466e-ae40-65f0bdd58695 req-ddd4c684-ecc3-4c11-84aa-339b6e7804b0 service nova] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Received unexpected event network-vif-plugged-fadc6652-e769-4a50-81a4-caefd1de83ff for instance with vm_state deleted and task_state None.
Aug 15 19:19:04 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Deleted allocations for instance 2a472af2-b10c-456b-8dba-6c75f3ab806a
Aug 15 19:19:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e9f400b6-b98f-4472-b542-fc6d5a44eb05 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "2a472af2-b10c-456b-8dba-6c75f3ab806a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.333s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:05 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:19:05 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:19:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:19:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:19:05 user nova-compute[73188]: DEBUG nova.network.neutron [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:19:05 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:19:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:19:05 user nova-compute[73188]: DEBUG nova.policy [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88c0edd2a58744da9497d7c5164f22a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb950591a3349908b17b33c0ebca302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:19:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:19:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:19:05 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Creating image(s)
Aug 15 19:19:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "/opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "/opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.198s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.204s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk 1073741824" returned: 0 in 0.140s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.352s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:06 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:19:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:06 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Cannot resize image /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:19:06 user nova-compute[73188]: DEBUG nova.objects.instance [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'migration_context' on Instance uuid 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:19:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:19:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Ensure instance console log exists: /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:19:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:06 user nova-compute[73188]: DEBUG nova.network.neutron [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Successfully created port: 6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.network.neutron [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Successfully updated port: 6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "refresh_cache-5c2929f0-0a13-4279-ba1a-085ffdb2cd83" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquired lock "refresh_cache-5c2929f0-0a13-4279-ba1a-085ffdb2cd83" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.network.neutron [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-02c23617-72ac-4319-9be3-ef58547f9870 req-41257434-7307-4370-b218-09a0125e8710 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received event network-changed-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-02c23617-72ac-4319-9be3-ef58547f9870 req-41257434-7307-4370-b218-09a0125e8710 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Refreshing instance network info cache due to event network-changed-6225a308-7ed4-4b5e-baf9-217609c291e5. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-02c23617-72ac-4319-9be3-ef58547f9870 req-41257434-7307-4370-b218-09a0125e8710 service nova] Acquiring lock "refresh_cache-5c2929f0-0a13-4279-ba1a-085ffdb2cd83" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.network.neutron [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.network.neutron [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Updating instance_info_cache with network_info: [{"id": "6225a308-7ed4-4b5e-baf9-217609c291e5", "address": "fa:16:3e:a1:7a:2a", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6225a308-7e", "ovs_interfaceid": "6225a308-7ed4-4b5e-baf9-217609c291e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Releasing lock "refresh_cache-5c2929f0-0a13-4279-ba1a-085ffdb2cd83" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Instance network_info: |[{"id": "6225a308-7ed4-4b5e-baf9-217609c291e5", "address": "fa:16:3e:a1:7a:2a", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6225a308-7e", "ovs_interfaceid": "6225a308-7ed4-4b5e-baf9-217609c291e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-02c23617-72ac-4319-9be3-ef58547f9870 req-41257434-7307-4370-b218-09a0125e8710 service nova] Acquired lock "refresh_cache-5c2929f0-0a13-4279-ba1a-085ffdb2cd83" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.network.neutron [req-02c23617-72ac-4319-9be3-ef58547f9870 req-41257434-7307-4370-b218-09a0125e8710 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Refreshing network info cache for port 6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Start _get_guest_xml network_info=[{"id": "6225a308-7ed4-4b5e-baf9-217609c291e5", "address": "fa:16:3e:a1:7a:2a", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6225a308-7e", "ovs_interfaceid": "6225a308-7ed4-4b5e-baf9-217609c291e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:19:07 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:19:07 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1041831059',display_name='tempest-ServerRescueNegativeTestJSON-server-1041831059',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1041831059',id=31,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEq2iQ1h4jzBjE0atv0a4mo1L4j66QLfP7MxRxkxH1Yw8sM5jKyasNf48oOhELPjdXUEvOx3hNYXDkucV1CUoRmiVobninOEOJkdc8lPhCPKnn/KUBn7RaKi3Y4oHf1Lrw==',key_name='tempest-keypair-1377831358',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeb950591a3349908b17b33c0ebca302',ramdisk_id='',reservation_id='r-wmo5f3m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-990996828',owner_user_name='tempest-ServerRescueNegativeTestJSON-990996828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:19:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88c0edd2a58744da9497d7c5164f22a2',uuid=5c2929f0-0a13-4279-ba1a-085ffdb2cd83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6225a308-7ed4-4b5e-baf9-217609c291e5", "address": "fa:16:3e:a1:7a:2a", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6225a308-7e", "ovs_interfaceid": "6225a308-7ed4-4b5e-baf9-217609c291e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converting VIF {"id": "6225a308-7ed4-4b5e-baf9-217609c291e5", "address": "fa:16:3e:a1:7a:2a", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6225a308-7e", "ovs_interfaceid": "6225a308-7ed4-4b5e-baf9-217609c291e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:7a:2a,bridge_name='br-int',has_traffic_filtering=True,id=6225a308-7ed4-4b5e-baf9-217609c291e5,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6225a308-7e') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.objects.instance [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:19:07 user nova-compute[73188]:   <uuid>5c2929f0-0a13-4279-ba1a-085ffdb2cd83</uuid>
Aug 15 19:19:07 user nova-compute[73188]:   <name>instance-0000001f</name>
Aug 15 19:19:07 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:19:07 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:19:07 user nova-compute[73188]:   <metadata>
Aug 15 19:19:07 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:19:07 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:19:07 user nova-compute[73188]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1041831059</nova:name>
Aug 15 19:19:07 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:19:07</nova:creationTime>
Aug 15 19:19:07 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:19:07 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:19:07 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:19:07 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:19:07 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:19:07 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:19:07 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:19:07 user nova-compute[73188]:       <nova:owner>
Aug 15 19:19:07 user nova-compute[73188]:         <nova:user uuid="88c0edd2a58744da9497d7c5164f22a2">tempest-ServerRescueNegativeTestJSON-990996828-project-member</nova:user>
Aug 15 19:19:07 user nova-compute[73188]:         <nova:project uuid="eeb950591a3349908b17b33c0ebca302">tempest-ServerRescueNegativeTestJSON-990996828</nova:project>
Aug 15 19:19:07 user nova-compute[73188]:       </nova:owner>
Aug 15 19:19:07 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:19:07 user nova-compute[73188]:       <nova:ports>
Aug 15 19:19:07 user nova-compute[73188]:         <nova:port uuid="6225a308-7ed4-4b5e-baf9-217609c291e5">
Aug 15 19:19:07 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 19:19:07 user nova-compute[73188]:         </nova:port>
Aug 15 19:19:07 user nova-compute[73188]:       </nova:ports>
Aug 15 19:19:07 user nova-compute[73188]:     </nova:instance>
Aug 15 19:19:07 user nova-compute[73188]:   </metadata>
Aug 15 19:19:07 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:19:07 user nova-compute[73188]:     <system>
Aug 15 19:19:07 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:19:07 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:19:07 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:19:07 user nova-compute[73188]:       <entry name="serial">5c2929f0-0a13-4279-ba1a-085ffdb2cd83</entry>
Aug 15 19:19:07 user nova-compute[73188]:       <entry name="uuid">5c2929f0-0a13-4279-ba1a-085ffdb2cd83</entry>
Aug 15 19:19:07 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:19:07 user nova-compute[73188]:     </system>
Aug 15 19:19:07 user nova-compute[73188]:   </sysinfo>
Aug 15 19:19:07 user nova-compute[73188]:   <os>
Aug 15 19:19:07 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:19:07 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:19:07 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:19:07 user nova-compute[73188]:   </os>
Aug 15 19:19:07 user nova-compute[73188]:   <features>
Aug 15 19:19:07 user nova-compute[73188]:     <acpi/>
Aug 15 19:19:07 user nova-compute[73188]:     <apic/>
Aug 15 19:19:07 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:19:07 user nova-compute[73188]:   </features>
Aug 15 19:19:07 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:19:07 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:19:07 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:19:07 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:19:07 user nova-compute[73188]:   </clock>
Aug 15 19:19:07 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:19:07 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:19:07 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:19:07 user nova-compute[73188]:   </cpu>
Aug 15 19:19:07 user nova-compute[73188]:   <devices>
Aug 15 19:19:07 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:19:07 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:19:07 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk"/>
Aug 15 19:19:07 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:19:07 user nova-compute[73188]:     </disk>
Aug 15 19:19:07 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:19:07 user nova-compute[73188]:       <mac address="fa:16:3e:a1:7a:2a"/>
Aug 15 19:19:07 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:19:07 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:19:07 user nova-compute[73188]:       <target dev="tap6225a308-7e"/>
Aug 15 19:19:07 user nova-compute[73188]:     </interface>
Aug 15 19:19:07 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:19:07 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/console.log" append="off"/>
Aug 15 19:19:07 user nova-compute[73188]:     </serial>
Aug 15 19:19:07 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:19:07 user nova-compute[73188]:     <video>
Aug 15 19:19:07 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:19:07 user nova-compute[73188]:     </video>
Aug 15 19:19:07 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:19:07 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:19:07 user nova-compute[73188]:     </rng>
Aug 15 19:19:07 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:19:07 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:19:07 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:19:07 user nova-compute[73188]:     </memballoon>
Aug 15 19:19:07 user nova-compute[73188]:   </devices>
Aug 15 19:19:07 user nova-compute[73188]: </domain>
Aug 15 19:19:07 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1041831059',display_name='tempest-ServerRescueNegativeTestJSON-server-1041831059',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1041831059',id=31,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEq2iQ1h4jzBjE0atv0a4mo1L4j66QLfP7MxRxkxH1Yw8sM5jKyasNf48oOhELPjdXUEvOx3hNYXDkucV1CUoRmiVobninOEOJkdc8lPhCPKnn/KUBn7RaKi3Y4oHf1Lrw==',key_name='tempest-keypair-1377831358',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeb950591a3349908b17b33c0ebca302',ramdisk_id='',reservation_id='r-wmo5f3m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-990996828',owner_user_name='tempest-ServerRescueNegativeTestJSON-990996828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:19:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88c0edd2a58744da9497d7c5164f22a2',uuid=5c2929f0-0a13-4279-ba1a-085ffdb2cd83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6225a308-7ed4-4b5e-baf9-217609c291e5", "address": "fa:16:3e:a1:7a:2a", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6225a308-7e", "ovs_interfaceid": "6225a308-7ed4-4b5e-baf9-217609c291e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converting VIF {"id": "6225a308-7ed4-4b5e-baf9-217609c291e5", "address": "fa:16:3e:a1:7a:2a", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6225a308-7e", "ovs_interfaceid": "6225a308-7ed4-4b5e-baf9-217609c291e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:7a:2a,bridge_name='br-int',has_traffic_filtering=True,id=6225a308-7ed4-4b5e-baf9-217609c291e5,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6225a308-7e') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG os_vif [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:7a:2a,bridge_name='br-int',has_traffic_filtering=True,id=6225a308-7ed4-4b5e-baf9-217609c291e5,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6225a308-7e') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6225a308-7e, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:19:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6225a308-7e, col_values=(('external_ids', {'iface-id': '6225a308-7ed4-4b5e-baf9-217609c291e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:7a:2a', 'vm-uuid': '5c2929f0-0a13-4279-ba1a-085ffdb2cd83'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:19:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "7f96acc3-0856-462e-9a32-879848f60a0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "7f96acc3-0856-462e-9a32-879848f60a0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:08 user nova-compute[73188]: INFO nova.compute.manager [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Terminating instance
Aug 15 19:19:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:08 user nova-compute[73188]: INFO os_vif [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:7a:2a,bridge_name='br-int',has_traffic_filtering=True,id=6225a308-7ed4-4b5e-baf9-217609c291e5,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6225a308-7e')
Aug 15 19:19:08 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:19:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:19:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] No VIF found with MAC fa:16:3e:a1:7a:2a, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:19:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:08 user nova-compute[73188]: DEBUG nova.network.neutron [req-02c23617-72ac-4319-9be3-ef58547f9870 req-41257434-7307-4370-b218-09a0125e8710 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Updated VIF entry in instance network info cache for port 6225a308-7ed4-4b5e-baf9-217609c291e5. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:19:08 user nova-compute[73188]: DEBUG nova.network.neutron [req-02c23617-72ac-4319-9be3-ef58547f9870 req-41257434-7307-4370-b218-09a0125e8710 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Updating instance_info_cache with network_info: [{"id": "6225a308-7ed4-4b5e-baf9-217609c291e5", "address": "fa:16:3e:a1:7a:2a", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6225a308-7e", "ovs_interfaceid": "6225a308-7ed4-4b5e-baf9-217609c291e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:19:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-02c23617-72ac-4319-9be3-ef58547f9870 req-41257434-7307-4370-b218-09a0125e8710 service nova] Releasing lock "refresh_cache-5c2929f0-0a13-4279-ba1a-085ffdb2cd83" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:19:09 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Instance destroyed successfully.
Aug 15 19:19:09 user nova-compute[73188]: DEBUG nova.objects.instance [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lazy-loading 'resources' on Instance uuid 7f96acc3-0856-462e-9a32-879848f60a0e {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:19:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-111252592',display_name='tempest-TestMinimumBasicScenario-server-111252592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-111252592',id=23,image_ref='db09264f-693e-42ea-ab97-9a80e0e3d7f0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzo1j4cBVFAovrT7TfUccrKZwiKQpZGTviawtl6Vd3nA7f6TnDYbJz/KfV9RA6oyc9t51QGzFgTfIWoGj/0yFu5Aw7Xq/O5Z50dyEYYFvMfClGGQzXjpVM891a+E+DfEw==',key_name='tempest-TestMinimumBasicScenario-48362326',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:13:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='575959aac5a1464dac98034bdb3bb948',ramdisk_id='',reservation_id='r-6e5ncuey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='db09264f-693e-42ea-ab97-9a80e0e3d7f0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1939446316',owner_user_name='tempest-TestMinimumBasicScenario-1939446316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:16:24Z,user_data=None,user_id='9f7c7805c0754c61a5b9f8d16e28b228',uuid=7f96acc3-0856-462e-9a32-879848f60a0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "address": "fa:16:3e:9b:51:30", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10933cb-e7", "ovs_interfaceid": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:19:09 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Converting VIF {"id": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "address": "fa:16:3e:9b:51:30", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc10933cb-e7", "ovs_interfaceid": "c10933cb-e730-47f0-9b80-fcec4cf6c359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:19:09 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:51:30,bridge_name='br-int',has_traffic_filtering=True,id=c10933cb-e730-47f0-9b80-fcec4cf6c359,network=Network(a4981d47-8986-4ebf-a0cd-54692da9ff40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc10933cb-e7') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:19:09 user nova-compute[73188]: DEBUG os_vif [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:51:30,bridge_name='br-int',has_traffic_filtering=True,id=c10933cb-e730-47f0-9b80-fcec4cf6c359,network=Network(a4981d47-8986-4ebf-a0cd-54692da9ff40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc10933cb-e7') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:19:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc10933cb-e7, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:19:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:19:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:09 user nova-compute[73188]: INFO os_vif [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:51:30,bridge_name='br-int',has_traffic_filtering=True,id=c10933cb-e730-47f0-9b80-fcec4cf6c359,network=Network(a4981d47-8986-4ebf-a0cd-54692da9ff40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc10933cb-e7')
Aug 15 19:19:09 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Deleting instance files /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e_del
Aug 15 19:19:09 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Deletion of /opt/stack/data/nova/instances/7f96acc3-0856-462e-9a32-879848f60a0e_del complete
Aug 15 19:19:09 user nova-compute[73188]: INFO nova.compute.manager [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 15 19:19:09 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:19:09 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:19:09 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:19:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-7b15ede3-a5fd-42bf-bbb3-1fe6b52cff7b req-16f12e50-48f0-4a80-843f-a7cf7681e345 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Received event network-vif-unplugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:19:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7b15ede3-a5fd-42bf-bbb3-1fe6b52cff7b req-16f12e50-48f0-4a80-843f-a7cf7681e345 service nova] Acquiring lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7b15ede3-a5fd-42bf-bbb3-1fe6b52cff7b req-16f12e50-48f0-4a80-843f-a7cf7681e345 service nova] Lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7b15ede3-a5fd-42bf-bbb3-1fe6b52cff7b req-16f12e50-48f0-4a80-843f-a7cf7681e345 service nova] Lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-7b15ede3-a5fd-42bf-bbb3-1fe6b52cff7b req-16f12e50-48f0-4a80-843f-a7cf7681e345 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] No waiting events found dispatching network-vif-unplugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:19:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-7b15ede3-a5fd-42bf-bbb3-1fe6b52cff7b req-16f12e50-48f0-4a80-843f-a7cf7681e345 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Received event network-vif-unplugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:19:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-7b15ede3-a5fd-42bf-bbb3-1fe6b52cff7b req-16f12e50-48f0-4a80-843f-a7cf7681e345 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Received event network-vif-plugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:19:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7b15ede3-a5fd-42bf-bbb3-1fe6b52cff7b req-16f12e50-48f0-4a80-843f-a7cf7681e345 service nova] Acquiring lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7b15ede3-a5fd-42bf-bbb3-1fe6b52cff7b req-16f12e50-48f0-4a80-843f-a7cf7681e345 service nova] Lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7b15ede3-a5fd-42bf-bbb3-1fe6b52cff7b req-16f12e50-48f0-4a80-843f-a7cf7681e345 service nova] Lock "7f96acc3-0856-462e-9a32-879848f60a0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-7b15ede3-a5fd-42bf-bbb3-1fe6b52cff7b req-16f12e50-48f0-4a80-843f-a7cf7681e345 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] No waiting events found dispatching network-vif-plugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:19:09 user nova-compute[73188]: WARNING nova.compute.manager [req-7b15ede3-a5fd-42bf-bbb3-1fe6b52cff7b req-16f12e50-48f0-4a80-843f-a7cf7681e345 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Received unexpected event network-vif-plugged-c10933cb-e730-47f0-9b80-fcec4cf6c359 for instance with vm_state active and task_state deleting.
Aug 15 19:19:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:10 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:19:10 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Took 0.96 seconds to deallocate network for instance.
Aug 15 19:19:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:10 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:19:10 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:19:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:10 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Deleted allocations for instance 7f96acc3-0856-462e-9a32-879848f60a0e
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8cd4705b-47fd-4a13-a0a7-d1d1ac527e47 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "7f96acc3-0856-462e-9a32-879848f60a0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.005s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG nova.objects.instance [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'flavor' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:11 user nova-compute[73188]: INFO nova.compute.manager [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Attaching volume b3f95f50-bd8d-4060-84ed-1f597c7a09ab to /dev/vdb
Aug 15 19:19:11 user nova-compute[73188]: DEBUG os_brick.utils [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8398b424-a835-4885-b9c3-b23a4101d565]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf8579a-0421-4c50-bb90-31e65c2ccb81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[820ac7d7-fdcb-4c84-b4af-038f95575865]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9e211d-9d96-4a76-9ad1-744f7665dd8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-a668a04f-1984-469c-918b-fd3b06d4792d req-b6a0e700-6a84-4773-9970-218aa1e664f2 service nova] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Received event network-vif-deleted-c10933cb-e730-47f0-9b80-fcec4cf6c359 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-a668a04f-1984-469c-918b-fd3b06d4792d req-b6a0e700-6a84-4773-9970-218aa1e664f2 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received event network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a668a04f-1984-469c-918b-fd3b06d4792d req-b6a0e700-6a84-4773-9970-218aa1e664f2 service nova] Acquiring lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a668a04f-1984-469c-918b-fd3b06d4792d req-b6a0e700-6a84-4773-9970-218aa1e664f2 service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a668a04f-1984-469c-918b-fd3b06d4792d req-b6a0e700-6a84-4773-9970-218aa1e664f2 service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-a668a04f-1984-469c-918b-fd3b06d4792d req-b6a0e700-6a84-4773-9970-218aa1e664f2 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] No waiting events found dispatching network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:19:11 user nova-compute[73188]: WARNING nova.compute.manager [req-a668a04f-1984-469c-918b-fd3b06d4792d req-b6a0e700-6a84-4773-9970-218aa1e664f2 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received unexpected event network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 for instance with vm_state building and task_state spawning.
Aug 15 19:19:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-a668a04f-1984-469c-918b-fd3b06d4792d req-b6a0e700-6a84-4773-9970-218aa1e664f2 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received event network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a668a04f-1984-469c-918b-fd3b06d4792d req-b6a0e700-6a84-4773-9970-218aa1e664f2 service nova] Acquiring lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a668a04f-1984-469c-918b-fd3b06d4792d req-b6a0e700-6a84-4773-9970-218aa1e664f2 service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a668a04f-1984-469c-918b-fd3b06d4792d req-b6a0e700-6a84-4773-9970-218aa1e664f2 service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-a668a04f-1984-469c-918b-fd3b06d4792d req-b6a0e700-6a84-4773-9970-218aa1e664f2 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] No waiting events found dispatching network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:19:11 user nova-compute[73188]: WARNING nova.compute.manager [req-a668a04f-1984-469c-918b-fd3b06d4792d req-b6a0e700-6a84-4773-9970-218aa1e664f2 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received unexpected event network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 for instance with vm_state building and task_state spawning.
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:19:11 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:19:11 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fd46c7-0a73-46c3-8224-b8bea357d0ef]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG os_brick.utils [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:19:11 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Updating existing volume attachment record: 536bf913-fcb8-4e67-bddc-45e7ca3dfd2b {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:19:12 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127152.3553653, 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:19:12 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] VM Resumed (Lifecycle Event)
Aug 15 19:19:12 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:19:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:19:12 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:19:12 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Instance spawned successfully.
Aug 15 19:19:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:19:12 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:19:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:19:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:19:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:19:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:19:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:19:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:19:12 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:19:12 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127152.3578804, 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:19:12 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] VM Started (Lifecycle Event)
Aug 15 19:19:12 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:19:12 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:19:12 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:19:12 user nova-compute[73188]: INFO nova.compute.manager [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Took 6.98 seconds to spawn the instance on the hypervisor.
Aug 15 19:19:12 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:19:12 user nova-compute[73188]: INFO nova.compute.manager [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Took 7.89 seconds to build instance.
Aug 15 19:19:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e38e9aad-0adf-426b-9301-e9601210a71a tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.986s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:17 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127142.4989598, 2a472af2-b10c-456b-8dba-6c75f3ab806a => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:19:17 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] VM Stopped (Lifecycle Event)
Aug 15 19:19:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-a1a91a2f-9b63-41e0-abc7-2510059a8a07 None None] [instance: 2a472af2-b10c-456b-8dba-6c75f3ab806a] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:19:17 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:19:18 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:19:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Acquiring lock "ac47948a-9396-4c68-9662-1ad1595d096b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "ac47948a-9396-4c68-9662-1ad1595d096b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:19 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:19:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:19 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:19:19 user nova-compute[73188]: INFO nova.compute.claims [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Claim successful on node user
Aug 15 19:19:19 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:19:19 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:19:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:19 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:19:19 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:19:19 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:19:19 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:19:19 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG nova.policy [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffd643862c1447868d962e4315a38d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cfc95d252dc44f79afe90be2f4324a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:19:20 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Creating image(s)
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac47948a-9396-4c68-9662-1ad1595d096b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "/opt/stack/data/nova/instances/ac47948a-9396-4c68-9662-1ad1595d096b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "/opt/stack/data/nova/instances/ac47948a-9396-4c68-9662-1ad1595d096b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.175s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/ac47948a-9396-4c68-9662-1ad1595d096b/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/ac47948a-9396-4c68-9662-1ad1595d096b/disk 1073741824" returned: 0 in 0.047s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Didn't find any instances for network info cache update. {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Successfully created port: f242734a-9f10-401a-b13d-6102ac2fb10f {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.185s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac47948a-9396-4c68-9662-1ad1595d096b/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac47948a-9396-4c68-9662-1ad1595d096b/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac47948a-9396-4c68-9662-1ad1595d096b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Cannot resize image /opt/stack/data/nova/instances/ac47948a-9396-4c68-9662-1ad1595d096b/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG nova.objects.instance [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lazy-loading 'migration_context' on Instance uuid ac47948a-9396-4c68-9662-1ad1595d096b {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Ensure instance console log exists: /opt/stack/data/nova/instances/ac47948a-9396-4c68-9662-1ad1595d096b/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpyxgIPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:19:21 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:19:21 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:19:21 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[812a7ed8-8206-4709-b82b-26247bc6e03a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:19:21 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02ffd04-18a5-4411-8d2f-6be73648ffe5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab] added
Aug 15 19:19:21 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5b84a5-f0d5-47ab-b984-f5710608de60]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4fed26-fb6d-438e-8a6d-09052646ebe7]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpyxgIPu {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpyxgIPu" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caf2179-5a83-49ad-af44-061d7fcc1e76]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HpyxgIPu'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d59a73b-bbb6-4633-b398-66ce0771cf46]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[210a58e4-ae81-4ea1-bf79-89dcd48eb0a9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:19:21 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:19:21 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:19:21 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:19:21 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:19:21 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:19:21 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3831e2-4fa3-4919-b423-fccd24064a89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab, portal: 172.16.0.220,3260]
Aug 15 19:19:21 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab, portal: 172.16.0.220,3260] successful.
Aug 15 19:19:21 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bb2ae7-1e51-4a69-8daf-1c9763e3fd7d]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e0edfe-fbb7-4f69-9a06-e19faf5b4d0c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:19:21 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:19:21 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:19:21 user nova-compute[73188]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:19:21 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:19:21 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:19:21 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:19:21 user nova-compute[73188]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:19:21 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ed001c-fe33-4186-ae18-afb485928c01]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpyxgIPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Successfully updated port: f242734a-9f10-401a-b13d-6102ac2fb10f {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Acquiring lock "refresh_cache-ac47948a-9396-4c68-9662-1ad1595d096b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Acquired lock "refresh_cache-ac47948a-9396-4c68-9662-1ad1595d096b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:19:21 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-316cc388-db02-42ed-a520-82cde29d673f req-d0b13809-b75c-4e58-be07-31b1d1fe5d19 service nova] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Received event network-changed-f242734a-9f10-401a-b13d-6102ac2fb10f {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-316cc388-db02-42ed-a520-82cde29d673f req-d0b13809-b75c-4e58-be07-31b1d1fe5d19 service nova] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Refreshing instance network info cache due to event network-changed-f242734a-9f10-401a-b13d-6102ac2fb10f. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-316cc388-db02-42ed-a520-82cde29d673f req-d0b13809-b75c-4e58-be07-31b1d1fe5d19 service nova] Acquiring lock "refresh_cache-ac47948a-9396-4c68-9662-1ad1595d096b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Updating instance_info_cache with network_info: [{"id": "f242734a-9f10-401a-b13d-6102ac2fb10f", "address": "fa:16:3e:da:9b:ac", "network": {"id": "67b69ed4-0c6f-4b67-a173-2570bbb4d6d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979729543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cfc95d252dc44f79afe90be2f4324a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242734a-9f", "ovs_interfaceid": "f242734a-9f10-401a-b13d-6102ac2fb10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26338333339666166', 'path': '/dev/sde'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338333339666166', 'path': '/dev/sde'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.objects.instance [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'flavor' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Releasing lock "refresh_cache-ac47948a-9396-4c68-9662-1ad1595d096b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Instance network_info: |[{"id": "f242734a-9f10-401a-b13d-6102ac2fb10f", "address": "fa:16:3e:da:9b:ac", "network": {"id": "67b69ed4-0c6f-4b67-a173-2570bbb4d6d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979729543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cfc95d252dc44f79afe90be2f4324a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242734a-9f", "ovs_interfaceid": "f242734a-9f10-401a-b13d-6102ac2fb10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-316cc388-db02-42ed-a520-82cde29d673f req-d0b13809-b75c-4e58-be07-31b1d1fe5d19 service nova] Acquired lock "refresh_cache-ac47948a-9396-4c68-9662-1ad1595d096b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.network.neutron [req-316cc388-db02-42ed-a520-82cde29d673f req-d0b13809-b75c-4e58-be07-31b1d1fe5d19 service nova] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Refreshing network info cache for port f242734a-9f10-401a-b13d-6102ac2fb10f {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Start _get_guest_xml network_info=[{"id": "f242734a-9f10-401a-b13d-6102ac2fb10f", "address": "fa:16:3e:da:9b:ac", "network": {"id": "67b69ed4-0c6f-4b67-a173-2570bbb4d6d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979729543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cfc95d252dc44f79afe90be2f4324a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242734a-9f", "ovs_interfaceid": "f242734a-9f10-401a-b13d-6102ac2fb10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:19:22 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:19:22 user nova-compute[73188]:   <source dev="/dev/sde"/>
Aug 15 19:19:22 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:19:22 user nova-compute[73188]:   <serial>b3f95f50-bd8d-4060-84ed-1f597c7a09ab</serial>
Aug 15 19:19:22 user nova-compute[73188]: </disk>
Aug 15 19:19:22 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:22 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:19:22 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:19:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1027311022',display_name='tempest-VolumesActionsTest-instance-1027311022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1027311022',id=32,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cfc95d252dc44f79afe90be2f4324a6',ramdisk_id='',reservation_id='r-c4svvvc3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1468435355',owner_user_name='tempest-VolumesActionsTest-1468435355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:19:20Z,user_data=None,user_id='ffd643862c1447868d962e4315a38d13',uuid=ac47948a-9396-4c68-9662-1ad1595d096b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f242734a-9f10-401a-b13d-6102ac2fb10f", "address": "fa:16:3e:da:9b:ac", "network": {"id": "67b69ed4-0c6f-4b67-a173-2570bbb4d6d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979729543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cfc95d252dc44f79afe90be2f4324a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242734a-9f", "ovs_interfaceid": "f242734a-9f10-401a-b13d-6102ac2fb10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Converting VIF {"id": "f242734a-9f10-401a-b13d-6102ac2fb10f", "address": "fa:16:3e:da:9b:ac", "network": {"id": "67b69ed4-0c6f-4b67-a173-2570bbb4d6d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979729543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cfc95d252dc44f79afe90be2f4324a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242734a-9f", "ovs_interfaceid": "f242734a-9f10-401a-b13d-6102ac2fb10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:9b:ac,bridge_name='br-int',has_traffic_filtering=True,id=f242734a-9f10-401a-b13d-6102ac2fb10f,network=Network(67b69ed4-0c6f-4b67-a173-2570bbb4d6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf242734a-9f') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.objects.instance [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lazy-loading 'pci_devices' on Instance uuid ac47948a-9396-4c68-9662-1ad1595d096b {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:19:22 user nova-compute[73188]:   <uuid>ac47948a-9396-4c68-9662-1ad1595d096b</uuid>
Aug 15 19:19:22 user nova-compute[73188]:   <name>instance-00000020</name>
Aug 15 19:19:22 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:19:22 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:19:22 user nova-compute[73188]:   <metadata>
Aug 15 19:19:22 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:19:22 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:19:22 user nova-compute[73188]:       <nova:name>tempest-VolumesActionsTest-instance-1027311022</nova:name>
Aug 15 19:19:22 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:19:22</nova:creationTime>
Aug 15 19:19:22 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:19:22 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:19:22 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:19:22 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:19:22 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:19:22 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:19:22 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:19:22 user nova-compute[73188]:       <nova:owner>
Aug 15 19:19:22 user nova-compute[73188]:         <nova:user uuid="ffd643862c1447868d962e4315a38d13">tempest-VolumesActionsTest-1468435355-project-member</nova:user>
Aug 15 19:19:22 user nova-compute[73188]:         <nova:project uuid="1cfc95d252dc44f79afe90be2f4324a6">tempest-VolumesActionsTest-1468435355</nova:project>
Aug 15 19:19:22 user nova-compute[73188]:       </nova:owner>
Aug 15 19:19:22 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:19:22 user nova-compute[73188]:       <nova:ports>
Aug 15 19:19:22 user nova-compute[73188]:         <nova:port uuid="f242734a-9f10-401a-b13d-6102ac2fb10f">
Aug 15 19:19:22 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 19:19:22 user nova-compute[73188]:         </nova:port>
Aug 15 19:19:22 user nova-compute[73188]:       </nova:ports>
Aug 15 19:19:22 user nova-compute[73188]:     </nova:instance>
Aug 15 19:19:22 user nova-compute[73188]:   </metadata>
Aug 15 19:19:22 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:19:22 user nova-compute[73188]:     <system>
Aug 15 19:19:22 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:19:22 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:19:22 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:19:22 user nova-compute[73188]:       <entry name="serial">ac47948a-9396-4c68-9662-1ad1595d096b</entry>
Aug 15 19:19:22 user nova-compute[73188]:       <entry name="uuid">ac47948a-9396-4c68-9662-1ad1595d096b</entry>
Aug 15 19:19:22 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:19:22 user nova-compute[73188]:     </system>
Aug 15 19:19:22 user nova-compute[73188]:   </sysinfo>
Aug 15 19:19:22 user nova-compute[73188]:   <os>
Aug 15 19:19:22 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:19:22 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:19:22 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:19:22 user nova-compute[73188]:   </os>
Aug 15 19:19:22 user nova-compute[73188]:   <features>
Aug 15 19:19:22 user nova-compute[73188]:     <acpi/>
Aug 15 19:19:22 user nova-compute[73188]:     <apic/>
Aug 15 19:19:22 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:19:22 user nova-compute[73188]:   </features>
Aug 15 19:19:22 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:19:22 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:19:22 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:19:22 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:19:22 user nova-compute[73188]:   </clock>
Aug 15 19:19:22 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:19:22 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:19:22 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:19:22 user nova-compute[73188]:   </cpu>
Aug 15 19:19:22 user nova-compute[73188]:   <devices>
Aug 15 19:19:22 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:19:22 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:19:22 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/ac47948a-9396-4c68-9662-1ad1595d096b/disk"/>
Aug 15 19:19:22 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:19:22 user nova-compute[73188]:     </disk>
Aug 15 19:19:22 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:19:22 user nova-compute[73188]:       <mac address="fa:16:3e:da:9b:ac"/>
Aug 15 19:19:22 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:19:22 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:19:22 user nova-compute[73188]:       <target dev="tapf242734a-9f"/>
Aug 15 19:19:22 user nova-compute[73188]:     </interface>
Aug 15 19:19:22 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:19:22 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/ac47948a-9396-4c68-9662-1ad1595d096b/console.log" append="off"/>
Aug 15 19:19:22 user nova-compute[73188]:     </serial>
Aug 15 19:19:22 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:19:22 user nova-compute[73188]:     <video>
Aug 15 19:19:22 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:19:22 user nova-compute[73188]:     </video>
Aug 15 19:19:22 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:19:22 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:19:22 user nova-compute[73188]:     </rng>
Aug 15 19:19:22 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:19:22 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:19:22 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:19:22 user nova-compute[73188]:     </memballoon>
Aug 15 19:19:22 user nova-compute[73188]:   </devices>
Aug 15 19:19:22 user nova-compute[73188]: </domain>
Aug 15 19:19:22 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:19:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1027311022',display_name='tempest-VolumesActionsTest-instance-1027311022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1027311022',id=32,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cfc95d252dc44f79afe90be2f4324a6',ramdisk_id='',reservation_id='r-c4svvvc3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1468435355',owner_user_name='tempest-VolumesActionsTest-1468435355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:19:20Z,user_data=None,user_id='ffd643862c1447868d962e4315a38d13',uuid=ac47948a-9396-4c68-9662-1ad1595d096b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f242734a-9f10-401a-b13d-6102ac2fb10f", "address": "fa:16:3e:da:9b:ac", "network": {"id": "67b69ed4-0c6f-4b67-a173-2570bbb4d6d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979729543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cfc95d252dc44f79afe90be2f4324a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242734a-9f", "ovs_interfaceid": "f242734a-9f10-401a-b13d-6102ac2fb10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Converting VIF {"id": "f242734a-9f10-401a-b13d-6102ac2fb10f", "address": "fa:16:3e:da:9b:ac", "network": {"id": "67b69ed4-0c6f-4b67-a173-2570bbb4d6d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979729543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cfc95d252dc44f79afe90be2f4324a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242734a-9f", "ovs_interfaceid": "f242734a-9f10-401a-b13d-6102ac2fb10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:9b:ac,bridge_name='br-int',has_traffic_filtering=True,id=f242734a-9f10-401a-b13d-6102ac2fb10f,network=Network(67b69ed4-0c6f-4b67-a173-2570bbb4d6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf242734a-9f') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG os_vif [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:9b:ac,bridge_name='br-int',has_traffic_filtering=True,id=f242734a-9f10-401a-b13d-6102ac2fb10f,network=Network(67b69ed4-0c6f-4b67-a173-2570bbb4d6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf242734a-9f') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf242734a-9f, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf242734a-9f, col_values=(('external_ids', {'iface-id': 'f242734a-9f10-401a-b13d-6102ac2fb10f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:9b:ac', 'vm-uuid': 'ac47948a-9396-4c68-9662-1ad1595d096b'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:22 user nova-compute[73188]: INFO os_vif [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:9b:ac,bridge_name='br-int',has_traffic_filtering=True,id=f242734a-9f10-401a-b13d-6102ac2fb10f,network=Network(67b69ed4-0c6f-4b67-a173-2570bbb4d6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf242734a-9f')
Aug 15 19:19:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] No VIF found with MAC fa:16:3e:da:9b:ac, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] No VIF found with MAC fa:16:3e:d9:51:98, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.network.neutron [req-316cc388-db02-42ed-a520-82cde29d673f req-d0b13809-b75c-4e58-be07-31b1d1fe5d19 service nova] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Updated VIF entry in instance network info cache for port f242734a-9f10-401a-b13d-6102ac2fb10f. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG nova.network.neutron [req-316cc388-db02-42ed-a520-82cde29d673f req-d0b13809-b75c-4e58-be07-31b1d1fe5d19 service nova] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Updating instance_info_cache with network_info: [{"id": "f242734a-9f10-401a-b13d-6102ac2fb10f", "address": "fa:16:3e:da:9b:ac", "network": {"id": "67b69ed4-0c6f-4b67-a173-2570bbb4d6d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979729543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cfc95d252dc44f79afe90be2f4324a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242734a-9f", "ovs_interfaceid": "f242734a-9f10-401a-b13d-6102ac2fb10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:19:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-316cc388-db02-42ed-a520-82cde29d673f req-d0b13809-b75c-4e58-be07-31b1d1fe5d19 service nova] Releasing lock "refresh_cache-ac47948a-9396-4c68-9662-1ad1595d096b" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28691bdd-985b-4dc7-a121-a0d0fe7fecc6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.776s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7926b52f-3470-4627-afe2-fcd1b23fbf21 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7926b52f-3470-4627-afe2-fcd1b23fbf21 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.003s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG nova.compute.manager [None req-7926b52f-3470-4627-afe2-fcd1b23fbf21 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG nova.compute.manager [None req-7926b52f-3470-4627-afe2-fcd1b23fbf21 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73188) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG nova.objects.instance [None req-7926b52f-3470-4627-afe2-fcd1b23fbf21 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'flavor' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG nova.compute.manager [req-6eea4ca9-9dfb-4479-b797-2c7be115a464 req-8a8462e8-2e64-48d6-bcb3-8c88c67b93df service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received event network-vif-unplugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6eea4ca9-9dfb-4479-b797-2c7be115a464 req-8a8462e8-2e64-48d6-bcb3-8c88c67b93df service nova] Acquiring lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6eea4ca9-9dfb-4479-b797-2c7be115a464 req-8a8462e8-2e64-48d6-bcb3-8c88c67b93df service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6eea4ca9-9dfb-4479-b797-2c7be115a464 req-8a8462e8-2e64-48d6-bcb3-8c88c67b93df service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG nova.compute.manager [req-6eea4ca9-9dfb-4479-b797-2c7be115a464 req-8a8462e8-2e64-48d6-bcb3-8c88c67b93df service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] No waiting events found dispatching network-vif-unplugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:19:23 user nova-compute[73188]: WARNING nova.compute.manager [req-6eea4ca9-9dfb-4479-b797-2c7be115a464 req-8a8462e8-2e64-48d6-bcb3-8c88c67b93df service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received unexpected event network-vif-unplugged-0546e618-e785-46c7-aa82-d527ec295deb for instance with vm_state active and task_state powering-off.
Aug 15 19:19:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:24 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127149.2050688, 7f96acc3-0856-462e-9a32-879848f60a0e => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:19:24 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] VM Stopped (Lifecycle Event)
Aug 15 19:19:24 user nova-compute[73188]: DEBUG nova.compute.manager [None req-8b04e5ad-64d1-4e96-8027-d04ed9d5b303 None None] [instance: 7f96acc3-0856-462e-9a32-879848f60a0e] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:19:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:24 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Instance destroyed successfully.
Aug 15 19:19:24 user nova-compute[73188]: DEBUG nova.compute.manager [None req-7926b52f-3470-4627-afe2-fcd1b23fbf21 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:19:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7926b52f-3470-4627-afe2-fcd1b23fbf21 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.443s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127166.5766995, ac47948a-9396-4c68-9662-1ad1595d096b => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:19:26 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] VM Resumed (Lifecycle Event)
Aug 15 19:19:26 user nova-compute[73188]: DEBUG nova.compute.manager [req-61fe9751-9c02-4867-8602-b75fa8d3c8e6 req-92a7cc29-f80c-4cea-8824-429ab5e6bf3f service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received event network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-61fe9751-9c02-4867-8602-b75fa8d3c8e6 req-92a7cc29-f80c-4cea-8824-429ab5e6bf3f service nova] Acquiring lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-61fe9751-9c02-4867-8602-b75fa8d3c8e6 req-92a7cc29-f80c-4cea-8824-429ab5e6bf3f service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-61fe9751-9c02-4867-8602-b75fa8d3c8e6 req-92a7cc29-f80c-4cea-8824-429ab5e6bf3f service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG nova.compute.manager [req-61fe9751-9c02-4867-8602-b75fa8d3c8e6 req-92a7cc29-f80c-4cea-8824-429ab5e6bf3f service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] No waiting events found dispatching network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:19:26 user nova-compute[73188]: WARNING nova.compute.manager [req-61fe9751-9c02-4867-8602-b75fa8d3c8e6 req-92a7cc29-f80c-4cea-8824-429ab5e6bf3f service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received unexpected event network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb for instance with vm_state stopped and task_state None.
Aug 15 19:19:26 user nova-compute[73188]: DEBUG nova.compute.manager [req-61fe9751-9c02-4867-8602-b75fa8d3c8e6 req-92a7cc29-f80c-4cea-8824-429ab5e6bf3f service nova] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Received event network-vif-plugged-f242734a-9f10-401a-b13d-6102ac2fb10f {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-61fe9751-9c02-4867-8602-b75fa8d3c8e6 req-92a7cc29-f80c-4cea-8824-429ab5e6bf3f service nova] Acquiring lock "ac47948a-9396-4c68-9662-1ad1595d096b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-61fe9751-9c02-4867-8602-b75fa8d3c8e6 req-92a7cc29-f80c-4cea-8824-429ab5e6bf3f service nova] Lock "ac47948a-9396-4c68-9662-1ad1595d096b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-61fe9751-9c02-4867-8602-b75fa8d3c8e6 req-92a7cc29-f80c-4cea-8824-429ab5e6bf3f service nova] Lock "ac47948a-9396-4c68-9662-1ad1595d096b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG nova.compute.manager [req-61fe9751-9c02-4867-8602-b75fa8d3c8e6 req-92a7cc29-f80c-4cea-8824-429ab5e6bf3f service nova] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] No waiting events found dispatching network-vif-plugged-f242734a-9f10-401a-b13d-6102ac2fb10f {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:19:26 user nova-compute[73188]: WARNING nova.compute.manager [req-61fe9751-9c02-4867-8602-b75fa8d3c8e6 req-92a7cc29-f80c-4cea-8824-429ab5e6bf3f service nova] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Received unexpected event network-vif-plugged-f242734a-9f10-401a-b13d-6102ac2fb10f for instance with vm_state building and task_state spawning.
Aug 15 19:19:26 user nova-compute[73188]: DEBUG nova.compute.manager [req-61fe9751-9c02-4867-8602-b75fa8d3c8e6 req-92a7cc29-f80c-4cea-8824-429ab5e6bf3f service nova] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Received event network-vif-plugged-f242734a-9f10-401a-b13d-6102ac2fb10f {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-61fe9751-9c02-4867-8602-b75fa8d3c8e6 req-92a7cc29-f80c-4cea-8824-429ab5e6bf3f service nova] Acquiring lock "ac47948a-9396-4c68-9662-1ad1595d096b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-61fe9751-9c02-4867-8602-b75fa8d3c8e6 req-92a7cc29-f80c-4cea-8824-429ab5e6bf3f service nova] Lock "ac47948a-9396-4c68-9662-1ad1595d096b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-61fe9751-9c02-4867-8602-b75fa8d3c8e6 req-92a7cc29-f80c-4cea-8824-429ab5e6bf3f service nova] Lock "ac47948a-9396-4c68-9662-1ad1595d096b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG nova.compute.manager [req-61fe9751-9c02-4867-8602-b75fa8d3c8e6 req-92a7cc29-f80c-4cea-8824-429ab5e6bf3f service nova] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] No waiting events found dispatching network-vif-plugged-f242734a-9f10-401a-b13d-6102ac2fb10f {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:19:26 user nova-compute[73188]: WARNING nova.compute.manager [req-61fe9751-9c02-4867-8602-b75fa8d3c8e6 req-92a7cc29-f80c-4cea-8824-429ab5e6bf3f service nova] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Received unexpected event network-vif-plugged-f242734a-9f10-401a-b13d-6102ac2fb10f for instance with vm_state building and task_state spawning.
Aug 15 19:19:26 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:19:26 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:19:26 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:19:26 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=7204MB free_disk=25.105266571044922GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:26 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Instance spawned successfully.
Aug 15 19:19:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:19:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:19:26 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:19:26 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127166.5789518, ac47948a-9396-4c68-9662-1ad1595d096b => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:19:26 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] VM Started (Lifecycle Event)
Aug 15 19:19:27 user nova-compute[73188]: INFO nova.compute.manager [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Took 6.90 seconds to spawn the instance on the hypervisor.
Aug 15 19:19:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:19:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:19:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:19:27 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:19:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:19:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3d713d03-3e60-4dec-a295-a4652ac21842 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:19:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e00adf53-085f-436d-a09f-e97e92ca79cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:19:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 139ccf1c-4792-4653-9475-c61b1f9c4846 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:19:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 215077af-60a1-4a82-b24e-1545349363d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:19:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 0ee7de87-76ad-48ae-8bcd-93b2792a96cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:19:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:19:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance b3dd183e-7ab1-40ae-b282-40575a9e47df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:19:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 182d8fc2-0246-4164-9d1b-f970cec4dd1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:19:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 9940ced5-da22-4d30-8895-a1fbe03821c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:19:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:19:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ac47948a-9396-4c68-9662-1ad1595d096b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:19:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:19:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:19:27 user nova-compute[73188]: INFO nova.compute.manager [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Took 7.70 seconds to build instance.
Aug 15 19:19:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ae7695a8-5e70-4b12-bd60-abc57c5e4666 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "ac47948a-9396-4c68-9662-1ad1595d096b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.789s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:27 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:19:27 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:19:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:19:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:29 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:19:29 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:19:29 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:19:29 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:19:29 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:19:29 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:19:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:39 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127164.6760309, b3dd183e-7ab1-40ae-b282-40575a9e47df => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:19:39 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] VM Stopped (Lifecycle Event)
Aug 15 19:19:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-39b89ddf-c875-481a-89af-7c066880e7e4 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:19:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-39b89ddf-c875-481a-89af-7c066880e7e4 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:19:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-d0bdff3f-aae2-47f8-9f33-8ed6f6831c99 req-73e03243-351c-4892-9b27-2cf54b04c38b service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Received event network-changed-0cbee9cd-128c-4c6d-ae87-7368a786fc4a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:19:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-d0bdff3f-aae2-47f8-9f33-8ed6f6831c99 req-73e03243-351c-4892-9b27-2cf54b04c38b service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Refreshing instance network info cache due to event network-changed-0cbee9cd-128c-4c6d-ae87-7368a786fc4a. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:19:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d0bdff3f-aae2-47f8-9f33-8ed6f6831c99 req-73e03243-351c-4892-9b27-2cf54b04c38b service nova] Acquiring lock "refresh_cache-182d8fc2-0246-4164-9d1b-f970cec4dd1f" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:19:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d0bdff3f-aae2-47f8-9f33-8ed6f6831c99 req-73e03243-351c-4892-9b27-2cf54b04c38b service nova] Acquired lock "refresh_cache-182d8fc2-0246-4164-9d1b-f970cec4dd1f" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:19:40 user nova-compute[73188]: DEBUG nova.network.neutron [req-d0bdff3f-aae2-47f8-9f33-8ed6f6831c99 req-73e03243-351c-4892-9b27-2cf54b04c38b service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Refreshing network info cache for port 0cbee9cd-128c-4c6d-ae87-7368a786fc4a {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:19:41 user nova-compute[73188]: DEBUG nova.network.neutron [req-d0bdff3f-aae2-47f8-9f33-8ed6f6831c99 req-73e03243-351c-4892-9b27-2cf54b04c38b service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Updated VIF entry in instance network info cache for port 0cbee9cd-128c-4c6d-ae87-7368a786fc4a. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:19:41 user nova-compute[73188]: DEBUG nova.network.neutron [req-d0bdff3f-aae2-47f8-9f33-8ed6f6831c99 req-73e03243-351c-4892-9b27-2cf54b04c38b service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Updating instance_info_cache with network_info: [{"id": "0cbee9cd-128c-4c6d-ae87-7368a786fc4a", "address": "fa:16:3e:b8:b6:ca", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cbee9cd-12", "ovs_interfaceid": "0cbee9cd-128c-4c6d-ae87-7368a786fc4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:19:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d0bdff3f-aae2-47f8-9f33-8ed6f6831c99 req-73e03243-351c-4892-9b27-2cf54b04c38b service nova] Releasing lock "refresh_cache-182d8fc2-0246-4164-9d1b-f970cec4dd1f" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:19:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "30dbb719-b373-431d-8590-7b7040fa3443" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "30dbb719-b373-431d-8590-7b7040fa3443" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:52 user nova-compute[73188]: DEBUG nova.compute.manager [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:19:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:19:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:19:52 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:19:52 user nova-compute[73188]: INFO nova.compute.claims [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Claim successful on node user
Aug 15 19:19:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:52 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:19:52 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:19:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:19:52 user nova-compute[73188]: DEBUG nova.compute.manager [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:19:52 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:19:52 user nova-compute[73188]: DEBUG nova.compute.manager [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:19:52 user nova-compute[73188]: DEBUG nova.network.neutron [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:19:52 user nova-compute[73188]: DEBUG nova.compute.manager [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:19:52 user nova-compute[73188]: INFO nova.virt.block_device [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Booting with volume snapshot ba70cf7d-2e07-4ae5-bf9d-46ac1039f617 at /dev/vda
Aug 15 19:19:53 user nova-compute[73188]: DEBUG nova.policy [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9503705066e5402cb569fae3b2bd8976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18eadba32f4547ad9436aca9285b7aad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:19:53 user nova-compute[73188]: DEBUG nova.network.neutron [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Successfully created port: 2cb25acc-8605-44c3-aa08-dfcbd3d60424 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:19:54 user nova-compute[73188]: DEBUG nova.network.neutron [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Successfully updated port: 2cb25acc-8605-44c3-aa08-dfcbd3d60424 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:19:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "refresh_cache-30dbb719-b373-431d-8590-7b7040fa3443" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:19:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquired lock "refresh_cache-30dbb719-b373-431d-8590-7b7040fa3443" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:19:54 user nova-compute[73188]: DEBUG nova.network.neutron [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:19:54 user nova-compute[73188]: DEBUG nova.compute.manager [req-0f582be0-8679-4bf0-899e-e712b47bbaa1 req-97a8534f-0b31-4b0b-bad8-a2803a9d8a65 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Received event network-changed-2cb25acc-8605-44c3-aa08-dfcbd3d60424 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:19:54 user nova-compute[73188]: DEBUG nova.compute.manager [req-0f582be0-8679-4bf0-899e-e712b47bbaa1 req-97a8534f-0b31-4b0b-bad8-a2803a9d8a65 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Refreshing instance network info cache due to event network-changed-2cb25acc-8605-44c3-aa08-dfcbd3d60424. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:19:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0f582be0-8679-4bf0-899e-e712b47bbaa1 req-97a8534f-0b31-4b0b-bad8-a2803a9d8a65 service nova] Acquiring lock "refresh_cache-30dbb719-b373-431d-8590-7b7040fa3443" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:19:54 user nova-compute[73188]: DEBUG nova.network.neutron [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:19:55 user nova-compute[73188]: DEBUG nova.network.neutron [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Updating instance_info_cache with network_info: [{"id": "2cb25acc-8605-44c3-aa08-dfcbd3d60424", "address": "fa:16:3e:81:95:3d", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb25acc-86", "ovs_interfaceid": "2cb25acc-8605-44c3-aa08-dfcbd3d60424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:19:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Releasing lock "refresh_cache-30dbb719-b373-431d-8590-7b7040fa3443" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:19:55 user nova-compute[73188]: DEBUG nova.compute.manager [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Instance network_info: |[{"id": "2cb25acc-8605-44c3-aa08-dfcbd3d60424", "address": "fa:16:3e:81:95:3d", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb25acc-86", "ovs_interfaceid": "2cb25acc-8605-44c3-aa08-dfcbd3d60424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:19:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0f582be0-8679-4bf0-899e-e712b47bbaa1 req-97a8534f-0b31-4b0b-bad8-a2803a9d8a65 service nova] Acquired lock "refresh_cache-30dbb719-b373-431d-8590-7b7040fa3443" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:19:55 user nova-compute[73188]: DEBUG nova.network.neutron [req-0f582be0-8679-4bf0-899e-e712b47bbaa1 req-97a8534f-0b31-4b0b-bad8-a2803a9d8a65 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Refreshing network info cache for port 2cb25acc-8605-44c3-aa08-dfcbd3d60424 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:19:55 user nova-compute[73188]: DEBUG nova.network.neutron [req-0f582be0-8679-4bf0-899e-e712b47bbaa1 req-97a8534f-0b31-4b0b-bad8-a2803a9d8a65 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Updated VIF entry in instance network info cache for port 2cb25acc-8605-44c3-aa08-dfcbd3d60424. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:19:55 user nova-compute[73188]: DEBUG nova.network.neutron [req-0f582be0-8679-4bf0-899e-e712b47bbaa1 req-97a8534f-0b31-4b0b-bad8-a2803a9d8a65 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Updating instance_info_cache with network_info: [{"id": "2cb25acc-8605-44c3-aa08-dfcbd3d60424", "address": "fa:16:3e:81:95:3d", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb25acc-86", "ovs_interfaceid": "2cb25acc-8605-44c3-aa08-dfcbd3d60424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:19:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0f582be0-8679-4bf0-899e-e712b47bbaa1 req-97a8534f-0b31-4b0b-bad8-a2803a9d8a65 service nova] Releasing lock "refresh_cache-30dbb719-b373-431d-8590-7b7040fa3443" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:19:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:19:58 user nova-compute[73188]: DEBUG os_brick.utils [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:19:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a66439-0a35-4786-8174-7b63acc88dd5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:19:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7665346-0383-4230-bc22-dd2dcd918212]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:19:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:19:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3560dcdf-4063-4db6-8e44-88c6b315f938]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:19:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f4df7e-f1c1-46cb-96e1-fe69c2df1d6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:19:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:19:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:19:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:19:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:19:58 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:19:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ea409e-db77-4f61-ac63-6cb70d760800]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:19:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:19:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:19:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:19:58 user nova-compute[73188]: DEBUG os_brick.utils [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:19:58 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Updating existing volume attachment record: 44edc4bb-33a2-4a46-8ada-abbe03c12b64 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:20:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "d8f302f1-7c20-483a-9eef-24566d51143d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:20:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "d8f302f1-7c20-483a-9eef-24566d51143d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:20:01 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:20:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:20:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:20:01 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:20:01 user nova-compute[73188]: INFO nova.compute.claims [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Claim successful on node user
Aug 15 19:20:02 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:20:02 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:20:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:20:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:20:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:20:02 user nova-compute[73188]: DEBUG nova.network.neutron [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:20:02 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:20:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:20:02 user nova-compute[73188]: DEBUG nova.policy [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f7c7805c0754c61a5b9f8d16e28b228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575959aac5a1464dac98034bdb3bb948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:20:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:20:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:20:02 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:20:02 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Creating image(s)
Aug 15 19:20:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:20:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "/opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:20:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "/opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:20:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "3362f0b0687e609ff915b47a67a76c6a2c333581" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:20:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "3362f0b0687e609ff915b47a67a76c6a2c333581" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:20:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3362f0b0687e609ff915b47a67a76c6a2c333581.part --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3362f0b0687e609ff915b47a67a76c6a2c333581.part --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:03 user nova-compute[73188]: DEBUG nova.virt.images [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] 631e0fe8-5eee-40af-9bb8-e5257f118c66 was qcow2, converting to raw {{(pid=73188) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 19:20:03 user nova-compute[73188]: DEBUG nova.privsep.utils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73188) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 19:20:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3362f0b0687e609ff915b47a67a76c6a2c333581.part /opt/stack/data/nova/instances/_base/3362f0b0687e609ff915b47a67a76c6a2c333581.converted {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:03 user nova-compute[73188]: DEBUG nova.network.neutron [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Successfully created port: 11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3362f0b0687e609ff915b47a67a76c6a2c333581.part /opt/stack/data/nova/instances/_base/3362f0b0687e609ff915b47a67a76c6a2c333581.converted" returned: 0 in 0.742s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3362f0b0687e609ff915b47a67a76c6a2c333581.converted --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3362f0b0687e609ff915b47a67a76c6a2c333581.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "3362f0b0687e609ff915b47a67a76c6a2c333581" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.715s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3362f0b0687e609ff915b47a67a76c6a2c333581 --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3362f0b0687e609ff915b47a67a76c6a2c333581 --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "3362f0b0687e609ff915b47a67a76c6a2c333581" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "3362f0b0687e609ff915b47a67a76c6a2c333581" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3362f0b0687e609ff915b47a67a76c6a2c333581 --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG nova.network.neutron [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Successfully updated port: 11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3362f0b0687e609ff915b47a67a76c6a2c333581 --force-share --output=json" returned: 0 in 0.193s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3362f0b0687e609ff915b47a67a76c6a2c333581,backing_fmt=raw /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG nova.compute.manager [req-69cc2ce0-f47b-4e07-b039-8115c1ca8490 req-ec8ed5b9-a214-485d-b338-307e22a0515a service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Received event network-changed-11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG nova.compute.manager [req-69cc2ce0-f47b-4e07-b039-8115c1ca8490 req-ec8ed5b9-a214-485d-b338-307e22a0515a service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Refreshing instance network info cache due to event network-changed-11b7dd56-8608-446d-9229-ccac461f89b2. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-69cc2ce0-f47b-4e07-b039-8115c1ca8490 req-ec8ed5b9-a214-485d-b338-307e22a0515a service nova] Acquiring lock "refresh_cache-d8f302f1-7c20-483a-9eef-24566d51143d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-69cc2ce0-f47b-4e07-b039-8115c1ca8490 req-ec8ed5b9-a214-485d-b338-307e22a0515a service nova] Acquired lock "refresh_cache-d8f302f1-7c20-483a-9eef-24566d51143d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG nova.network.neutron [req-69cc2ce0-f47b-4e07-b039-8115c1ca8490 req-ec8ed5b9-a214-485d-b338-307e22a0515a service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Refreshing network info cache for port 11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "refresh_cache-d8f302f1-7c20-483a-9eef-24566d51143d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3362f0b0687e609ff915b47a67a76c6a2c333581,backing_fmt=raw /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk 1073741824" returned: 0 in 0.056s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "3362f0b0687e609ff915b47a67a76c6a2c333581" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3362f0b0687e609ff915b47a67a76c6a2c333581 --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG nova.network.neutron [req-69cc2ce0-f47b-4e07-b039-8115c1ca8490 req-ec8ed5b9-a214-485d-b338-307e22a0515a service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3362f0b0687e609ff915b47a67a76c6a2c333581 --force-share --output=json" returned: 0 in 0.183s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:20:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:05 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Cannot resize image /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:20:05 user nova-compute[73188]: DEBUG nova.objects.instance [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lazy-loading 'migration_context' on Instance uuid d8f302f1-7c20-483a-9eef-24566d51143d {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:20:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:20:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Ensure instance console log exists: /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:20:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:20:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:20:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:20:05 user nova-compute[73188]: DEBUG nova.network.neutron [req-69cc2ce0-f47b-4e07-b039-8115c1ca8490 req-ec8ed5b9-a214-485d-b338-307e22a0515a service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:20:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-69cc2ce0-f47b-4e07-b039-8115c1ca8490 req-ec8ed5b9-a214-485d-b338-307e22a0515a service nova] Releasing lock "refresh_cache-d8f302f1-7c20-483a-9eef-24566d51143d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:20:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquired lock "refresh_cache-d8f302f1-7c20-483a-9eef-24566d51143d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:20:05 user nova-compute[73188]: DEBUG nova.network.neutron [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:20:05 user nova-compute[73188]: DEBUG nova.network.neutron [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.network.neutron [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Updating instance_info_cache with network_info: [{"id": "11b7dd56-8608-446d-9229-ccac461f89b2", "address": "fa:16:3e:e6:c1:cc", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b7dd56-86", "ovs_interfaceid": "11b7dd56-8608-446d-9229-ccac461f89b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Releasing lock "refresh_cache-d8f302f1-7c20-483a-9eef-24566d51143d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Instance network_info: |[{"id": "11b7dd56-8608-446d-9229-ccac461f89b2", "address": "fa:16:3e:e6:c1:cc", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b7dd56-86", "ovs_interfaceid": "11b7dd56-8608-446d-9229-ccac461f89b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Start _get_guest_xml network_info=[{"id": "11b7dd56-8608-446d-9229-ccac461f89b2", "address": "fa:16:3e:e6:c1:cc", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b7dd56-86", "ovs_interfaceid": "11b7dd56-8608-446d-9229-ccac461f89b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:19:59Z,direct_url=<?>,disk_format='qcow2',id=631e0fe8-5eee-40af-9bb8-e5257f118c66,min_disk=0,min_ram=0,name='tempest-scenario-img--2104017191',owner='575959aac5a1464dac98034bdb3bb948',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:20:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': '631e0fe8-5eee-40af-9bb8-e5257f118c66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:20:06 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:20:06 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:19:59Z,direct_url=<?>,disk_format='qcow2',id=631e0fe8-5eee-40af-9bb8-e5257f118c66,min_disk=0,min_ram=0,name='tempest-scenario-img--2104017191',owner='575959aac5a1464dac98034bdb3bb948',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:20:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-301520799',display_name='tempest-TestMinimumBasicScenario-server-301520799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-301520799',id=34,image_ref='631e0fe8-5eee-40af-9bb8-e5257f118c66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdv0IsHB3MXQN4dTrfwe7oeY+S+nveVoed4be855tcM05giYptdJQ6TYYtWmT0/Fe+DKOFA/PwEqda4fyRZdR34JH9hdE5a8e3CvPSR5qDW4Mzi86zCElNUxumBIWNwxg==',key_name='tempest-TestMinimumBasicScenario-1240204301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='575959aac5a1464dac98034bdb3bb948',ramdisk_id='',reservation_id='r-ozfpmbwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='631e0fe8-5eee-40af-9bb8-e5257f118c66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1939446316',owner_user_name='tempest-TestMinimumBasicScenario-1939446316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:20:03Z,user_data=None,user_id='9f7c7805c0754c61a5b9f8d16e28b228',uuid=d8f302f1-7c20-483a-9eef-24566d51143d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11b7dd56-8608-446d-9229-ccac461f89b2", "address": "fa:16:3e:e6:c1:cc", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b7dd56-86", "ovs_interfaceid": "11b7dd56-8608-446d-9229-ccac461f89b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Converting VIF {"id": "11b7dd56-8608-446d-9229-ccac461f89b2", "address": "fa:16:3e:e6:c1:cc", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b7dd56-86", "ovs_interfaceid": "11b7dd56-8608-446d-9229-ccac461f89b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:c1:cc,bridge_name='br-int',has_traffic_filtering=True,id=11b7dd56-8608-446d-9229-ccac461f89b2,network=Network(a4981d47-8986-4ebf-a0cd-54692da9ff40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b7dd56-86') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.objects.instance [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lazy-loading 'pci_devices' on Instance uuid d8f302f1-7c20-483a-9eef-24566d51143d {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:20:06 user nova-compute[73188]:   <uuid>d8f302f1-7c20-483a-9eef-24566d51143d</uuid>
Aug 15 19:20:06 user nova-compute[73188]:   <name>instance-00000022</name>
Aug 15 19:20:06 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:20:06 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:20:06 user nova-compute[73188]:   <metadata>
Aug 15 19:20:06 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:20:06 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:20:06 user nova-compute[73188]:       <nova:name>tempest-TestMinimumBasicScenario-server-301520799</nova:name>
Aug 15 19:20:06 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:20:06</nova:creationTime>
Aug 15 19:20:06 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:20:06 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:20:06 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:20:06 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:20:06 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:20:06 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:20:06 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:20:06 user nova-compute[73188]:       <nova:owner>
Aug 15 19:20:06 user nova-compute[73188]:         <nova:user uuid="9f7c7805c0754c61a5b9f8d16e28b228">tempest-TestMinimumBasicScenario-1939446316-project-member</nova:user>
Aug 15 19:20:06 user nova-compute[73188]:         <nova:project uuid="575959aac5a1464dac98034bdb3bb948">tempest-TestMinimumBasicScenario-1939446316</nova:project>
Aug 15 19:20:06 user nova-compute[73188]:       </nova:owner>
Aug 15 19:20:06 user nova-compute[73188]:       <nova:root type="image" uuid="631e0fe8-5eee-40af-9bb8-e5257f118c66"/>
Aug 15 19:20:06 user nova-compute[73188]:       <nova:ports>
Aug 15 19:20:06 user nova-compute[73188]:         <nova:port uuid="11b7dd56-8608-446d-9229-ccac461f89b2">
Aug 15 19:20:06 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 19:20:06 user nova-compute[73188]:         </nova:port>
Aug 15 19:20:06 user nova-compute[73188]:       </nova:ports>
Aug 15 19:20:06 user nova-compute[73188]:     </nova:instance>
Aug 15 19:20:06 user nova-compute[73188]:   </metadata>
Aug 15 19:20:06 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:20:06 user nova-compute[73188]:     <system>
Aug 15 19:20:06 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:20:06 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:20:06 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:20:06 user nova-compute[73188]:       <entry name="serial">d8f302f1-7c20-483a-9eef-24566d51143d</entry>
Aug 15 19:20:06 user nova-compute[73188]:       <entry name="uuid">d8f302f1-7c20-483a-9eef-24566d51143d</entry>
Aug 15 19:20:06 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:20:06 user nova-compute[73188]:     </system>
Aug 15 19:20:06 user nova-compute[73188]:   </sysinfo>
Aug 15 19:20:06 user nova-compute[73188]:   <os>
Aug 15 19:20:06 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:20:06 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:20:06 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:20:06 user nova-compute[73188]:   </os>
Aug 15 19:20:06 user nova-compute[73188]:   <features>
Aug 15 19:20:06 user nova-compute[73188]:     <acpi/>
Aug 15 19:20:06 user nova-compute[73188]:     <apic/>
Aug 15 19:20:06 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:20:06 user nova-compute[73188]:   </features>
Aug 15 19:20:06 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:20:06 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:20:06 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:20:06 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:20:06 user nova-compute[73188]:   </clock>
Aug 15 19:20:06 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:20:06 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:20:06 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:20:06 user nova-compute[73188]:   </cpu>
Aug 15 19:20:06 user nova-compute[73188]:   <devices>
Aug 15 19:20:06 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:20:06 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:20:06 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk"/>
Aug 15 19:20:06 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:20:06 user nova-compute[73188]:     </disk>
Aug 15 19:20:06 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:20:06 user nova-compute[73188]:       <mac address="fa:16:3e:e6:c1:cc"/>
Aug 15 19:20:06 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:20:06 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:20:06 user nova-compute[73188]:       <target dev="tap11b7dd56-86"/>
Aug 15 19:20:06 user nova-compute[73188]:     </interface>
Aug 15 19:20:06 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:20:06 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/console.log" append="off"/>
Aug 15 19:20:06 user nova-compute[73188]:     </serial>
Aug 15 19:20:06 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:20:06 user nova-compute[73188]:     <video>
Aug 15 19:20:06 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:20:06 user nova-compute[73188]:     </video>
Aug 15 19:20:06 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:20:06 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:20:06 user nova-compute[73188]:     </rng>
Aug 15 19:20:06 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:20:06 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:20:06 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:20:06 user nova-compute[73188]:     </memballoon>
Aug 15 19:20:06 user nova-compute[73188]:   </devices>
Aug 15 19:20:06 user nova-compute[73188]: </domain>
Aug 15 19:20:06 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-301520799',display_name='tempest-TestMinimumBasicScenario-server-301520799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-301520799',id=34,image_ref='631e0fe8-5eee-40af-9bb8-e5257f118c66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdv0IsHB3MXQN4dTrfwe7oeY+S+nveVoed4be855tcM05giYptdJQ6TYYtWmT0/Fe+DKOFA/PwEqda4fyRZdR34JH9hdE5a8e3CvPSR5qDW4Mzi86zCElNUxumBIWNwxg==',key_name='tempest-TestMinimumBasicScenario-1240204301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='575959aac5a1464dac98034bdb3bb948',ramdisk_id='',reservation_id='r-ozfpmbwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='631e0fe8-5eee-40af-9bb8-e5257f118c66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1939446316',owner_user_name='tempest-TestMinimumBasicScenario-1939446316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:20:03Z,user_data=None,user_id='9f7c7805c0754c61a5b9f8d16e28b228',uuid=d8f302f1-7c20-483a-9eef-24566d51143d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11b7dd56-8608-446d-9229-ccac461f89b2", "address": "fa:16:3e:e6:c1:cc", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b7dd56-86", "ovs_interfaceid": "11b7dd56-8608-446d-9229-ccac461f89b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Converting VIF {"id": "11b7dd56-8608-446d-9229-ccac461f89b2", "address": "fa:16:3e:e6:c1:cc", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b7dd56-86", "ovs_interfaceid": "11b7dd56-8608-446d-9229-ccac461f89b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:c1:cc,bridge_name='br-int',has_traffic_filtering=True,id=11b7dd56-8608-446d-9229-ccac461f89b2,network=Network(a4981d47-8986-4ebf-a0cd-54692da9ff40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b7dd56-86') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG os_vif [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:c1:cc,bridge_name='br-int',has_traffic_filtering=True,id=11b7dd56-8608-446d-9229-ccac461f89b2,network=Network(a4981d47-8986-4ebf-a0cd-54692da9ff40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b7dd56-86') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11b7dd56-86, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap11b7dd56-86, col_values=(('external_ids', {'iface-id': '11b7dd56-8608-446d-9229-ccac461f89b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:c1:cc', 'vm-uuid': 'd8f302f1-7c20-483a-9eef-24566d51143d'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:06 user nova-compute[73188]: INFO os_vif [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:c1:cc,bridge_name='br-int',has_traffic_filtering=True,id=11b7dd56-8608-446d-9229-ccac461f89b2,network=Network(a4981d47-8986-4ebf-a0cd-54692da9ff40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b7dd56-86')
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:20:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] No VIF found with MAC fa:16:3e:e6:c1:cc, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:20:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-58886263-e5f7-43d3-a049-97536fc81e47 req-1abd5702-ba28-41bb-abcb-b4505ec269a3 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Received event network-vif-plugged-11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:20:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-58886263-e5f7-43d3-a049-97536fc81e47 req-1abd5702-ba28-41bb-abcb-b4505ec269a3 service nova] Acquiring lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:20:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-58886263-e5f7-43d3-a049-97536fc81e47 req-1abd5702-ba28-41bb-abcb-b4505ec269a3 service nova] Lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:20:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-58886263-e5f7-43d3-a049-97536fc81e47 req-1abd5702-ba28-41bb-abcb-b4505ec269a3 service nova] Lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:20:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-58886263-e5f7-43d3-a049-97536fc81e47 req-1abd5702-ba28-41bb-abcb-b4505ec269a3 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] No waiting events found dispatching network-vif-plugged-11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:20:07 user nova-compute[73188]: WARNING nova.compute.manager [req-58886263-e5f7-43d3-a049-97536fc81e47 req-1abd5702-ba28-41bb-abcb-b4505ec269a3 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Received unexpected event network-vif-plugged-11b7dd56-8608-446d-9229-ccac461f89b2 for instance with vm_state building and task_state spawning.
Aug 15 19:20:08 user nova-compute[73188]: DEBUG nova.compute.manager [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:20:08 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Creating image(s)
Aug 15 19:20:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Did not create local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Ensure instance console log exists: /opt/stack/data/nova/instances/30dbb719-b373-431d-8590-7b7040fa3443/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Start _get_guest_xml network_info=[{"id": "2cb25acc-8605-44c3-aa08-dfcbd3d60424", "address": "fa:16:3e:81:95:3d", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb25acc-86", "ovs_interfaceid": "2cb25acc-8605-44c3-aa08-dfcbd3d60424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-15T19:19:43Z,direct_url=<?>,disk_format='qcow2',id=0f297bb0-2af2-4383-bd97-3fb47c39b5b0,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-482546897',owner='18eadba32f4547ad9436aca9285b7aad',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-15T19:19:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bZnfrWcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '30dbb719-b373-431d-8590-7b7040fa3443', 'attached_at': '', 'detached_at': '', 'volume_id': '43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0', 'serial': '43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0'}, 'attachment_id': '44edc4bb-33a2-4a46-8ada-abbe03c12b64', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:20:08 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:20:08 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:20:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-15T19:19:43Z,direct_url=<?>,disk_format='qcow2',id=0f297bb0-2af2-4383-bd97-3fb47c39b5b0,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-482546897',owner='18eadba32f4547ad9436aca9285b7aad',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-15T19:19:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bZnfrWcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:20:08 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:20:08 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:20:08 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca19c56-80ae-4cb1-b227-a4e4b6e43b95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:20:08 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a780d6d3-d863-43a3-91ce-4a47aea4614a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0] added
Aug 15 19:20:08 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c27f8c6-b590-4542-b11b-cc25ddf5776f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[132e39ce-da40-4c82-a90e-a4611f9d17a1]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bZnfrWcX {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bZnfrWcX" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eebd4b2-a789-4163-a3ef-791bac30424f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bZnfrWcX'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[383b069c-5212-4714-be76-ed246350950f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb46c30-c23e-4884-a911-3a115f37f0d8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:20:08 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:20:08 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:20:08 user nova-compute[73188]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:20:08 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:20:08 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:20:08 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:20:08 user nova-compute[73188]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:20:08 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c02cf8-1648-4bcf-8a5e-e365a6d96752]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0, portal: 172.16.0.220,3260]
Aug 15 19:20:08 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0, portal: 172.16.0.220,3260] successful.
Aug 15 19:20:08 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa6a8b3-504b-4557-b619-22475a9ee38b]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7e3888-ff32-4aa5-9ff2-b22cdf1fe972]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:20:08 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:20:08 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:20:08 user nova-compute[73188]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:20:08 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:20:08 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:20:08 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:20:08 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:20:08 user nova-compute[73188]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:20:08 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:20:08 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e114d9-e53f-4900-9836-6c87b1ed33a7]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:20:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bZnfrWcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26465366636356139', 'path': '/dev/sdf'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465366636356139', 'path': '/dev/sdf'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1258219588',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1258219588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1258219588',id=33,image_ref='0f297bb0-2af2-4383-bd97-3fb47c39b5b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKC0bpnnzrQvW1jA/u16Bx5fqsyaeRjf6ClnT/JFCnHfS6GwfrIu0YFrhio7M+/MwC+vypXVfEqwhqfdUh6XGHG/gcFbTOK8Y5HNfkgHr5Qw4Qpe0YttcePRY3x3TwwPhQ==',key_name='tempest-keypair-988402873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18eadba32f4547ad9436aca9285b7aad',ramdisk_id='',reservation_id='r-m47pl2lu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2114363476',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2114363476-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2114363476',owner_user_name='tempest-TestVolumeBootPattern-2114363476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9503705066e5402cb569fae3b2bd8976',uuid=30dbb719-b373-431d-8590-7b7040fa3443,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cb25acc-8605-44c3-aa08-dfcbd3d60424", "address": "fa:16:3e:81:95:3d", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb25acc-86", "ovs_interfaceid": "2cb25acc-8605-44c3-aa08-dfcbd3d60424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converting VIF {"id": "2cb25acc-8605-44c3-aa08-dfcbd3d60424", "address": "fa:16:3e:81:95:3d", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb25acc-86", "ovs_interfaceid": "2cb25acc-8605-44c3-aa08-dfcbd3d60424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:95:3d,bridge_name='br-int',has_traffic_filtering=True,id=2cb25acc-8605-44c3-aa08-dfcbd3d60424,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cb25acc-86') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG nova.objects.instance [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lazy-loading 'pci_devices' on Instance uuid 30dbb719-b373-431d-8590-7b7040fa3443 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:20:09 user nova-compute[73188]:   <uuid>30dbb719-b373-431d-8590-7b7040fa3443</uuid>
Aug 15 19:20:09 user nova-compute[73188]:   <name>instance-00000021</name>
Aug 15 19:20:09 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:20:09 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:20:09 user nova-compute[73188]:   <metadata>
Aug 15 19:20:09 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:20:09 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:20:09 user nova-compute[73188]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1258219588</nova:name>
Aug 15 19:20:09 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:20:08</nova:creationTime>
Aug 15 19:20:09 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:20:09 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:20:09 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:20:09 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:20:09 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:20:09 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:20:09 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:20:09 user nova-compute[73188]:       <nova:owner>
Aug 15 19:20:09 user nova-compute[73188]:         <nova:user uuid="9503705066e5402cb569fae3b2bd8976">tempest-TestVolumeBootPattern-2114363476-project-member</nova:user>
Aug 15 19:20:09 user nova-compute[73188]:         <nova:project uuid="18eadba32f4547ad9436aca9285b7aad">tempest-TestVolumeBootPattern-2114363476</nova:project>
Aug 15 19:20:09 user nova-compute[73188]:       </nova:owner>
Aug 15 19:20:09 user nova-compute[73188]:       <nova:root type="image" uuid="0f297bb0-2af2-4383-bd97-3fb47c39b5b0"/>
Aug 15 19:20:09 user nova-compute[73188]:       <nova:ports>
Aug 15 19:20:09 user nova-compute[73188]:         <nova:port uuid="2cb25acc-8605-44c3-aa08-dfcbd3d60424">
Aug 15 19:20:09 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 19:20:09 user nova-compute[73188]:         </nova:port>
Aug 15 19:20:09 user nova-compute[73188]:       </nova:ports>
Aug 15 19:20:09 user nova-compute[73188]:     </nova:instance>
Aug 15 19:20:09 user nova-compute[73188]:   </metadata>
Aug 15 19:20:09 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:20:09 user nova-compute[73188]:     <system>
Aug 15 19:20:09 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:20:09 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:20:09 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:20:09 user nova-compute[73188]:       <entry name="serial">30dbb719-b373-431d-8590-7b7040fa3443</entry>
Aug 15 19:20:09 user nova-compute[73188]:       <entry name="uuid">30dbb719-b373-431d-8590-7b7040fa3443</entry>
Aug 15 19:20:09 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:20:09 user nova-compute[73188]:     </system>
Aug 15 19:20:09 user nova-compute[73188]:   </sysinfo>
Aug 15 19:20:09 user nova-compute[73188]:   <os>
Aug 15 19:20:09 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:20:09 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:20:09 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:20:09 user nova-compute[73188]:   </os>
Aug 15 19:20:09 user nova-compute[73188]:   <features>
Aug 15 19:20:09 user nova-compute[73188]:     <acpi/>
Aug 15 19:20:09 user nova-compute[73188]:     <apic/>
Aug 15 19:20:09 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:20:09 user nova-compute[73188]:   </features>
Aug 15 19:20:09 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:20:09 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:20:09 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:20:09 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:20:09 user nova-compute[73188]:   </clock>
Aug 15 19:20:09 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:20:09 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:20:09 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:20:09 user nova-compute[73188]:   </cpu>
Aug 15 19:20:09 user nova-compute[73188]:   <devices>
Aug 15 19:20:09 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:20:09 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:20:09 user nova-compute[73188]:       <source dev="/dev/sdf"/>
Aug 15 19:20:09 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:20:09 user nova-compute[73188]:       <serial>43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0</serial>
Aug 15 19:20:09 user nova-compute[73188]:     </disk>
Aug 15 19:20:09 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:20:09 user nova-compute[73188]:       <mac address="fa:16:3e:81:95:3d"/>
Aug 15 19:20:09 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:20:09 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:20:09 user nova-compute[73188]:       <target dev="tap2cb25acc-86"/>
Aug 15 19:20:09 user nova-compute[73188]:     </interface>
Aug 15 19:20:09 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:20:09 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/30dbb719-b373-431d-8590-7b7040fa3443/console.log" append="off"/>
Aug 15 19:20:09 user nova-compute[73188]:     </serial>
Aug 15 19:20:09 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:20:09 user nova-compute[73188]:     <video>
Aug 15 19:20:09 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:20:09 user nova-compute[73188]:     </video>
Aug 15 19:20:09 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:20:09 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:20:09 user nova-compute[73188]:     </rng>
Aug 15 19:20:09 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:20:09 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:20:09 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:20:09 user nova-compute[73188]:     </memballoon>
Aug 15 19:20:09 user nova-compute[73188]:   </devices>
Aug 15 19:20:09 user nova-compute[73188]: </domain>
Aug 15 19:20:09 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1258219588',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1258219588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1258219588',id=33,image_ref='0f297bb0-2af2-4383-bd97-3fb47c39b5b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKC0bpnnzrQvW1jA/u16Bx5fqsyaeRjf6ClnT/JFCnHfS6GwfrIu0YFrhio7M+/MwC+vypXVfEqwhqfdUh6XGHG/gcFbTOK8Y5HNfkgHr5Qw4Qpe0YttcePRY3x3TwwPhQ==',key_name='tempest-keypair-988402873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18eadba32f4547ad9436aca9285b7aad',ramdisk_id='',reservation_id='r-m47pl2lu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2114363476',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2114363476-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2114363476',owner_user_name='tempest-TestVolumeBootPattern-2114363476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9503705066e5402cb569fae3b2bd8976',uuid=30dbb719-b373-431d-8590-7b7040fa3443,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cb25acc-8605-44c3-aa08-dfcbd3d60424", "address": "fa:16:3e:81:95:3d", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb25acc-86", "ovs_interfaceid": "2cb25acc-8605-44c3-aa08-dfcbd3d60424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converting VIF {"id": "2cb25acc-8605-44c3-aa08-dfcbd3d60424", "address": "fa:16:3e:81:95:3d", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb25acc-86", "ovs_interfaceid": "2cb25acc-8605-44c3-aa08-dfcbd3d60424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:95:3d,bridge_name='br-int',has_traffic_filtering=True,id=2cb25acc-8605-44c3-aa08-dfcbd3d60424,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cb25acc-86') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG os_vif [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:95:3d,bridge_name='br-int',has_traffic_filtering=True,id=2cb25acc-8605-44c3-aa08-dfcbd3d60424,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cb25acc-86') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cb25acc-86, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2cb25acc-86, col_values=(('external_ids', {'iface-id': '2cb25acc-8605-44c3-aa08-dfcbd3d60424', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:95:3d', 'vm-uuid': '30dbb719-b373-431d-8590-7b7040fa3443'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:09 user nova-compute[73188]: INFO os_vif [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:95:3d,bridge_name='br-int',has_traffic_filtering=True,id=2cb25acc-8605-44c3-aa08-dfcbd3d60424,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cb25acc-86')
Aug 15 19:20:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] No VIF found with MAC fa:16:3e:81:95:3d, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-469f43e7-4787-462a-966b-5f61a83be1f3 req-59aa6ac1-fe31-4a90-bbb9-71b2d98ca1ab service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Received event network-vif-plugged-11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-469f43e7-4787-462a-966b-5f61a83be1f3 req-59aa6ac1-fe31-4a90-bbb9-71b2d98ca1ab service nova] Acquiring lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-469f43e7-4787-462a-966b-5f61a83be1f3 req-59aa6ac1-fe31-4a90-bbb9-71b2d98ca1ab service nova] Lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-469f43e7-4787-462a-966b-5f61a83be1f3 req-59aa6ac1-fe31-4a90-bbb9-71b2d98ca1ab service nova] Lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-469f43e7-4787-462a-966b-5f61a83be1f3 req-59aa6ac1-fe31-4a90-bbb9-71b2d98ca1ab service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] No waiting events found dispatching network-vif-plugged-11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:20:09 user nova-compute[73188]: WARNING nova.compute.manager [req-469f43e7-4787-462a-966b-5f61a83be1f3 req-59aa6ac1-fe31-4a90-bbb9-71b2d98ca1ab service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Received unexpected event network-vif-plugged-11b7dd56-8608-446d-9229-ccac461f89b2 for instance with vm_state building and task_state spawning.
Aug 15 19:20:09 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127209.9653654, d8f302f1-7c20-483a-9eef-24566d51143d => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:20:09 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] VM Resumed (Lifecycle Event)
Aug 15 19:20:09 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:20:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:20:09 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Instance spawned successfully.
Aug 15 19:20:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:20:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:20:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:20:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:20:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:20:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:20:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:20:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:20:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:20:10 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:20:10 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127209.966959, d8f302f1-7c20-483a-9eef-24566d51143d => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:20:10 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] VM Started (Lifecycle Event)
Aug 15 19:20:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:20:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:20:10 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:20:10 user nova-compute[73188]: INFO nova.compute.manager [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Took 7.52 seconds to spawn the instance on the hypervisor.
Aug 15 19:20:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:20:10 user nova-compute[73188]: INFO nova.compute.manager [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Took 8.30 seconds to build instance.
Aug 15 19:20:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e7f1c970-caf9-42d3-a21d-d86291909723 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "d8f302f1-7c20-483a-9eef-24566d51143d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.417s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:20:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-5c24d4b5-7659-4241-813d-c81c778166b0 req-66c876d4-5dbd-43cb-b52d-680e6e8df8c6 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Received event network-vif-plugged-2cb25acc-8605-44c3-aa08-dfcbd3d60424 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:20:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5c24d4b5-7659-4241-813d-c81c778166b0 req-66c876d4-5dbd-43cb-b52d-680e6e8df8c6 service nova] Acquiring lock "30dbb719-b373-431d-8590-7b7040fa3443-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:20:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5c24d4b5-7659-4241-813d-c81c778166b0 req-66c876d4-5dbd-43cb-b52d-680e6e8df8c6 service nova] Lock "30dbb719-b373-431d-8590-7b7040fa3443-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:20:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5c24d4b5-7659-4241-813d-c81c778166b0 req-66c876d4-5dbd-43cb-b52d-680e6e8df8c6 service nova] Lock "30dbb719-b373-431d-8590-7b7040fa3443-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:20:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-5c24d4b5-7659-4241-813d-c81c778166b0 req-66c876d4-5dbd-43cb-b52d-680e6e8df8c6 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] No waiting events found dispatching network-vif-plugged-2cb25acc-8605-44c3-aa08-dfcbd3d60424 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:20:11 user nova-compute[73188]: WARNING nova.compute.manager [req-5c24d4b5-7659-4241-813d-c81c778166b0 req-66c876d4-5dbd-43cb-b52d-680e6e8df8c6 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Received unexpected event network-vif-plugged-2cb25acc-8605-44c3-aa08-dfcbd3d60424 for instance with vm_state building and task_state spawning.
Aug 15 19:20:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-5c24d4b5-7659-4241-813d-c81c778166b0 req-66c876d4-5dbd-43cb-b52d-680e6e8df8c6 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Received event network-vif-plugged-2cb25acc-8605-44c3-aa08-dfcbd3d60424 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:20:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5c24d4b5-7659-4241-813d-c81c778166b0 req-66c876d4-5dbd-43cb-b52d-680e6e8df8c6 service nova] Acquiring lock "30dbb719-b373-431d-8590-7b7040fa3443-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:20:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5c24d4b5-7659-4241-813d-c81c778166b0 req-66c876d4-5dbd-43cb-b52d-680e6e8df8c6 service nova] Lock "30dbb719-b373-431d-8590-7b7040fa3443-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:20:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5c24d4b5-7659-4241-813d-c81c778166b0 req-66c876d4-5dbd-43cb-b52d-680e6e8df8c6 service nova] Lock "30dbb719-b373-431d-8590-7b7040fa3443-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:20:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-5c24d4b5-7659-4241-813d-c81c778166b0 req-66c876d4-5dbd-43cb-b52d-680e6e8df8c6 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] No waiting events found dispatching network-vif-plugged-2cb25acc-8605-44c3-aa08-dfcbd3d60424 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:20:11 user nova-compute[73188]: WARNING nova.compute.manager [req-5c24d4b5-7659-4241-813d-c81c778166b0 req-66c876d4-5dbd-43cb-b52d-680e6e8df8c6 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Received unexpected event network-vif-plugged-2cb25acc-8605-44c3-aa08-dfcbd3d60424 for instance with vm_state building and task_state spawning.
Aug 15 19:20:13 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127213.267985, 30dbb719-b373-431d-8590-7b7040fa3443 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:20:13 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] VM Resumed (Lifecycle Event)
Aug 15 19:20:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:20:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:20:13 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Instance spawned successfully.
Aug 15 19:20:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:20:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:20:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:20:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:20:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:20:13 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:20:13 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127213.2720242, 30dbb719-b373-431d-8590-7b7040fa3443 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:20:13 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] VM Started (Lifecycle Event)
Aug 15 19:20:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:20:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:20:13 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:20:13 user nova-compute[73188]: INFO nova.compute.manager [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Took 5.23 seconds to spawn the instance on the hypervisor.
Aug 15 19:20:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:20:13 user nova-compute[73188]: INFO nova.compute.manager [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Took 21.25 seconds to build instance.
Aug 15 19:20:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0cbbe1a8-3ff3-46c3-b00d-50fe383af2b4 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "30dbb719-b373-431d-8590-7b7040fa3443" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.375s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:20:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:18 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:20:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:20 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:20:21 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:20:21 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:20:21 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:20:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:20:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:20:21 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:20:21 user nova-compute[73188]: DEBUG nova.objects.instance [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lazy-loading 'info_cache' on Instance uuid ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:20:22 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Updating instance_info_cache with network_info: [{"id": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "address": "fa:16:3e:df:71:ad", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85966f51-bc", "ovs_interfaceid": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:20:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:20:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:20:22 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:20:22 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:20:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:20:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:20:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:20:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:20:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:20:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:24 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:20:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:20:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac47948a-9396-4c68-9662-1ad1595d096b/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac47948a-9396-4c68-9662-1ad1595d096b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac47948a-9396-4c68-9662-1ad1595d096b/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac47948a-9396-4c68-9662-1ad1595d096b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:20:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:20:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:27 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:20:27 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:20:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=7021MB free_disk=25.023841857910156GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3d713d03-3e60-4dec-a295-a4652ac21842 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e00adf53-085f-436d-a09f-e97e92ca79cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 139ccf1c-4792-4653-9475-c61b1f9c4846 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 215077af-60a1-4a82-b24e-1545349363d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 0ee7de87-76ad-48ae-8bcd-93b2792a96cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance b3dd183e-7ab1-40ae-b282-40575a9e47df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 182d8fc2-0246-4164-9d1b-f970cec4dd1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 9940ced5-da22-4d30-8895-a1fbe03821c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ac47948a-9396-4c68-9662-1ad1595d096b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 30dbb719-b373-431d-8590-7b7040fa3443 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance d8f302f1-7c20-483a-9eef-24566d51143d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:20:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:20:28 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:20:28 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:20:28 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:20:28 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:20:28 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:20:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:30 user nova-compute[73188]: DEBUG nova.compute.manager [req-ac186c3e-d10e-42bd-8de9-9bfb32c868e0 req-4ac180d4-cb01-4241-805c-a25ce39e612e service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Received event network-changed-7bcc30ef-9465-417f-9400-3c8135ca58d2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:20:30 user nova-compute[73188]: DEBUG nova.compute.manager [req-ac186c3e-d10e-42bd-8de9-9bfb32c868e0 req-4ac180d4-cb01-4241-805c-a25ce39e612e service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Refreshing instance network info cache due to event network-changed-7bcc30ef-9465-417f-9400-3c8135ca58d2. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:20:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ac186c3e-d10e-42bd-8de9-9bfb32c868e0 req-4ac180d4-cb01-4241-805c-a25ce39e612e service nova] Acquiring lock "refresh_cache-9940ced5-da22-4d30-8895-a1fbe03821c8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:20:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ac186c3e-d10e-42bd-8de9-9bfb32c868e0 req-4ac180d4-cb01-4241-805c-a25ce39e612e service nova] Acquired lock "refresh_cache-9940ced5-da22-4d30-8895-a1fbe03821c8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:20:30 user nova-compute[73188]: DEBUG nova.network.neutron [req-ac186c3e-d10e-42bd-8de9-9bfb32c868e0 req-4ac180d4-cb01-4241-805c-a25ce39e612e service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Refreshing network info cache for port 7bcc30ef-9465-417f-9400-3c8135ca58d2 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "9940ced5-da22-4d30-8895-a1fbe03821c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "9940ced5-da22-4d30-8895-a1fbe03821c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG nova.objects.instance [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lazy-loading 'flavor' on Instance uuid 9940ced5-da22-4d30-8895-a1fbe03821c8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:20:31 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Ignoring supplied device name: /dev/vdb
Aug 15 19:20:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "9940ced5-da22-4d30-8895-a1fbe03821c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "9940ced5-da22-4d30-8895-a1fbe03821c8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "9940ced5-da22-4d30-8895-a1fbe03821c8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:20:31 user nova-compute[73188]: INFO nova.compute.manager [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Attaching volume adccab50-964b-4c57-9995-27a54f36eda4 to /dev/vdb
Aug 15 19:20:31 user nova-compute[73188]: DEBUG nova.network.neutron [req-ac186c3e-d10e-42bd-8de9-9bfb32c868e0 req-4ac180d4-cb01-4241-805c-a25ce39e612e service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Updated VIF entry in instance network info cache for port 7bcc30ef-9465-417f-9400-3c8135ca58d2. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG nova.network.neutron [req-ac186c3e-d10e-42bd-8de9-9bfb32c868e0 req-4ac180d4-cb01-4241-805c-a25ce39e612e service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Updating instance_info_cache with network_info: [{"id": "7bcc30ef-9465-417f-9400-3c8135ca58d2", "address": "fa:16:3e:48:d8:ca", "network": {"id": "852c135b-1d66-4329-8090-3770310ffce0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1628017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72b50bc97b84e3dac8161b6a36f50ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcc30ef-94", "ovs_interfaceid": "7bcc30ef-9465-417f-9400-3c8135ca58d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ac186c3e-d10e-42bd-8de9-9bfb32c868e0 req-4ac180d4-cb01-4241-805c-a25ce39e612e service nova] Releasing lock "refresh_cache-9940ced5-da22-4d30-8895-a1fbe03821c8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG os_brick.utils [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b75d2b-d3c4-40a3-9f14-b3d7dd3c9a72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ab0c0a-97f4-40e4-972a-0706f16a0796]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c108961a-2044-4847-96cb-95da55bc4826]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabbe9a8-0f1c-431b-aad1-72ce2865062d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:20:31 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:20:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[65836e6f-0dec-4705-a65f-adc948ffb34d]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG os_brick.utils [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Updating existing volume attachment record: e8899409-1586-4b81-9781-1f48dc08f3c8 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:20:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:33 user nova-compute[73188]: INFO nova.compute.manager [None req-2ac471fa-49cc-4cda-a7ba-a6d3eb4f5ba6 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Unrescuing
Aug 15 19:20:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2ac471fa-49cc-4cda-a7ba-a6d3eb4f5ba6 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "refresh_cache-7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:20:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2ac471fa-49cc-4cda-a7ba-a6d3eb4f5ba6 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquired lock "refresh_cache-7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:20:33 user nova-compute[73188]: DEBUG nova.network.neutron [None req-2ac471fa-49cc-4cda-a7ba-a6d3eb4f5ba6 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:20:33 user nova-compute[73188]: DEBUG nova.network.neutron [None req-2ac471fa-49cc-4cda-a7ba-a6d3eb4f5ba6 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Updating instance_info_cache with network_info: [{"id": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "address": "fa:16:3e:11:3f:a6", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da073c1-08", "ovs_interfaceid": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:20:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2ac471fa-49cc-4cda-a7ba-a6d3eb4f5ba6 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Releasing lock "refresh_cache-7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:20:33 user nova-compute[73188]: DEBUG nova.objects.instance [None req-2ac471fa-49cc-4cda-a7ba-a6d3eb4f5ba6 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'flavor' on Instance uuid 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:20:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:34 user nova-compute[73188]: DEBUG nova.compute.manager [req-5743d75e-1045-4196-aa1d-201d34ffcc96 req-f20fbf90-01b6-491c-9e89-73924a0c0a04 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received event network-vif-unplugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:20:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5743d75e-1045-4196-aa1d-201d34ffcc96 req-f20fbf90-01b6-491c-9e89-73924a0c0a04 service nova] Acquiring lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:20:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5743d75e-1045-4196-aa1d-201d34ffcc96 req-f20fbf90-01b6-491c-9e89-73924a0c0a04 service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:20:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-5743d75e-1045-4196-aa1d-201d34ffcc96 req-f20fbf90-01b6-491c-9e89-73924a0c0a04 service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:20:34 user nova-compute[73188]: DEBUG nova.compute.manager [req-5743d75e-1045-4196-aa1d-201d34ffcc96 req-f20fbf90-01b6-491c-9e89-73924a0c0a04 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] No waiting events found dispatching network-vif-unplugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:20:34 user nova-compute[73188]: WARNING nova.compute.manager [req-5743d75e-1045-4196-aa1d-201d34ffcc96 req-f20fbf90-01b6-491c-9e89-73924a0c0a04 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received unexpected event network-vif-unplugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 for instance with vm_state rescued and task_state unrescuing.
Aug 15 19:20:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:34 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:34 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Instance destroyed successfully.
Aug 15 19:20:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:36 user nova-compute[73188]: DEBUG nova.compute.manager [req-12cb7c1f-a177-4b96-b382-d3b1eaa5a5a5 req-ca32601a-0582-4a62-b772-651e7784bae2 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received event network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:20:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-12cb7c1f-a177-4b96-b382-d3b1eaa5a5a5 req-ca32601a-0582-4a62-b772-651e7784bae2 service nova] Acquiring lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:20:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-12cb7c1f-a177-4b96-b382-d3b1eaa5a5a5 req-ca32601a-0582-4a62-b772-651e7784bae2 service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:20:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-12cb7c1f-a177-4b96-b382-d3b1eaa5a5a5 req-ca32601a-0582-4a62-b772-651e7784bae2 service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:20:36 user nova-compute[73188]: DEBUG nova.compute.manager [req-12cb7c1f-a177-4b96-b382-d3b1eaa5a5a5 req-ca32601a-0582-4a62-b772-651e7784bae2 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] No waiting events found dispatching network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:20:36 user nova-compute[73188]: WARNING nova.compute.manager [req-12cb7c1f-a177-4b96-b382-d3b1eaa5a5a5 req-ca32601a-0582-4a62-b772-651e7784bae2 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received unexpected event network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 for instance with vm_state rescued and task_state unrescuing.
Aug 15 19:20:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Removed pending event for 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 due to event {{(pid=73188) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 19:20:38 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127238.1924958, 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:20:38 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] VM Resumed (Lifecycle Event)
Aug 15 19:20:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-2ac471fa-49cc-4cda-a7ba-a6d3eb4f5ba6 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:20:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:20:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:20:38 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 19:20:38 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127238.1934881, 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:20:38 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] VM Started (Lifecycle Event)
Aug 15 19:20:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:20:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:20:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-b923168e-9a46-4c89-a0a0-97109718a71c req-c187d98a-c59a-4f9c-b944-6836255c6e5f service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received event network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:20:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b923168e-9a46-4c89-a0a0-97109718a71c req-c187d98a-c59a-4f9c-b944-6836255c6e5f service nova] Acquiring lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:20:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b923168e-9a46-4c89-a0a0-97109718a71c req-c187d98a-c59a-4f9c-b944-6836255c6e5f service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:20:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b923168e-9a46-4c89-a0a0-97109718a71c req-c187d98a-c59a-4f9c-b944-6836255c6e5f service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:20:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-b923168e-9a46-4c89-a0a0-97109718a71c req-c187d98a-c59a-4f9c-b944-6836255c6e5f service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] No waiting events found dispatching network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:20:38 user nova-compute[73188]: WARNING nova.compute.manager [req-b923168e-9a46-4c89-a0a0-97109718a71c req-c187d98a-c59a-4f9c-b944-6836255c6e5f service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received unexpected event network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 for instance with vm_state active and task_state None.
Aug 15 19:20:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-b923168e-9a46-4c89-a0a0-97109718a71c req-c187d98a-c59a-4f9c-b944-6836255c6e5f service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received event network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:20:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b923168e-9a46-4c89-a0a0-97109718a71c req-c187d98a-c59a-4f9c-b944-6836255c6e5f service nova] Acquiring lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:20:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b923168e-9a46-4c89-a0a0-97109718a71c req-c187d98a-c59a-4f9c-b944-6836255c6e5f service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:20:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b923168e-9a46-4c89-a0a0-97109718a71c req-c187d98a-c59a-4f9c-b944-6836255c6e5f service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:20:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-b923168e-9a46-4c89-a0a0-97109718a71c req-c187d98a-c59a-4f9c-b944-6836255c6e5f service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] No waiting events found dispatching network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:20:38 user nova-compute[73188]: WARNING nova.compute.manager [req-b923168e-9a46-4c89-a0a0-97109718a71c req-c187d98a-c59a-4f9c-b944-6836255c6e5f service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received unexpected event network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 for instance with vm_state active and task_state None.
Aug 15 19:20:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOhFdRGD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:20:47 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:20:47 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:20:47 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f355d7ab-5796-444b-9a7e-27fca32e567e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:20:47 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[261bce65-f701-42c4-b207-eb40ac0eca95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4] added
Aug 15 19:20:47 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fd7315-59d6-4221-a210-73cf9fd1d996]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c75a26b-3277-40c9-a7e1-4b1e3bd20ff7]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zOhFdRGD {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zOhFdRGD" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8b315a-42af-42c4-9a99-c3b69fd9b7a7]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zOhFdRGD'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fb8bec-6887-46b3-a0b1-1278c041df16]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f480b6-d8c5-4991-b3c3-6e64e69e1896]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:20:47 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:20:47 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:20:47 user nova-compute[73188]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:20:47 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:20:47 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:20:47 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:20:47 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:20:47 user nova-compute[73188]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:20:47 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:20:47 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74e123e-7656-48ac-9fca-a6a2df9d2fa3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4, portal: 172.16.0.220,3260]
Aug 15 19:20:47 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4, portal: 172.16.0.220,3260] successful.
Aug 15 19:20:47 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc90f35-e2fe-4eed-8fec-b580118a6aa2]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[946a418b-3efd-4d49-a8c1-63ea76194f4a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:20:47 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:20:47 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:20:47 user nova-compute[73188]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:20:47 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:20:47 user nova-compute[73188]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)
Aug 15 19:20:47 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:20:47 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:20:47 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:20:47 user nova-compute[73188]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:20:47 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:20:47 user nova-compute[73188]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)
Aug 15 19:20:47 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] HCTL ('38', '-', '-', 0) found on session 32 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14c08f1-2bf6-49a7-a45e-691633a5840d]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Searching for a device in session 32 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:20:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOhFdRGD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:20:48 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:20:48 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23833366230373063', 'path': '/dev/sdg'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:20:48 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833366230373063', 'path': '/dev/sdg'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:20:48 user nova-compute[73188]: DEBUG nova.objects.instance [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lazy-loading 'flavor' on Instance uuid 9940ced5-da22-4d30-8895-a1fbe03821c8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:20:48 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:20:48 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:20:48 user nova-compute[73188]:   <source dev="/dev/sdg"/>
Aug 15 19:20:48 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:20:48 user nova-compute[73188]:   <serial>adccab50-964b-4c57-9995-27a54f36eda4</serial>
Aug 15 19:20:48 user nova-compute[73188]: </disk>
Aug 15 19:20:48 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:20:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:20:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:20:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] No VIF found with MAC fa:16:3e:48:d8:ca, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:20:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-38f3e9a3-380f-413f-87bc-ce670ebac351 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "9940ced5-da22-4d30-8895-a1fbe03821c8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.906s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:20:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:55 user nova-compute[73188]: DEBUG nova.compute.manager [req-f0124c1c-6fa0-486f-b247-c5a3d4aaa194 req-8d7c018b-6cfc-49a6-8ee5-ed64ec8b92cf service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received event network-changed-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:20:55 user nova-compute[73188]: DEBUG nova.compute.manager [req-f0124c1c-6fa0-486f-b247-c5a3d4aaa194 req-8d7c018b-6cfc-49a6-8ee5-ed64ec8b92cf service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Refreshing instance network info cache due to event network-changed-6225a308-7ed4-4b5e-baf9-217609c291e5. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:20:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f0124c1c-6fa0-486f-b247-c5a3d4aaa194 req-8d7c018b-6cfc-49a6-8ee5-ed64ec8b92cf service nova] Acquiring lock "refresh_cache-5c2929f0-0a13-4279-ba1a-085ffdb2cd83" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:20:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f0124c1c-6fa0-486f-b247-c5a3d4aaa194 req-8d7c018b-6cfc-49a6-8ee5-ed64ec8b92cf service nova] Acquired lock "refresh_cache-5c2929f0-0a13-4279-ba1a-085ffdb2cd83" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:20:55 user nova-compute[73188]: DEBUG nova.network.neutron [req-f0124c1c-6fa0-486f-b247-c5a3d4aaa194 req-8d7c018b-6cfc-49a6-8ee5-ed64ec8b92cf service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Refreshing network info cache for port 6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG nova.objects.instance [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'flavor' on Instance uuid 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:20:56 user nova-compute[73188]: INFO nova.compute.manager [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Attaching volume dfbcd191-af36-4608-8861-dfd9587ed764 to /dev/vdb
Aug 15 19:20:56 user nova-compute[73188]: DEBUG os_brick.utils [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0404301-ccab-462b-bec0-3a222db89845]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e28127f-b74a-4ca3-9b27-66888327b999]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f6b776-9502-4e2c-8a85-1d0bcbd11213]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e0ca55-f6fe-48d4-8b0e-ec8d907ec579]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG nova.network.neutron [req-f0124c1c-6fa0-486f-b247-c5a3d4aaa194 req-8d7c018b-6cfc-49a6-8ee5-ed64ec8b92cf service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Updated VIF entry in instance network info cache for port 6225a308-7ed4-4b5e-baf9-217609c291e5. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG nova.network.neutron [req-f0124c1c-6fa0-486f-b247-c5a3d4aaa194 req-8d7c018b-6cfc-49a6-8ee5-ed64ec8b92cf service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Updating instance_info_cache with network_info: [{"id": "6225a308-7ed4-4b5e-baf9-217609c291e5", "address": "fa:16:3e:a1:7a:2a", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6225a308-7e", "ovs_interfaceid": "6225a308-7ed4-4b5e-baf9-217609c291e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f0124c1c-6fa0-486f-b247-c5a3d4aaa194 req-8d7c018b-6cfc-49a6-8ee5-ed64ec8b92cf service nova] Releasing lock "refresh_cache-5c2929f0-0a13-4279-ba1a-085ffdb2cd83" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:20:56 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:20:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b37acad-3ce4-4c0b-99b6-bd78a8931bb3]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG os_brick.utils [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Updating existing volume attachment record: 88c119d3-e1bb-47cc-8e8d-ce474247be0a {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:20:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:20:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:04 user nova-compute[73188]: DEBUG nova.compute.manager [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:21:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:21:04 user nova-compute[73188]: INFO nova.compute.claims [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Claim successful on node user
Aug 15 19:21:05 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG nova.network.neutron [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:21:05 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:21:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:21:05 user nova-compute[73188]: INFO nova.virt.block_device [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Booting with volume a7f56af9-f1ab-443d-a7ec-63468e65fb69 at /dev/vda
Aug 15 19:21:05 user nova-compute[73188]: DEBUG nova.policy [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c30de55a2834422c8f6df816899b881e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c085a0ccf841e297d98037c07a7111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG os_brick.utils [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4a73b3-764f-4031-8931-017b93fa7615]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4810bb63-5932-4df8-8796-9efc76eab25f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b1bd75-dc02-4267-b186-d23ffd910f08]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2946559f-f934-4bee-9920-01df9ef59272]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:21:05 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:21:05 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e7685a-3bf3-440c-9c05-f965df8a456a]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG os_brick.utils [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Updating existing volume attachment record: 55109b3d-e999-4391-a4d8-bfbd8515ddd8 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:21:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:06 user nova-compute[73188]: DEBUG nova.network.neutron [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Successfully created port: 35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:21:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:07 user nova-compute[73188]: DEBUG nova.network.neutron [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Successfully updated port: 35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:21:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "refresh_cache-e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:21:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquired lock "refresh_cache-e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:21:07 user nova-compute[73188]: DEBUG nova.network.neutron [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:21:07 user nova-compute[73188]: DEBUG nova.network.neutron [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:21:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-4960445c-e9cf-4e46-a6b7-ed4b9102817f req-e2478c8c-24ad-4d1b-920f-2fb7785fa49b service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Received event network-changed-35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:21:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-4960445c-e9cf-4e46-a6b7-ed4b9102817f req-e2478c8c-24ad-4d1b-920f-2fb7785fa49b service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Refreshing instance network info cache due to event network-changed-35b20fd1-f9c9-4cd7-8744-77f418bd0428. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:21:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4960445c-e9cf-4e46-a6b7-ed4b9102817f req-e2478c8c-24ad-4d1b-920f-2fb7785fa49b service nova] Acquiring lock "refresh_cache-e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:21:07 user nova-compute[73188]: DEBUG nova.network.neutron [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Updating instance_info_cache with network_info: [{"id": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "address": "fa:16:3e:20:ae:90", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b20fd1-f9", "ovs_interfaceid": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:21:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Releasing lock "refresh_cache-e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:21:07 user nova-compute[73188]: DEBUG nova.compute.manager [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Instance network_info: |[{"id": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "address": "fa:16:3e:20:ae:90", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b20fd1-f9", "ovs_interfaceid": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:21:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4960445c-e9cf-4e46-a6b7-ed4b9102817f req-e2478c8c-24ad-4d1b-920f-2fb7785fa49b service nova] Acquired lock "refresh_cache-e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:21:07 user nova-compute[73188]: DEBUG nova.network.neutron [req-4960445c-e9cf-4e46-a6b7-ed4b9102817f req-e2478c8c-24ad-4d1b-920f-2fb7785fa49b service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Refreshing network info cache for port 35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:21:08 user nova-compute[73188]: DEBUG nova.network.neutron [req-4960445c-e9cf-4e46-a6b7-ed4b9102817f req-e2478c8c-24ad-4d1b-920f-2fb7785fa49b service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Updated VIF entry in instance network info cache for port 35b20fd1-f9c9-4cd7-8744-77f418bd0428. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:21:08 user nova-compute[73188]: DEBUG nova.network.neutron [req-4960445c-e9cf-4e46-a6b7-ed4b9102817f req-e2478c8c-24ad-4d1b-920f-2fb7785fa49b service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Updating instance_info_cache with network_info: [{"id": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "address": "fa:16:3e:20:ae:90", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b20fd1-f9", "ovs_interfaceid": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:21:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4960445c-e9cf-4e46-a6b7-ed4b9102817f req-e2478c8c-24ad-4d1b-920f-2fb7785fa49b service nova] Releasing lock "refresh_cache-e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:21:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Acquiring lock "ac47948a-9396-4c68-9662-1ad1595d096b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "ac47948a-9396-4c68-9662-1ad1595d096b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Acquiring lock "ac47948a-9396-4c68-9662-1ad1595d096b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "ac47948a-9396-4c68-9662-1ad1595d096b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "ac47948a-9396-4c68-9662-1ad1595d096b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:10 user nova-compute[73188]: INFO nova.compute.manager [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Terminating instance
Aug 15 19:21:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG nova.compute.manager [req-dcc1da9d-f8e4-40c9-9d9d-3c57926d9c63 req-e4c87ae2-14d5-48e1-8d83-79fda8faa501 service nova] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Received event network-vif-unplugged-f242734a-9f10-401a-b13d-6102ac2fb10f {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-dcc1da9d-f8e4-40c9-9d9d-3c57926d9c63 req-e4c87ae2-14d5-48e1-8d83-79fda8faa501 service nova] Acquiring lock "ac47948a-9396-4c68-9662-1ad1595d096b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-dcc1da9d-f8e4-40c9-9d9d-3c57926d9c63 req-e4c87ae2-14d5-48e1-8d83-79fda8faa501 service nova] Lock "ac47948a-9396-4c68-9662-1ad1595d096b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-dcc1da9d-f8e4-40c9-9d9d-3c57926d9c63 req-e4c87ae2-14d5-48e1-8d83-79fda8faa501 service nova] Lock "ac47948a-9396-4c68-9662-1ad1595d096b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG nova.compute.manager [req-dcc1da9d-f8e4-40c9-9d9d-3c57926d9c63 req-e4c87ae2-14d5-48e1-8d83-79fda8faa501 service nova] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] No waiting events found dispatching network-vif-unplugged-f242734a-9f10-401a-b13d-6102ac2fb10f {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG nova.compute.manager [req-dcc1da9d-f8e4-40c9-9d9d-3c57926d9c63 req-e4c87ae2-14d5-48e1-8d83-79fda8faa501 service nova] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Received event network-vif-unplugged-f242734a-9f10-401a-b13d-6102ac2fb10f for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:21:10 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Instance destroyed successfully.
Aug 15 19:21:10 user nova-compute[73188]: DEBUG nova.objects.instance [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lazy-loading 'resources' on Instance uuid ac47948a-9396-4c68-9662-1ad1595d096b {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:19:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1027311022',display_name='tempest-VolumesActionsTest-instance-1027311022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1027311022',id=32,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:19:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1cfc95d252dc44f79afe90be2f4324a6',ramdisk_id='',reservation_id='r-c4svvvc3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1468435355',owner_user_name='tempest-VolumesActionsTest-1468435355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:19:27Z,user_data=None,user_id='ffd643862c1447868d962e4315a38d13',uuid=ac47948a-9396-4c68-9662-1ad1595d096b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f242734a-9f10-401a-b13d-6102ac2fb10f", "address": "fa:16:3e:da:9b:ac", "network": {"id": "67b69ed4-0c6f-4b67-a173-2570bbb4d6d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979729543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cfc95d252dc44f79afe90be2f4324a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242734a-9f", "ovs_interfaceid": "f242734a-9f10-401a-b13d-6102ac2fb10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Converting VIF {"id": "f242734a-9f10-401a-b13d-6102ac2fb10f", "address": "fa:16:3e:da:9b:ac", "network": {"id": "67b69ed4-0c6f-4b67-a173-2570bbb4d6d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979729543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cfc95d252dc44f79afe90be2f4324a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf242734a-9f", "ovs_interfaceid": "f242734a-9f10-401a-b13d-6102ac2fb10f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:9b:ac,bridge_name='br-int',has_traffic_filtering=True,id=f242734a-9f10-401a-b13d-6102ac2fb10f,network=Network(67b69ed4-0c6f-4b67-a173-2570bbb4d6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf242734a-9f') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG os_vif [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:9b:ac,bridge_name='br-int',has_traffic_filtering=True,id=f242734a-9f10-401a-b13d-6102ac2fb10f,network=Network(67b69ed4-0c6f-4b67-a173-2570bbb4d6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf242734a-9f') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf242734a-9f, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:21:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:10 user nova-compute[73188]: INFO os_vif [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:9b:ac,bridge_name='br-int',has_traffic_filtering=True,id=f242734a-9f10-401a-b13d-6102ac2fb10f,network=Network(67b69ed4-0c6f-4b67-a173-2570bbb4d6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf242734a-9f')
Aug 15 19:21:10 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Deleting instance files /opt/stack/data/nova/instances/ac47948a-9396-4c68-9662-1ad1595d096b_del
Aug 15 19:21:11 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Deletion of /opt/stack/data/nova/instances/ac47948a-9396-4c68-9662-1ad1595d096b_del complete
Aug 15 19:21:11 user nova-compute[73188]: INFO nova.compute.manager [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 15 19:21:11 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:21:11 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:21:11 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:21:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:11 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:21:11 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Took 0.58 seconds to deallocate network for instance.
Aug 15 19:21:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-8f57b266-97ca-407f-9314-bd8223005f29 req-19207e96-3cb0-4a72-9e0a-3679f5ae9ddd service nova] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Received event network-vif-deleted-f242734a-9f10-401a-b13d-6102ac2fb10f {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:21:11 user nova-compute[73188]: INFO nova.compute.manager [req-8f57b266-97ca-407f-9314-bd8223005f29 req-19207e96-3cb0-4a72-9e0a-3679f5ae9ddd service nova] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Neutron deleted interface f242734a-9f10-401a-b13d-6102ac2fb10f; detaching it from the instance and deleting it from the info cache
Aug 15 19:21:11 user nova-compute[73188]: DEBUG nova.network.neutron [req-8f57b266-97ca-407f-9314-bd8223005f29 req-19207e96-3cb0-4a72-9e0a-3679f5ae9ddd service nova] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:21:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-8f57b266-97ca-407f-9314-bd8223005f29 req-19207e96-3cb0-4a72-9e0a-3679f5ae9ddd service nova] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Detach interface failed, port_id=f242734a-9f10-401a-b13d-6102ac2fb10f, reason: Instance ac47948a-9396-4c68-9662-1ad1595d096b could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:21:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:12 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:21:12 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:21:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:12 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Deleted allocations for instance ac47948a-9396-4c68-9662-1ad1595d096b
Aug 15 19:21:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-21279f0a-1dc4-414a-a1f3-498d1284c603 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "ac47948a-9396-4c68-9662-1ad1595d096b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.082s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:12 user nova-compute[73188]: DEBUG nova.compute.manager [req-13d26c18-ab46-40f7-8ea2-da8eb235c176 req-3f602ac8-50bc-4a73-9d62-be517ef03f28 service nova] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Received event network-vif-plugged-f242734a-9f10-401a-b13d-6102ac2fb10f {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:21:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-13d26c18-ab46-40f7-8ea2-da8eb235c176 req-3f602ac8-50bc-4a73-9d62-be517ef03f28 service nova] Acquiring lock "ac47948a-9396-4c68-9662-1ad1595d096b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-13d26c18-ab46-40f7-8ea2-da8eb235c176 req-3f602ac8-50bc-4a73-9d62-be517ef03f28 service nova] Lock "ac47948a-9396-4c68-9662-1ad1595d096b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-13d26c18-ab46-40f7-8ea2-da8eb235c176 req-3f602ac8-50bc-4a73-9d62-be517ef03f28 service nova] Lock "ac47948a-9396-4c68-9662-1ad1595d096b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:12 user nova-compute[73188]: DEBUG nova.compute.manager [req-13d26c18-ab46-40f7-8ea2-da8eb235c176 req-3f602ac8-50bc-4a73-9d62-be517ef03f28 service nova] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] No waiting events found dispatching network-vif-plugged-f242734a-9f10-401a-b13d-6102ac2fb10f {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:21:12 user nova-compute[73188]: WARNING nova.compute.manager [req-13d26c18-ab46-40f7-8ea2-da8eb235c176 req-3f602ac8-50bc-4a73-9d62-be517ef03f28 service nova] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Received unexpected event network-vif-plugged-f242734a-9f10-401a-b13d-6102ac2fb10f for instance with vm_state deleted and task_state None.
Aug 15 19:21:14 user nova-compute[73188]: DEBUG nova.objects.instance [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'flavor' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "refresh_cache-b3dd183e-7ab1-40ae-b282-40575a9e47df" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquired lock "refresh_cache-b3dd183e-7ab1-40ae-b282-40575a9e47df" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG nova.network.neutron [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG nova.objects.instance [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'info_cache' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQFLDpxf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:21:14 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:21:14 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:21:14 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8c1933-3a7d-4835-9e42-ce611e1d595c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:21:14 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c57556-b97d-4af8-bbe3-a413c2133ae4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764] added
Aug 15 19:21:14 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5e74b9-64c6-4261-847f-9c8cf7210779]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b42d5f9-21fb-4767-bac5-1c8c49a748f6]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OQFLDpxf {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OQFLDpxf" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fb6b00-db6b-4c0a-88a9-914da099605f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OQFLDpxf'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e3708b-bd76-482b-b6f6-d720eabb6298]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac222c8-a809-48bb-9024-98930d622c24]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:21:14 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:21:14 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:21:14 user nova-compute[73188]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:21:14 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:21:14 user nova-compute[73188]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)
Aug 15 19:21:14 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:21:14 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:21:14 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:21:14 user nova-compute[73188]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:21:14 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:21:14 user nova-compute[73188]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)
Aug 15 19:21:14 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97ac5dc-8dd2-4a91-9dd1-4bcd4f62f232]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764, portal: 172.16.0.220,3260]
Aug 15 19:21:14 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764, portal: 172.16.0.220,3260] successful.
Aug 15 19:21:14 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a78c02-44d9-4b3c-bd3d-d647205169b8]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG nova.network.neutron [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Updating instance_info_cache with network_info: [{"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Releasing lock "refresh_cache-b3dd183e-7ab1-40ae-b282-40575a9e47df" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[295cde68-b116-4cbd-ba50-c8d5683458ba]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:21:14 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:21:14 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:21:14 user nova-compute[73188]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:21:14 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:21:14 user nova-compute[73188]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)
Aug 15 19:21:14 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:21:14 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:21:14 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:21:14 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:21:14 user nova-compute[73188]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:21:14 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:21:14 user nova-compute[73188]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)
Aug 15 19:21:14 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:21:14 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] HCTL ('39', '-', '-', 0) found on session 33 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:14 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Instance destroyed successfully.
Aug 15 19:21:14 user nova-compute[73188]: DEBUG nova.objects.instance [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'resources' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[26de68ed-834e-4dbd-b4d7-0580b95db034]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Searching for a device in session 33 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQFLDpxf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-10055614',display_name='tempest-AttachVolumeTestJSON-server-10055614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-10055614',id=28,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMQScQjuREEUf8BduiZ5KX0osvQ5QWZEC23alXhUk4mA8l8fA2zn02jcheLrGtQU0hVs1wuTRm/gfQIlRP/+vodTg9/qG3oTDrK2DQcQ9kCcFR8/YFg4QfP/P5iwNCjNg==',key_name='tempest-keypair-229082612',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:17:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='399c3c31298f41dbb11ae1c0bc593e1f',ramdisk_id='',reservation_id='r-jd0udn2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-953696987',owner_user_name='tempest-AttachVolumeTestJSON-953696987-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:19:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae5b2b05980944af80c4ffe09cd20de1',uuid=b3dd183e-7ab1-40ae-b282-40575a9e47df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converting VIF {"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:98,bridge_name='br-int',has_traffic_filtering=True,id=0546e618-e785-46c7-aa82-d527ec295deb,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0546e618-e7') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_vif [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:98,bridge_name='br-int',has_traffic_filtering=True,id=0546e618-e785-46c7-aa82-d527ec295deb,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0546e618-e7') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0546e618-e7, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:21:14 user nova-compute[73188]: INFO os_vif [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:98,bridge_name='br-int',has_traffic_filtering=True,id=0546e618-e785-46c7-aa82-d527ec295deb,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0546e618-e7')
Aug 15 19:21:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpyxgIPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:21:14 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:21:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23464356165666337', 'path': '/dev/sdh'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464356165666337', 'path': '/dev/sdh'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.974s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG nova.objects.instance [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'flavor' on Instance uuid 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3003e4-850b-4b76-92dd-22e65e3a1f19]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:21:15 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:21:15 user nova-compute[73188]:   <source dev="/dev/sdh"/>
Aug 15 19:21:15 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:21:15 user nova-compute[73188]:   <serial>dfbcd191-af36-4608-8861-dfd9587ed764</serial>
Aug 15 19:21:15 user nova-compute[73188]: </disk>
Aug 15 19:21:15 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed028f4-3b5f-495a-a269-dcfb104795c9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:21:15 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:21:15 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:21:15 user nova-compute[73188]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:21:15 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:21:15 user nova-compute[73188]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)
Aug 15 19:21:15 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:21:15 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:21:15 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:21:15 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:21:15 user nova-compute[73188]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:21:15 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:21:15 user nova-compute[73188]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)
Aug 15 19:21:15 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:21:15 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e47101f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab'): ({'sde'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Removing single pathed devices sde {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da11086-6a79-43d2-8704-7a2bfacedba9]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a78e90-f4df-43d8-a977-03d82c867d40]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Flushing IO for device /dev/sde {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd45cf6-7e14-469d-abba-274f62e48425]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:21:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[439721e3-5e7a-4d3b-b2f5-f12d8e352cb4]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] SCSI volumes sde have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5ffb38-8c20-46e4-bd3b-4bc35f0af997]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ec7bcb-5fe4-4b2a-95c4-295fdaf066bf]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab, portal: 172.16.0.220,3260]
Aug 15 19:21:16 user nova-compute[73188]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab, portal: 172.16.0.220,3260] successful.
Aug 15 19:21:16 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[346129d9-fa98-42fc-9b26-504f68ea9cc8]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] <== disconnect_volume: return (1315ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Start _get_guest_xml network_info=[{"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpyxgIPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'b3dd183e-7ab1-40ae-b282-40575a9e47df', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3f95f50-bd8d-4060-84ed-1f597c7a09ab', 'serial': 'b3f95f50-bd8d-4060-84ed-1f597c7a09ab'}, 'attachment_id': '536bf913-fcb8-4e67-bddc-45e7ca3dfd2b', 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.objects.instance [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'numa_topology' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:21:16 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:21:16 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.objects.instance [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'vcpu_model' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpyxgIPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:21:16 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:21:16 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:21:16 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f809a22-d3be-44e7-9381-b79337d878e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:21:16 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] No VIF found with MAC fa:16:3e:a1:7a:2a, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[187b23c3-e927-4758-b8d9-8650ab77f17e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab] added
Aug 15 19:21:16 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e7fd69-b467-4b8a-b679-f643e42a013e]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[944fcfc9-9a7d-48d5-bcd6-cfaae6c3d275]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpyxgIPu {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpyxgIPu" returned: 0 in 0.030s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6eb090-d422-460f-9865-b7d5706261b8]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HpyxgIPu'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd012df8-952c-4af5-a601-4eae174677c7]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a8166dfe-55d4-4f19-bf5f-47687c340cb6 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.263s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.compute.manager [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:21:16 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Creating image(s)
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Did not create local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Ensure instance console log exists: /opt/stack/data/nova/instances/e0d0b28d-602f-47dd-a798-2d9c54b1a2c7/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Start _get_guest_xml network_info=[{"id": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "address": "fa:16:3e:20:ae:90", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b20fd1-f9", "ovs_interfaceid": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RbgQdsPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e0d0b28d-602f-47dd-a798-2d9c54b1a2c7', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7f56af9-f1ab-443d-a7ec-63468e65fb69', 'serial': 'a7f56af9-f1ab-443d-a7ec-63468e65fb69'}, 'attachment_id': '55109b3d-e999-4391-a4d8-bfbd8515ddd8', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:21:16 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:21:16 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RbgQdsPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:21:16 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4009e183-2b6f-4d0a-bb22-eb9056ec9fc9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:21:16 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:21:16 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:21:16 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:21:16 user nova-compute[73188]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)
Aug 15 19:21:16 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:21:16 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:21:16 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:21:16 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:21:16 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:21:16 user nova-compute[73188]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)
Aug 15 19:21:16 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:21:16 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d58b90-a761-47b2-8255-45a3f2880e5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab, portal: 172.16.0.220,3260]
Aug 15 19:21:16 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab, portal: 172.16.0.220,3260] successful.
Aug 15 19:21:16 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f4b249-6614-4fff-be7a-b48345732c26]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8143e0-0c9e-4971-b141-1ec1e4bd2392]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:21:16 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:21:16 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:21:16 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:21:16 user nova-compute[73188]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)
Aug 15 19:21:16 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:21:16 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:21:16 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:21:16 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:21:16 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:21:16 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:21:16 user nova-compute[73188]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)
Aug 15 19:21:16 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:21:16 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:21:16 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac51f6ab-077e-4c9a-ac3b-4a860d6a05a9]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: None {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:21:16 user nova-compute[73188]: INFO nova.compute.manager [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Rescuing
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "refresh_cache-5c2929f0-0a13-4279-ba1a-085ffdb2cd83" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquired lock "refresh_cache-5c2929f0-0a13-4279-ba1a-085ffdb2cd83" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:21:16 user nova-compute[73188]: DEBUG nova.network.neutron [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG nova.network.neutron [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Updating instance_info_cache with network_info: [{"id": "6225a308-7ed4-4b5e-baf9-217609c291e5", "address": "fa:16:3e:a1:7a:2a", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6225a308-7e", "ovs_interfaceid": "6225a308-7ed4-4b5e-baf9-217609c291e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Releasing lock "refresh_cache-5c2929f0-0a13-4279-ba1a-085ffdb2cd83" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpyxgIPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '26338333339666166', 'path': '/dev/sde'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338333339666166', 'path': '/dev/sde'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.171s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:21:17 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:21:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:21:17 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc8ac8e-3213-4afe-b622-9b5a0f049395]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:21:17 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-10055614',display_name='tempest-AttachVolumeTestJSON-server-10055614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-10055614',id=28,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMQScQjuREEUf8BduiZ5KX0osvQ5QWZEC23alXhUk4mA8l8fA2zn02jcheLrGtQU0hVs1wuTRm/gfQIlRP/+vodTg9/qG3oTDrK2DQcQ9kCcFR8/YFg4QfP/P5iwNCjNg==',key_name='tempest-keypair-229082612',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:17:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='399c3c31298f41dbb11ae1c0bc593e1f',ramdisk_id='',reservation_id='r-jd0udn2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-953696987',owner_user_name='tempest-AttachVolumeTestJSON-953696987-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:19:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae5b2b05980944af80c4ffe09cd20de1',uuid=b3dd183e-7ab1-40ae-b282-40575a9e47df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converting VIF {"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:98,bridge_name='br-int',has_traffic_filtering=True,id=0546e618-e785-46c7-aa82-d527ec295deb,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0546e618-e7') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG nova.objects.instance [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'pci_devices' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:21:17 user nova-compute[73188]:   <uuid>b3dd183e-7ab1-40ae-b282-40575a9e47df</uuid>
Aug 15 19:21:17 user nova-compute[73188]:   <name>instance-0000001c</name>
Aug 15 19:21:17 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:21:17 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:21:17 user nova-compute[73188]:   <metadata>
Aug 15 19:21:17 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:21:17 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:21:17 user nova-compute[73188]:       <nova:name>tempest-AttachVolumeTestJSON-server-10055614</nova:name>
Aug 15 19:21:17 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:21:16</nova:creationTime>
Aug 15 19:21:17 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:21:17 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:21:17 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:21:17 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:21:17 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:21:17 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:21:17 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:21:17 user nova-compute[73188]:       <nova:owner>
Aug 15 19:21:17 user nova-compute[73188]:         <nova:user uuid="ae5b2b05980944af80c4ffe09cd20de1">tempest-AttachVolumeTestJSON-953696987-project-member</nova:user>
Aug 15 19:21:17 user nova-compute[73188]:         <nova:project uuid="399c3c31298f41dbb11ae1c0bc593e1f">tempest-AttachVolumeTestJSON-953696987</nova:project>
Aug 15 19:21:17 user nova-compute[73188]:       </nova:owner>
Aug 15 19:21:17 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:21:17 user nova-compute[73188]:       <nova:ports>
Aug 15 19:21:17 user nova-compute[73188]:         <nova:port uuid="0546e618-e785-46c7-aa82-d527ec295deb">
Aug 15 19:21:17 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 19:21:17 user nova-compute[73188]:         </nova:port>
Aug 15 19:21:17 user nova-compute[73188]:       </nova:ports>
Aug 15 19:21:17 user nova-compute[73188]:     </nova:instance>
Aug 15 19:21:17 user nova-compute[73188]:   </metadata>
Aug 15 19:21:17 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:21:17 user nova-compute[73188]:     <system>
Aug 15 19:21:17 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:21:17 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:21:17 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:21:17 user nova-compute[73188]:       <entry name="serial">b3dd183e-7ab1-40ae-b282-40575a9e47df</entry>
Aug 15 19:21:17 user nova-compute[73188]:       <entry name="uuid">b3dd183e-7ab1-40ae-b282-40575a9e47df</entry>
Aug 15 19:21:17 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:21:17 user nova-compute[73188]:     </system>
Aug 15 19:21:17 user nova-compute[73188]:   </sysinfo>
Aug 15 19:21:17 user nova-compute[73188]:   <os>
Aug 15 19:21:17 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:21:17 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:21:17 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:21:17 user nova-compute[73188]:   </os>
Aug 15 19:21:17 user nova-compute[73188]:   <features>
Aug 15 19:21:17 user nova-compute[73188]:     <acpi/>
Aug 15 19:21:17 user nova-compute[73188]:     <apic/>
Aug 15 19:21:17 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:21:17 user nova-compute[73188]:   </features>
Aug 15 19:21:17 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:21:17 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:21:17 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:21:17 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:21:17 user nova-compute[73188]:   </clock>
Aug 15 19:21:17 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:21:17 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:21:17 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:21:17 user nova-compute[73188]:   </cpu>
Aug 15 19:21:17 user nova-compute[73188]:   <devices>
Aug 15 19:21:17 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:21:17 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:21:17 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk"/>
Aug 15 19:21:17 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:21:17 user nova-compute[73188]:     </disk>
Aug 15 19:21:17 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:21:17 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:21:17 user nova-compute[73188]:       <source dev="/dev/sde"/>
Aug 15 19:21:17 user nova-compute[73188]:       <target dev="vdb" bus="virtio"/>
Aug 15 19:21:17 user nova-compute[73188]:       <serial>b3f95f50-bd8d-4060-84ed-1f597c7a09ab</serial>
Aug 15 19:21:17 user nova-compute[73188]:     </disk>
Aug 15 19:21:17 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:21:17 user nova-compute[73188]:       <mac address="fa:16:3e:d9:51:98"/>
Aug 15 19:21:17 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:21:17 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:21:17 user nova-compute[73188]:       <target dev="tap0546e618-e7"/>
Aug 15 19:21:17 user nova-compute[73188]:     </interface>
Aug 15 19:21:17 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:21:17 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/console.log" append="off"/>
Aug 15 19:21:17 user nova-compute[73188]:     </serial>
Aug 15 19:21:17 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:21:17 user nova-compute[73188]:     <video>
Aug 15 19:21:17 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:21:17 user nova-compute[73188]:     </video>
Aug 15 19:21:17 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:21:17 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:21:17 user nova-compute[73188]:     </rng>
Aug 15 19:21:17 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:21:17 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:21:17 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:21:17 user nova-compute[73188]:     </memballoon>
Aug 15 19:21:17 user nova-compute[73188]:   </devices>
Aug 15 19:21:17 user nova-compute[73188]: </domain>
Aug 15 19:21:17 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a02743-63d3-49f2-a54d-c595b75c74f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69] added
Aug 15 19:21:17 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1a4a56-7039-4a6b-8351-12520870db36]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0bd158-fd3a-4fe3-a67b-31a3a2d5541e]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RbgQdsPB {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RbgQdsPB" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[75da18a1-82e2-45fd-a080-0f7c5c1a6a1c]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RbgQdsPB'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-c412e7d5-138e-466d-a430-f7ddb81cb226 req-3cfc9544-5780-4829-be0f-1365f16e4432 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received event network-vif-unplugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c412e7d5-138e-466d-a430-f7ddb81cb226 req-3cfc9544-5780-4829-be0f-1365f16e4432 service nova] Acquiring lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c412e7d5-138e-466d-a430-f7ddb81cb226 req-3cfc9544-5780-4829-be0f-1365f16e4432 service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c412e7d5-138e-466d-a430-f7ddb81cb226 req-3cfc9544-5780-4829-be0f-1365f16e4432 service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-c412e7d5-138e-466d-a430-f7ddb81cb226 req-3cfc9544-5780-4829-be0f-1365f16e4432 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] No waiting events found dispatching network-vif-unplugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:21:17 user nova-compute[73188]: WARNING nova.compute.manager [req-c412e7d5-138e-466d-a430-f7ddb81cb226 req-3cfc9544-5780-4829-be0f-1365f16e4432 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received unexpected event network-vif-unplugged-6225a308-7ed4-4b5e-baf9-217609c291e5 for instance with vm_state active and task_state rescuing.
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17c68d4-8466-438d-b880-6677900875de]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f92623-028a-485d-9dbf-efb136b51e58]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:21:17 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:21:17 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:21:17 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:21:17 user nova-compute[73188]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)
Aug 15 19:21:17 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:21:17 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:21:17 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:21:17 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:21:17 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:21:17 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:21:17 user nova-compute[73188]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)
Aug 15 19:21:17 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:21:17 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:21:17 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.objects.instance [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'trusted_certs' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.185s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:18 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Instance destroyed successfully.
Aug 15 19:21:18 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Attempting rescue
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73188) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Instance directory exists: not creating {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 19:21:18 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Creating image(s)
Aug 15 19:21:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "/opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "/opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.objects.instance [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Cannot resize image /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.objects.instance [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'migration_context' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-10055614',display_name='tempest-AttachVolumeTestJSON-server-10055614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-10055614',id=28,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMQScQjuREEUf8BduiZ5KX0osvQ5QWZEC23alXhUk4mA8l8fA2zn02jcheLrGtQU0hVs1wuTRm/gfQIlRP/+vodTg9/qG3oTDrK2DQcQ9kCcFR8/YFg4QfP/P5iwNCjNg==',key_name='tempest-keypair-229082612',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:17:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='399c3c31298f41dbb11ae1c0bc593e1f',ramdisk_id='',reservation_id='r-jd0udn2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-953696987',owner_user_name='tempest-AttachVolumeTestJSON-953696987-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:19:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae5b2b05980944af80c4ffe09cd20de1',uuid=b3dd183e-7ab1-40ae-b282-40575a9e47df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converting VIF {"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:98,bridge_name='br-int',has_traffic_filtering=True,id=0546e618-e785-46c7-aa82-d527ec295deb,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0546e618-e7') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG os_vif [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:98,bridge_name='br-int',has_traffic_filtering=True,id=0546e618-e785-46c7-aa82-d527ec295deb,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0546e618-e7') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0546e618-e7, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0546e618-e7, col_values=(('external_ids', {'iface-id': '0546e618-e785-46c7-aa82-d527ec295deb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:51:98', 'vm-uuid': 'b3dd183e-7ab1-40ae-b282-40575a9e47df'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:18 user nova-compute[73188]: INFO os_vif [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:98,bridge_name='br-int',has_traffic_filtering=True,id=0546e618-e785-46c7-aa82-d527ec295deb,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0546e618-e7')
Aug 15 19:21:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk.rescue {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk.rescue" returned: 0 in 0.049s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.objects.instance [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'migration_context' on Instance uuid 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Start _get_guest_xml network_info=[{"id": "6225a308-7ed4-4b5e-baf9-217609c291e5", "address": "fa:16:3e:a1:7a:2a", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "vif_mac": "fa:16:3e:a1:7a:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6225a308-7e", "ovs_interfaceid": "6225a308-7ed4-4b5e-baf9-217609c291e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.objects.instance [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'resources' on Instance uuid 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.objects.instance [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'numa_topology' on Instance uuid 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:21:18 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:21:18 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.objects.instance [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1041831059',display_name='tempest-ServerRescueNegativeTestJSON-server-1041831059',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1041831059',id=31,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEq2iQ1h4jzBjE0atv0a4mo1L4j66QLfP7MxRxkxH1Yw8sM5jKyasNf48oOhELPjdXUEvOx3hNYXDkucV1CUoRmiVobninOEOJkdc8lPhCPKnn/KUBn7RaKi3Y4oHf1Lrw==',key_name='tempest-keypair-1377831358',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:19:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eeb950591a3349908b17b33c0ebca302',ramdisk_id='',reservation_id='r-wmo5f3m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-990996828',owner_user_name='tempest-ServerRescueNegativeTestJSON-990996828-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88c0edd2a58744da9497d7c5164f22a2',uuid=5c2929f0-0a13-4279-ba1a-085ffdb2cd83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6225a308-7ed4-4b5e-baf9-217609c291e5", "address": "fa:16:3e:a1:7a:2a", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "vif_mac": "fa:16:3e:a1:7a:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6225a308-7e", "ovs_interfaceid": "6225a308-7ed4-4b5e-baf9-217609c291e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converting VIF {"id": "6225a308-7ed4-4b5e-baf9-217609c291e5", "address": "fa:16:3e:a1:7a:2a", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "vif_mac": "fa:16:3e:a1:7a:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6225a308-7e", "ovs_interfaceid": "6225a308-7ed4-4b5e-baf9-217609c291e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:7a:2a,bridge_name='br-int',has_traffic_filtering=True,id=6225a308-7ed4-4b5e-baf9-217609c291e5,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6225a308-7e') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.objects.instance [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:21:18 user nova-compute[73188]:   <uuid>5c2929f0-0a13-4279-ba1a-085ffdb2cd83</uuid>
Aug 15 19:21:18 user nova-compute[73188]:   <name>instance-0000001f</name>
Aug 15 19:21:18 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:21:18 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:21:18 user nova-compute[73188]:   <metadata>
Aug 15 19:21:18 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:21:18 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:21:18 user nova-compute[73188]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1041831059</nova:name>
Aug 15 19:21:18 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:21:18</nova:creationTime>
Aug 15 19:21:18 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:21:18 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:21:18 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:21:18 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:21:18 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:21:18 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:21:18 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:21:18 user nova-compute[73188]:       <nova:owner>
Aug 15 19:21:18 user nova-compute[73188]:         <nova:user uuid="88c0edd2a58744da9497d7c5164f22a2">tempest-ServerRescueNegativeTestJSON-990996828-project-member</nova:user>
Aug 15 19:21:18 user nova-compute[73188]:         <nova:project uuid="eeb950591a3349908b17b33c0ebca302">tempest-ServerRescueNegativeTestJSON-990996828</nova:project>
Aug 15 19:21:18 user nova-compute[73188]:       </nova:owner>
Aug 15 19:21:18 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:21:18 user nova-compute[73188]:       <nova:ports>
Aug 15 19:21:18 user nova-compute[73188]:         <nova:port uuid="6225a308-7ed4-4b5e-baf9-217609c291e5">
Aug 15 19:21:18 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 19:21:18 user nova-compute[73188]:         </nova:port>
Aug 15 19:21:18 user nova-compute[73188]:       </nova:ports>
Aug 15 19:21:18 user nova-compute[73188]:     </nova:instance>
Aug 15 19:21:18 user nova-compute[73188]:   </metadata>
Aug 15 19:21:18 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:21:18 user nova-compute[73188]:     <system>
Aug 15 19:21:18 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:21:18 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:21:18 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:21:18 user nova-compute[73188]:       <entry name="serial">5c2929f0-0a13-4279-ba1a-085ffdb2cd83</entry>
Aug 15 19:21:18 user nova-compute[73188]:       <entry name="uuid">5c2929f0-0a13-4279-ba1a-085ffdb2cd83</entry>
Aug 15 19:21:18 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:21:18 user nova-compute[73188]:     </system>
Aug 15 19:21:18 user nova-compute[73188]:   </sysinfo>
Aug 15 19:21:18 user nova-compute[73188]:   <os>
Aug 15 19:21:18 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:21:18 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:21:18 user nova-compute[73188]:   </os>
Aug 15 19:21:18 user nova-compute[73188]:   <features>
Aug 15 19:21:18 user nova-compute[73188]:     <acpi/>
Aug 15 19:21:18 user nova-compute[73188]:     <apic/>
Aug 15 19:21:18 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:21:18 user nova-compute[73188]:   </features>
Aug 15 19:21:18 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:21:18 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:21:18 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:21:18 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:21:18 user nova-compute[73188]:   </clock>
Aug 15 19:21:18 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:21:18 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:21:18 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:21:18 user nova-compute[73188]:   </cpu>
Aug 15 19:21:18 user nova-compute[73188]:   <devices>
Aug 15 19:21:18 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:21:18 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:21:18 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk.rescue"/>
Aug 15 19:21:18 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:21:18 user nova-compute[73188]:     </disk>
Aug 15 19:21:18 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:21:18 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:21:18 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk"/>
Aug 15 19:21:18 user nova-compute[73188]:       <target dev="vdb" bus="virtio"/>
Aug 15 19:21:18 user nova-compute[73188]:     </disk>
Aug 15 19:21:18 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:21:18 user nova-compute[73188]:       <mac address="fa:16:3e:a1:7a:2a"/>
Aug 15 19:21:18 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:21:18 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:21:18 user nova-compute[73188]:       <target dev="tap6225a308-7e"/>
Aug 15 19:21:18 user nova-compute[73188]:     </interface>
Aug 15 19:21:18 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:21:18 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/console.log" append="off"/>
Aug 15 19:21:18 user nova-compute[73188]:     </serial>
Aug 15 19:21:18 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:21:18 user nova-compute[73188]:     <video>
Aug 15 19:21:18 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:21:18 user nova-compute[73188]:     </video>
Aug 15 19:21:18 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:21:18 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:21:18 user nova-compute[73188]:     </rng>
Aug 15 19:21:18 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:21:18 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:21:18 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:21:18 user nova-compute[73188]:     </memballoon>
Aug 15 19:21:18 user nova-compute[73188]:   </devices>
Aug 15 19:21:18 user nova-compute[73188]: </domain>
Aug 15 19:21:18 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:21:18 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Instance destroyed successfully.
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:21:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] No VIF found with MAC fa:16:3e:a1:7a:2a, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --login" returned: 0 in 1.093s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f755af9-ae3c-4c50-9e6b-bb1834ae8aad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69, portal: 172.16.0.220,3260]
Aug 15 19:21:19 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69, portal: 172.16.0.220,3260] successful.
Aug 15 19:21:19 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28186db-328b-411c-93bf-44fdb234d393]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c304e3ce-da81-4a70-91ad-ef36033d68e2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:21:19 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:21:19 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:21:19 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:21:19 user nova-compute[73188]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)
Aug 15 19:21:19 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:21:19 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:21:19 user nova-compute[73188]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:21:19 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:21:19 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:21:19 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:21:19 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:21:19 user nova-compute[73188]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)
Aug 15 19:21:19 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:21:19 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:21:19 user nova-compute[73188]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:21:19 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.387s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] HCTL ('40', '-', '-', 0) found on session 35 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fb7fed-f94e-4bc5-91c7-c29aae32b089]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Searching for a device in session 35 and hctl ['40', '*', '*', 0] yield: None {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG nova.compute.manager [req-0f99a750-76f6-4125-ae1d-2383b35df010 req-e60c4fa4-8644-44c4-9ec4-5d4365b43b69 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received event network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0f99a750-76f6-4125-ae1d-2383b35df010 req-e60c4fa4-8644-44c4-9ec4-5d4365b43b69 service nova] Acquiring lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0f99a750-76f6-4125-ae1d-2383b35df010 req-e60c4fa4-8644-44c4-9ec4-5d4365b43b69 service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0f99a750-76f6-4125-ae1d-2383b35df010 req-e60c4fa4-8644-44c4-9ec4-5d4365b43b69 service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:19 user nova-compute[73188]: DEBUG nova.compute.manager [req-0f99a750-76f6-4125-ae1d-2383b35df010 req-e60c4fa4-8644-44c4-9ec4-5d4365b43b69 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] No waiting events found dispatching network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:21:19 user nova-compute[73188]: WARNING nova.compute.manager [req-0f99a750-76f6-4125-ae1d-2383b35df010 req-e60c4fa4-8644-44c4-9ec4-5d4365b43b69 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received unexpected event network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 for instance with vm_state active and task_state rescuing.
Aug 15 19:21:20 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Searching for a device in session 35 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RbgQdsPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.419s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] <== connect_volume: return (3590ms) {'type': 'block', 'scsi_wwn': '26233393130643639', 'path': '/dev/sdi'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233393130643639', 'path': '/dev/sdi'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1831045405',display_name='tempest-ServerActionsTestOtherA-server-1831045405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1831045405',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIh7IYSXIzW76yUh0lcXYRIDkLihwOuaxeqKxDoqlHxog01X1wGWUVb+WSkm+7EoRfQvo2EKI4l4BqBnCc2BP7hJFNq/yIn4BoRVp0zONEwe3FPB6tn+4jOCYVx7bU/R3g==',key_name='tempest-keypair-1497630278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c085a0ccf841e297d98037c07a7111',ramdisk_id='',reservation_id='r-gn04qlii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2026424764',owner_user_name='tempest-ServerActionsTestOtherA-2026424764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:21:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30de55a2834422c8f6df816899b881e',uuid=e0d0b28d-602f-47dd-a798-2d9c54b1a2c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "address": "fa:16:3e:20:ae:90", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b20fd1-f9", "ovs_interfaceid": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converting VIF {"id": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "address": "fa:16:3e:20:ae:90", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b20fd1-f9", "ovs_interfaceid": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:ae:90,bridge_name='br-int',has_traffic_filtering=True,id=35b20fd1-f9c9-4cd7-8744-77f418bd0428,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35b20fd1-f9') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG nova.objects.instance [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'pci_devices' on Instance uuid e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:21:20 user nova-compute[73188]:   <uuid>e0d0b28d-602f-47dd-a798-2d9c54b1a2c7</uuid>
Aug 15 19:21:20 user nova-compute[73188]:   <name>instance-00000023</name>
Aug 15 19:21:20 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:21:20 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:21:20 user nova-compute[73188]:   <metadata>
Aug 15 19:21:20 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:21:20 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:21:20 user nova-compute[73188]:       <nova:name>tempest-ServerActionsTestOtherA-server-1831045405</nova:name>
Aug 15 19:21:20 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:21:16</nova:creationTime>
Aug 15 19:21:20 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:21:20 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:21:20 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:21:20 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:21:20 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:21:20 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:21:20 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:21:20 user nova-compute[73188]:       <nova:owner>
Aug 15 19:21:20 user nova-compute[73188]:         <nova:user uuid="c30de55a2834422c8f6df816899b881e">tempest-ServerActionsTestOtherA-2026424764-project-member</nova:user>
Aug 15 19:21:20 user nova-compute[73188]:         <nova:project uuid="a3c085a0ccf841e297d98037c07a7111">tempest-ServerActionsTestOtherA-2026424764</nova:project>
Aug 15 19:21:20 user nova-compute[73188]:       </nova:owner>
Aug 15 19:21:20 user nova-compute[73188]:       <nova:ports>
Aug 15 19:21:20 user nova-compute[73188]:         <nova:port uuid="35b20fd1-f9c9-4cd7-8744-77f418bd0428">
Aug 15 19:21:20 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 19:21:20 user nova-compute[73188]:         </nova:port>
Aug 15 19:21:20 user nova-compute[73188]:       </nova:ports>
Aug 15 19:21:20 user nova-compute[73188]:     </nova:instance>
Aug 15 19:21:20 user nova-compute[73188]:   </metadata>
Aug 15 19:21:20 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:21:20 user nova-compute[73188]:     <system>
Aug 15 19:21:20 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:21:20 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:21:20 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:21:20 user nova-compute[73188]:       <entry name="serial">e0d0b28d-602f-47dd-a798-2d9c54b1a2c7</entry>
Aug 15 19:21:20 user nova-compute[73188]:       <entry name="uuid">e0d0b28d-602f-47dd-a798-2d9c54b1a2c7</entry>
Aug 15 19:21:20 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:21:20 user nova-compute[73188]:     </system>
Aug 15 19:21:20 user nova-compute[73188]:   </sysinfo>
Aug 15 19:21:20 user nova-compute[73188]:   <os>
Aug 15 19:21:20 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:21:20 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:21:20 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:21:20 user nova-compute[73188]:   </os>
Aug 15 19:21:20 user nova-compute[73188]:   <features>
Aug 15 19:21:20 user nova-compute[73188]:     <acpi/>
Aug 15 19:21:20 user nova-compute[73188]:     <apic/>
Aug 15 19:21:20 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:21:20 user nova-compute[73188]:   </features>
Aug 15 19:21:20 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:21:20 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:21:20 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:21:20 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:21:20 user nova-compute[73188]:   </clock>
Aug 15 19:21:20 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:21:20 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:21:20 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:21:20 user nova-compute[73188]:   </cpu>
Aug 15 19:21:20 user nova-compute[73188]:   <devices>
Aug 15 19:21:20 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:21:20 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:21:20 user nova-compute[73188]:       <source dev="/dev/sdi"/>
Aug 15 19:21:20 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:21:20 user nova-compute[73188]:       <serial>a7f56af9-f1ab-443d-a7ec-63468e65fb69</serial>
Aug 15 19:21:20 user nova-compute[73188]:     </disk>
Aug 15 19:21:20 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:21:20 user nova-compute[73188]:       <mac address="fa:16:3e:20:ae:90"/>
Aug 15 19:21:20 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:21:20 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:21:20 user nova-compute[73188]:       <target dev="tap35b20fd1-f9"/>
Aug 15 19:21:20 user nova-compute[73188]:     </interface>
Aug 15 19:21:20 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:21:20 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/e0d0b28d-602f-47dd-a798-2d9c54b1a2c7/console.log" append="off"/>
Aug 15 19:21:20 user nova-compute[73188]:     </serial>
Aug 15 19:21:20 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:21:20 user nova-compute[73188]:     <video>
Aug 15 19:21:20 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:21:20 user nova-compute[73188]:     </video>
Aug 15 19:21:20 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:21:20 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:21:20 user nova-compute[73188]:     </rng>
Aug 15 19:21:20 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:21:20 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:21:20 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:21:20 user nova-compute[73188]:     </memballoon>
Aug 15 19:21:20 user nova-compute[73188]:   </devices>
Aug 15 19:21:20 user nova-compute[73188]: </domain>
Aug 15 19:21:20 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1831045405',display_name='tempest-ServerActionsTestOtherA-server-1831045405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1831045405',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIh7IYSXIzW76yUh0lcXYRIDkLihwOuaxeqKxDoqlHxog01X1wGWUVb+WSkm+7EoRfQvo2EKI4l4BqBnCc2BP7hJFNq/yIn4BoRVp0zONEwe3FPB6tn+4jOCYVx7bU/R3g==',key_name='tempest-keypair-1497630278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c085a0ccf841e297d98037c07a7111',ramdisk_id='',reservation_id='r-gn04qlii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2026424764',owner_user_name='tempest-ServerActionsTestOtherA-2026424764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:21:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30de55a2834422c8f6df816899b881e',uuid=e0d0b28d-602f-47dd-a798-2d9c54b1a2c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "address": "fa:16:3e:20:ae:90", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b20fd1-f9", "ovs_interfaceid": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converting VIF {"id": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "address": "fa:16:3e:20:ae:90", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b20fd1-f9", "ovs_interfaceid": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:ae:90,bridge_name='br-int',has_traffic_filtering=True,id=35b20fd1-f9c9-4cd7-8744-77f418bd0428,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35b20fd1-f9') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG os_vif [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:ae:90,bridge_name='br-int',has_traffic_filtering=True,id=35b20fd1-f9c9-4cd7-8744-77f418bd0428,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35b20fd1-f9') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35b20fd1-f9, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap35b20fd1-f9, col_values=(('external_ids', {'iface-id': '35b20fd1-f9c9-4cd7-8744-77f418bd0428', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:ae:90', 'vm-uuid': 'e0d0b28d-602f-47dd-a798-2d9c54b1a2c7'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:20 user nova-compute[73188]: INFO os_vif [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:ae:90,bridge_name='br-int',has_traffic_filtering=True,id=35b20fd1-f9c9-4cd7-8744-77f418bd0428,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35b20fd1-f9')
Aug 15 19:21:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:21:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] No VIF found with MAC fa:16:3e:20:ae:90, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:21:21 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:21:21 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:21:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-3d713d03-3e60-4dec-a295-a4652ac21842" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:21:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-3d713d03-3e60-4dec-a295-a4652ac21842" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:21:21 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:21:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-2b1ccd96-6089-4467-bf52-aa1aaeeb123f req-63a71b1d-a861-45fd-af6c-b154e4c7fcab service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received event network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:21:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2b1ccd96-6089-4467-bf52-aa1aaeeb123f req-63a71b1d-a861-45fd-af6c-b154e4c7fcab service nova] Acquiring lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2b1ccd96-6089-4467-bf52-aa1aaeeb123f req-63a71b1d-a861-45fd-af6c-b154e4c7fcab service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2b1ccd96-6089-4467-bf52-aa1aaeeb123f req-63a71b1d-a861-45fd-af6c-b154e4c7fcab service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-2b1ccd96-6089-4467-bf52-aa1aaeeb123f req-63a71b1d-a861-45fd-af6c-b154e4c7fcab service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] No waiting events found dispatching network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:21:22 user nova-compute[73188]: WARNING nova.compute.manager [req-2b1ccd96-6089-4467-bf52-aa1aaeeb123f req-63a71b1d-a861-45fd-af6c-b154e4c7fcab service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received unexpected event network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 for instance with vm_state active and task_state rescuing.
Aug 15 19:21:22 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Updating instance_info_cache with network_info: [{"id": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "address": "fa:16:3e:b4:8c:fd", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8c4e95-fc", "ovs_interfaceid": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:21:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-3d713d03-3e60-4dec-a295-a4652ac21842" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:21:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:21:22 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:21:22 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:21:22 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:21:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:22 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:21:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:23 user nova-compute[73188]: DEBUG nova.compute.manager [req-313e2259-2d26-45c7-a00f-7d35ed65fa48 req-ff67a3db-d2f9-4045-a776-3dd3bf6b3630 service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Received event network-vif-plugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:21:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-313e2259-2d26-45c7-a00f-7d35ed65fa48 req-ff67a3db-d2f9-4045-a776-3dd3bf6b3630 service nova] Acquiring lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-313e2259-2d26-45c7-a00f-7d35ed65fa48 req-ff67a3db-d2f9-4045-a776-3dd3bf6b3630 service nova] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-313e2259-2d26-45c7-a00f-7d35ed65fa48 req-ff67a3db-d2f9-4045-a776-3dd3bf6b3630 service nova] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:23 user nova-compute[73188]: DEBUG nova.compute.manager [req-313e2259-2d26-45c7-a00f-7d35ed65fa48 req-ff67a3db-d2f9-4045-a776-3dd3bf6b3630 service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] No waiting events found dispatching network-vif-plugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:21:23 user nova-compute[73188]: WARNING nova.compute.manager [req-313e2259-2d26-45c7-a00f-7d35ed65fa48 req-ff67a3db-d2f9-4045-a776-3dd3bf6b3630 service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Received unexpected event network-vif-plugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 for instance with vm_state building and task_state spawning.
Aug 15 19:21:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:24 user nova-compute[73188]: DEBUG nova.compute.manager [req-27ed621f-0bdc-47f3-90d9-382f77535dbe req-7d7d9a80-0b76-4c9b-a718-3fc07fb3c38b service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received event network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:21:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-27ed621f-0bdc-47f3-90d9-382f77535dbe req-7d7d9a80-0b76-4c9b-a718-3fc07fb3c38b service nova] Acquiring lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-27ed621f-0bdc-47f3-90d9-382f77535dbe req-7d7d9a80-0b76-4c9b-a718-3fc07fb3c38b service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-27ed621f-0bdc-47f3-90d9-382f77535dbe req-7d7d9a80-0b76-4c9b-a718-3fc07fb3c38b service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:24 user nova-compute[73188]: DEBUG nova.compute.manager [req-27ed621f-0bdc-47f3-90d9-382f77535dbe req-7d7d9a80-0b76-4c9b-a718-3fc07fb3c38b service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] No waiting events found dispatching network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:21:24 user nova-compute[73188]: WARNING nova.compute.manager [req-27ed621f-0bdc-47f3-90d9-382f77535dbe req-7d7d9a80-0b76-4c9b-a718-3fc07fb3c38b service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received unexpected event network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 for instance with vm_state active and task_state rescuing.
Aug 15 19:21:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [req-934800a8-2180-42fc-931e-9032a3296f82 req-f03514f9-00c4-4b46-bdc2-0a74195a0df6 service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Received event network-vif-plugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-934800a8-2180-42fc-931e-9032a3296f82 req-f03514f9-00c4-4b46-bdc2-0a74195a0df6 service nova] Acquiring lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-934800a8-2180-42fc-931e-9032a3296f82 req-f03514f9-00c4-4b46-bdc2-0a74195a0df6 service nova] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-934800a8-2180-42fc-931e-9032a3296f82 req-f03514f9-00c4-4b46-bdc2-0a74195a0df6 service nova] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [req-934800a8-2180-42fc-931e-9032a3296f82 req-f03514f9-00c4-4b46-bdc2-0a74195a0df6 service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] No waiting events found dispatching network-vif-plugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:21:25 user nova-compute[73188]: WARNING nova.compute.manager [req-934800a8-2180-42fc-931e-9032a3296f82 req-f03514f9-00c4-4b46-bdc2-0a74195a0df6 service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Received unexpected event network-vif-plugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 for instance with vm_state building and task_state spawning.
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [req-934800a8-2180-42fc-931e-9032a3296f82 req-f03514f9-00c4-4b46-bdc2-0a74195a0df6 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received event network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-934800a8-2180-42fc-931e-9032a3296f82 req-f03514f9-00c4-4b46-bdc2-0a74195a0df6 service nova] Acquiring lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-934800a8-2180-42fc-931e-9032a3296f82 req-f03514f9-00c4-4b46-bdc2-0a74195a0df6 service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-934800a8-2180-42fc-931e-9032a3296f82 req-f03514f9-00c4-4b46-bdc2-0a74195a0df6 service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [req-934800a8-2180-42fc-931e-9032a3296f82 req-f03514f9-00c4-4b46-bdc2-0a74195a0df6 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] No waiting events found dispatching network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:21:25 user nova-compute[73188]: WARNING nova.compute.manager [req-934800a8-2180-42fc-931e-9032a3296f82 req-f03514f9-00c4-4b46-bdc2-0a74195a0df6 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received unexpected event network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb for instance with vm_state stopped and task_state powering-on.
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [req-934800a8-2180-42fc-931e-9032a3296f82 req-f03514f9-00c4-4b46-bdc2-0a74195a0df6 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received event network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-934800a8-2180-42fc-931e-9032a3296f82 req-f03514f9-00c4-4b46-bdc2-0a74195a0df6 service nova] Acquiring lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-934800a8-2180-42fc-931e-9032a3296f82 req-f03514f9-00c4-4b46-bdc2-0a74195a0df6 service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-934800a8-2180-42fc-931e-9032a3296f82 req-f03514f9-00c4-4b46-bdc2-0a74195a0df6 service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [req-934800a8-2180-42fc-931e-9032a3296f82 req-f03514f9-00c4-4b46-bdc2-0a74195a0df6 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] No waiting events found dispatching network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:21:25 user nova-compute[73188]: WARNING nova.compute.manager [req-934800a8-2180-42fc-931e-9032a3296f82 req-f03514f9-00c4-4b46-bdc2-0a74195a0df6 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received unexpected event network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb for instance with vm_state stopped and task_state powering-on.
Aug 15 19:21:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Removed pending event for 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 due to event {{(pid=73188) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127285.2580369, 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:21:25 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] VM Resumed (Lifecycle Event)
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-307b6172-b365-494b-b4d0-338bd87db857 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:21:25 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127285.261479, 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:21:25 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] VM Started (Lifecycle Event)
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:21:25 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Instance spawned successfully.
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:21:25 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Instance rebooted successfully.
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-db175cd2-aa91-489c-9fa1-f21bea85aa04 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:21:25 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127285.3377194, e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:21:25 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] VM Resumed (Lifecycle Event)
Aug 15 19:21:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:25 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127285.337877, e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:21:25 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] VM Started (Lifecycle Event)
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:21:25 user nova-compute[73188]: INFO nova.compute.manager [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Took 9.06 seconds to spawn the instance on the hypervisor.
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:21:25 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127285.3559432, b3dd183e-7ab1-40ae-b282-40575a9e47df => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:21:25 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] VM Resumed (Lifecycle Event)
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127285.3562186, b3dd183e-7ab1-40ae-b282-40575a9e47df => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:21:25 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] VM Started (Lifecycle Event)
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:21:25 user nova-compute[73188]: INFO nova.compute.manager [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Took 21.01 seconds to build instance.
Aug 15 19:21:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-519dd585-a273-4e85-a20d-4837a151922c tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.137s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127270.9468791, ac47948a-9396-4c68-9662-1ad1595d096b => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:21:25 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] VM Stopped (Lifecycle Event)
Aug 15 19:21:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-7c3b0635-ac30-414b-99ce-479c801f7558 None None] [instance: ac47948a-9396-4c68-9662-1ad1595d096b] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:21:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:21:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:21:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:21:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:21:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:28 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:21:28 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:21:28 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=7125MB free_disk=25.013668060302734GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:21:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:28 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:21:28 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3d713d03-3e60-4dec-a295-a4652ac21842 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:21:28 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e00adf53-085f-436d-a09f-e97e92ca79cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:21:28 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 139ccf1c-4792-4653-9475-c61b1f9c4846 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:21:28 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 215077af-60a1-4a82-b24e-1545349363d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:21:28 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 0ee7de87-76ad-48ae-8bcd-93b2792a96cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:21:28 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:21:28 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance b3dd183e-7ab1-40ae-b282-40575a9e47df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:21:28 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 182d8fc2-0246-4164-9d1b-f970cec4dd1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:21:28 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 9940ced5-da22-4d30-8895-a1fbe03821c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:21:28 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:21:28 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 30dbb719-b373-431d-8590-7b7040fa3443 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:21:28 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance d8f302f1-7c20-483a-9eef-24566d51143d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:21:28 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:21:28 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:21:28 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:21:28 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing inventories for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 19:21:28 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Updating ProviderTree inventory for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 19:21:28 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Updating inventory in ProviderTree for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 19:21:28 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing aggregate associations for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5, aggregates: None {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 19:21:29 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing trait associations for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 19:21:29 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:21:29 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:21:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:21:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.106s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:29 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:21:29 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=73188) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 19:21:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:30 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:21:30 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:21:30 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:21:30 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:21:30 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:21:30 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:21:30 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:21:30 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Cleaning up deleted instances {{(pid=73188) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 19:21:30 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] There are 0 instances to clean {{(pid=73188) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 19:21:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "9940ced5-da22-4d30-8895-a1fbe03821c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "9940ced5-da22-4d30-8895-a1fbe03821c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:40 user nova-compute[73188]: INFO nova.compute.manager [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Detaching volume adccab50-964b-4c57-9995-27a54f36eda4
Aug 15 19:21:40 user nova-compute[73188]: INFO nova.virt.block_device [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Attempting to driver detach volume adccab50-964b-4c57-9995-27a54f36eda4 from mountpoint /dev/vdb
Aug 15 19:21:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Attempting to detach device vdb from instance 9940ced5-da22-4d30-8895-a1fbe03821c8 from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:21:40 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:21:40 user nova-compute[73188]:   <source dev="/dev/sdg"/>
Aug 15 19:21:40 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:21:40 user nova-compute[73188]:   <serial>adccab50-964b-4c57-9995-27a54f36eda4</serial>
Aug 15 19:21:40 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:21:40 user nova-compute[73188]: </disk>
Aug 15 19:21:40 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:21:40 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Successfully detached device vdb from instance 9940ced5-da22-4d30-8895-a1fbe03821c8 from the persistent domain config.
Aug 15 19:21:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9940ced5-da22-4d30-8895-a1fbe03821c8 from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:21:40 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:21:40 user nova-compute[73188]:   <source dev="/dev/sdg"/>
Aug 15 19:21:40 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:21:40 user nova-compute[73188]:   <serial>adccab50-964b-4c57-9995-27a54f36eda4</serial>
Aug 15 19:21:40 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:21:40 user nova-compute[73188]: </disk>
Aug 15 19:21:40 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "9940ced5-da22-4d30-8895-a1fbe03821c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692127300.8100467, 9940ced5-da22-4d30-8895-a1fbe03821c8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9940ced5-da22-4d30-8895-a1fbe03821c8 {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:21:40 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Successfully detached device vdb from instance 9940ced5-da22-4d30-8895-a1fbe03821c8 from the live domain config.
Aug 15 19:21:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOhFdRGD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:21:40 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:21:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ca9634-8b78-4418-b219-e11b89e63dc9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[173b3946-1d3a-4b09-9dd8-a131d25b01a0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:21:40 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:21:40 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:21:40 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:21:40 user nova-compute[73188]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)
Aug 15 19:21:40 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:21:40 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:21:40 user nova-compute[73188]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:21:40 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:21:40 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:21:40 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:21:40 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:21:40 user nova-compute[73188]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 (non-flash)
Aug 15 19:21:40 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:21:40 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:21:40 user nova-compute[73188]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:21:40 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e4713640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4'): ({'sdg'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Removing single pathed devices sdg {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b799c6-511d-49cf-acab-d5b6c0238189]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffef9c2-1e75-48af-b401-76920511bff2]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Flushing IO for device /dev/sdg {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9315161-49ef-4c51-81a4-78520a881621]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[479cf0cb-d935-4ec2-8972-3543a5f43d65]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] SCSI volumes sdg have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:21:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8283656f-d36e-4315-b634-41a92417b134]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[100e4c5c-62d9-4d83-8511-b280bf1e5afc]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4, portal: 172.16.0.220,3260]
Aug 15 19:21:41 user nova-compute[73188]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4, portal: 172.16.0.220,3260] successful.
Aug 15 19:21:41 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[30416bc3-99f9-4d58-ba87-2aab009094c6]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] <== disconnect_volume: return (318ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG nova.objects.instance [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lazy-loading 'flavor' on Instance uuid 9940ced5-da22-4d30-8895-a1fbe03821c8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-db012ac2-50bb-498d-a909-45ab7cc19e6a tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "9940ced5-da22-4d30-8895-a1fbe03821c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.666s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "9940ced5-da22-4d30-8895-a1fbe03821c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.538s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "9940ced5-da22-4d30-8895-a1fbe03821c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "9940ced5-da22-4d30-8895-a1fbe03821c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "9940ced5-da22-4d30-8895-a1fbe03821c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:41 user nova-compute[73188]: INFO nova.compute.manager [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Terminating instance
Aug 15 19:21:41 user nova-compute[73188]: DEBUG nova.compute.manager [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:21:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG nova.compute.manager [req-308f4b8c-bc44-4b11-9866-93c7e2cf6826 req-748f5c39-6b52-44cf-81f4-2c3a464669e7 service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Received event network-vif-unplugged-7bcc30ef-9465-417f-9400-3c8135ca58d2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-308f4b8c-bc44-4b11-9866-93c7e2cf6826 req-748f5c39-6b52-44cf-81f4-2c3a464669e7 service nova] Acquiring lock "9940ced5-da22-4d30-8895-a1fbe03821c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-308f4b8c-bc44-4b11-9866-93c7e2cf6826 req-748f5c39-6b52-44cf-81f4-2c3a464669e7 service nova] Lock "9940ced5-da22-4d30-8895-a1fbe03821c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-308f4b8c-bc44-4b11-9866-93c7e2cf6826 req-748f5c39-6b52-44cf-81f4-2c3a464669e7 service nova] Lock "9940ced5-da22-4d30-8895-a1fbe03821c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG nova.compute.manager [req-308f4b8c-bc44-4b11-9866-93c7e2cf6826 req-748f5c39-6b52-44cf-81f4-2c3a464669e7 service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] No waiting events found dispatching network-vif-unplugged-7bcc30ef-9465-417f-9400-3c8135ca58d2 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG nova.compute.manager [req-308f4b8c-bc44-4b11-9866-93c7e2cf6826 req-748f5c39-6b52-44cf-81f4-2c3a464669e7 service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Received event network-vif-unplugged-7bcc30ef-9465-417f-9400-3c8135ca58d2 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:21:42 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Instance destroyed successfully.
Aug 15 19:21:42 user nova-compute[73188]: DEBUG nova.objects.instance [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lazy-loading 'resources' on Instance uuid 9940ced5-da22-4d30-8895-a1fbe03821c8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-242031766',display_name='tempest-VolumesSnapshotTestJSON-instance-242031766',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-242031766',id=30,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfxj4JDnpghGORnSVuJLRN6X6hshHY6ka06lKhRqN9JRLo1kT68CrPn2Y5onzVU6oI5cAsgvpHkhcYWkd5SvqFqGgAsMgdNu2Cv7f421ik6/hJjNEVVfnOeAORpsr7KLQ==',key_name='tempest-keypair-340063242',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:18:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f72b50bc97b84e3dac8161b6a36f50ab',ramdisk_id='',reservation_id='r-cbq7h05v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-564329204',owner_user_name='tempest-VolumesSnapshotTestJSON-564329204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:18:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b8737b83c944ab2bed468f6ea5cd8ee',uuid=9940ced5-da22-4d30-8895-a1fbe03821c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bcc30ef-9465-417f-9400-3c8135ca58d2", "address": "fa:16:3e:48:d8:ca", "network": {"id": "852c135b-1d66-4329-8090-3770310ffce0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1628017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72b50bc97b84e3dac8161b6a36f50ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcc30ef-94", "ovs_interfaceid": "7bcc30ef-9465-417f-9400-3c8135ca58d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Converting VIF {"id": "7bcc30ef-9465-417f-9400-3c8135ca58d2", "address": "fa:16:3e:48:d8:ca", "network": {"id": "852c135b-1d66-4329-8090-3770310ffce0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1628017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72b50bc97b84e3dac8161b6a36f50ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcc30ef-94", "ovs_interfaceid": "7bcc30ef-9465-417f-9400-3c8135ca58d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:d8:ca,bridge_name='br-int',has_traffic_filtering=True,id=7bcc30ef-9465-417f-9400-3c8135ca58d2,network=Network(852c135b-1d66-4329-8090-3770310ffce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcc30ef-94') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG os_vif [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:d8:ca,bridge_name='br-int',has_traffic_filtering=True,id=7bcc30ef-9465-417f-9400-3c8135ca58d2,network=Network(852c135b-1d66-4329-8090-3770310ffce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcc30ef-94') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bcc30ef-94, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:42 user nova-compute[73188]: INFO os_vif [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:d8:ca,bridge_name='br-int',has_traffic_filtering=True,id=7bcc30ef-9465-417f-9400-3c8135ca58d2,network=Network(852c135b-1d66-4329-8090-3770310ffce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcc30ef-94')
Aug 15 19:21:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOhFdRGD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:21:42 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:21:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adccab50-964b-4c57-9995-27a54f36eda4', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[98741d12-ee96-4cf3-aea6-f0fdbf248b9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d21d6f-e007-44b7-a683-c3d967f8342c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:21:42 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:21:42 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:21:42 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:21:42 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:21:42 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:21:42 user nova-compute[73188]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:21:42 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:21:42 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:21:42 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:21:42 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:21:42 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:21:42 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:21:42 user nova-compute[73188]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:21:42 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e4713e20>, {}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Disconnecting from: [] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.056s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] <== disconnect_volume: return (57ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:21:42 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Deleting instance files /opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8_del
Aug 15 19:21:42 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Deletion of /opt/stack/data/nova/instances/9940ced5-da22-4d30-8895-a1fbe03821c8_del complete
Aug 15 19:21:42 user nova-compute[73188]: INFO nova.compute.manager [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 15 19:21:42 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:21:42 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "30dbb719-b373-431d-8590-7b7040fa3443" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "30dbb719-b373-431d-8590-7b7040fa3443" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "30dbb719-b373-431d-8590-7b7040fa3443-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "30dbb719-b373-431d-8590-7b7040fa3443-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "30dbb719-b373-431d-8590-7b7040fa3443-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:44 user nova-compute[73188]: INFO nova.compute.manager [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Terminating instance
Aug 15 19:21:44 user nova-compute[73188]: DEBUG nova.compute.manager [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG nova.compute.manager [req-1aaa135b-6d59-4349-a6ad-feec6c06024c req-1de01c40-378b-414c-adba-35d785779577 service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Received event network-vif-plugged-7bcc30ef-9465-417f-9400-3c8135ca58d2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1aaa135b-6d59-4349-a6ad-feec6c06024c req-1de01c40-378b-414c-adba-35d785779577 service nova] Acquiring lock "9940ced5-da22-4d30-8895-a1fbe03821c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1aaa135b-6d59-4349-a6ad-feec6c06024c req-1de01c40-378b-414c-adba-35d785779577 service nova] Lock "9940ced5-da22-4d30-8895-a1fbe03821c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1aaa135b-6d59-4349-a6ad-feec6c06024c req-1de01c40-378b-414c-adba-35d785779577 service nova] Lock "9940ced5-da22-4d30-8895-a1fbe03821c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG nova.compute.manager [req-1aaa135b-6d59-4349-a6ad-feec6c06024c req-1de01c40-378b-414c-adba-35d785779577 service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] No waiting events found dispatching network-vif-plugged-7bcc30ef-9465-417f-9400-3c8135ca58d2 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:21:44 user nova-compute[73188]: WARNING nova.compute.manager [req-1aaa135b-6d59-4349-a6ad-feec6c06024c req-1de01c40-378b-414c-adba-35d785779577 service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Received unexpected event network-vif-plugged-7bcc30ef-9465-417f-9400-3c8135ca58d2 for instance with vm_state active and task_state deleting.
Aug 15 19:21:44 user nova-compute[73188]: DEBUG nova.compute.manager [req-1aaa135b-6d59-4349-a6ad-feec6c06024c req-1de01c40-378b-414c-adba-35d785779577 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Received event network-changed-2cb25acc-8605-44c3-aa08-dfcbd3d60424 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG nova.compute.manager [req-1aaa135b-6d59-4349-a6ad-feec6c06024c req-1de01c40-378b-414c-adba-35d785779577 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Refreshing instance network info cache due to event network-changed-2cb25acc-8605-44c3-aa08-dfcbd3d60424. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1aaa135b-6d59-4349-a6ad-feec6c06024c req-1de01c40-378b-414c-adba-35d785779577 service nova] Acquiring lock "refresh_cache-30dbb719-b373-431d-8590-7b7040fa3443" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1aaa135b-6d59-4349-a6ad-feec6c06024c req-1de01c40-378b-414c-adba-35d785779577 service nova] Acquired lock "refresh_cache-30dbb719-b373-431d-8590-7b7040fa3443" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG nova.network.neutron [req-1aaa135b-6d59-4349-a6ad-feec6c06024c req-1de01c40-378b-414c-adba-35d785779577 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Refreshing network info cache for port 2cb25acc-8605-44c3-aa08-dfcbd3d60424 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:21:44 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Took 1.63 seconds to deallocate network for instance.
Aug 15 19:21:44 user nova-compute[73188]: DEBUG nova.compute.manager [req-fa939949-4d9a-43e0-80a5-300928e85bd0 req-980ac5d4-ab45-4b20-aa6d-4049b8738737 service nova] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Received event network-vif-deleted-7bcc30ef-9465-417f-9400-3c8135ca58d2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:21:44 user nova-compute[73188]: WARNING nova.volume.cinder [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Attachment e8899409-1586-4b81-9781-1f48dc08f3c8 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e8899409-1586-4b81-9781-1f48dc08f3c8. (HTTP 404) (Request-ID: req-a46562e5-ef39-478a-92ca-363dc00a8928)
Aug 15 19:21:44 user nova-compute[73188]: INFO nova.compute.manager [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Took 0.03 seconds to detach 1 volumes for instance.
Aug 15 19:21:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:44 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Instance destroyed successfully.
Aug 15 19:21:44 user nova-compute[73188]: DEBUG nova.objects.instance [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lazy-loading 'resources' on Instance uuid 30dbb719-b373-431d-8590-7b7040fa3443 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1258219588',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1258219588',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1258219588',id=33,image_ref='0f297bb0-2af2-4383-bd97-3fb47c39b5b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKC0bpnnzrQvW1jA/u16Bx5fqsyaeRjf6ClnT/JFCnHfS6GwfrIu0YFrhio7M+/MwC+vypXVfEqwhqfdUh6XGHG/gcFbTOK8Y5HNfkgHr5Qw4Qpe0YttcePRY3x3TwwPhQ==',key_name='tempest-keypair-988402873',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:20:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18eadba32f4547ad9436aca9285b7aad',ramdisk_id='',reservation_id='r-m47pl2lu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2114363476',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2114363476-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2114363476',owner_user_name='tempest-TestVolumeBootPattern-2114363476-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:20:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9503705066e5402cb569fae3b2bd8976',uuid=30dbb719-b373-431d-8590-7b7040fa3443,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cb25acc-8605-44c3-aa08-dfcbd3d60424", "address": "fa:16:3e:81:95:3d", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb25acc-86", "ovs_interfaceid": "2cb25acc-8605-44c3-aa08-dfcbd3d60424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converting VIF {"id": "2cb25acc-8605-44c3-aa08-dfcbd3d60424", "address": "fa:16:3e:81:95:3d", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb25acc-86", "ovs_interfaceid": "2cb25acc-8605-44c3-aa08-dfcbd3d60424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:95:3d,bridge_name='br-int',has_traffic_filtering=True,id=2cb25acc-8605-44c3-aa08-dfcbd3d60424,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cb25acc-86') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG os_vif [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:95:3d,bridge_name='br-int',has_traffic_filtering=True,id=2cb25acc-8605-44c3-aa08-dfcbd3d60424,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cb25acc-86') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cb25acc-86, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:21:44 user nova-compute[73188]: INFO os_vif [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:95:3d,bridge_name='br-int',has_traffic_filtering=True,id=2cb25acc-8605-44c3-aa08-dfcbd3d60424,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cb25acc-86')
Aug 15 19:21:44 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bZnfrWcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:21:44 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:21:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8439a1-13be-4116-a098-2fbe9687aaee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93f6817-c88b-495c-b0e1-c5e01a7b3813]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:21:44 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:21:44 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:21:44 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:21:44 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:21:44 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:21:44 user nova-compute[73188]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:21:44 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:21:44 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:21:44 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:21:44 user nova-compute[73188]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 (non-flash)
Aug 15 19:21:44 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:21:44 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:21:44 user nova-compute[73188]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:21:44 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e47b5870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0'): ({'sdf'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Removing single pathed devices sdf {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec56b12-b219-42ec-a5db-3d88fdea6784]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2752644-05d9-4ec1-86d2-73151f88aac7]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Flushing IO for device /dev/sdf {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d8f422-030c-4a14-9ab5-fd4735d4e9b0]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.065s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[341ee22e-2351-42e5-8392-fecfeced032a]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] SCSI volumes sdf have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.518s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a59ed94-67a5-4a62-833f-5589079ce058]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:45 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Deleted allocations for instance 9940ced5-da22-4d30-8895-a1fbe03821c8
Aug 15 19:21:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8daa57e8-2b6e-4181-b180-91123db771af]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0, portal: 172.16.0.220,3260]
Aug 15 19:21:45 user nova-compute[73188]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0, portal: 172.16.0.220,3260] successful.
Aug 15 19:21:45 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4c0b6189-238c-4b1a-aba1-196804256a60 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "9940ced5-da22-4d30-8895-a1fbe03821c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.330s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG nova.network.neutron [req-1aaa135b-6d59-4349-a6ad-feec6c06024c req-1de01c40-378b-414c-adba-35d785779577 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Updated VIF entry in instance network info cache for port 2cb25acc-8605-44c3-aa08-dfcbd3d60424. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG nova.network.neutron [req-1aaa135b-6d59-4349-a6ad-feec6c06024c req-1de01c40-378b-414c-adba-35d785779577 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Updating instance_info_cache with network_info: [{"id": "2cb25acc-8605-44c3-aa08-dfcbd3d60424", "address": "fa:16:3e:81:95:3d", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cb25acc-86", "ovs_interfaceid": "2cb25acc-8605-44c3-aa08-dfcbd3d60424", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6846b176-5816-46fb-8cfc-6b8560ea3f7d]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] <== disconnect_volume: return (363ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:21:45 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Deleting instance files /opt/stack/data/nova/instances/30dbb719-b373-431d-8590-7b7040fa3443_del
Aug 15 19:21:45 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Deletion of /opt/stack/data/nova/instances/30dbb719-b373-431d-8590-7b7040fa3443_del complete
Aug 15 19:21:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1aaa135b-6d59-4349-a6ad-feec6c06024c req-1de01c40-378b-414c-adba-35d785779577 service nova] Releasing lock "refresh_cache-30dbb719-b373-431d-8590-7b7040fa3443" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:21:45 user nova-compute[73188]: INFO nova.compute.manager [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 15 19:21:45 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:21:45 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:21:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:46 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:21:46 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Took 0.79 seconds to deallocate network for instance.
Aug 15 19:21:46 user nova-compute[73188]: DEBUG nova.compute.manager [req-59062737-41f5-48e4-8a6a-8a2a14ddefaa req-fc00cc2e-3c6a-4d5b-ae97-02cbfa8249c3 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Received event network-vif-deleted-2cb25acc-8605-44c3-aa08-dfcbd3d60424 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:21:46 user nova-compute[73188]: DEBUG nova.compute.manager [req-4aa15d4a-ee8b-4815-8cbd-e51e6d58862b req-a64c9240-c5e1-4fa7-89b0-b909c8872520 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Received event network-vif-unplugged-2cb25acc-8605-44c3-aa08-dfcbd3d60424 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:21:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4aa15d4a-ee8b-4815-8cbd-e51e6d58862b req-a64c9240-c5e1-4fa7-89b0-b909c8872520 service nova] Acquiring lock "30dbb719-b373-431d-8590-7b7040fa3443-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4aa15d4a-ee8b-4815-8cbd-e51e6d58862b req-a64c9240-c5e1-4fa7-89b0-b909c8872520 service nova] Lock "30dbb719-b373-431d-8590-7b7040fa3443-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4aa15d4a-ee8b-4815-8cbd-e51e6d58862b req-a64c9240-c5e1-4fa7-89b0-b909c8872520 service nova] Lock "30dbb719-b373-431d-8590-7b7040fa3443-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:46 user nova-compute[73188]: DEBUG nova.compute.manager [req-4aa15d4a-ee8b-4815-8cbd-e51e6d58862b req-a64c9240-c5e1-4fa7-89b0-b909c8872520 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] No waiting events found dispatching network-vif-unplugged-2cb25acc-8605-44c3-aa08-dfcbd3d60424 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:21:46 user nova-compute[73188]: DEBUG nova.compute.manager [req-4aa15d4a-ee8b-4815-8cbd-e51e6d58862b req-a64c9240-c5e1-4fa7-89b0-b909c8872520 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Received event network-vif-unplugged-2cb25acc-8605-44c3-aa08-dfcbd3d60424 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:21:46 user nova-compute[73188]: DEBUG nova.compute.manager [req-4aa15d4a-ee8b-4815-8cbd-e51e6d58862b req-a64c9240-c5e1-4fa7-89b0-b909c8872520 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Received event network-vif-plugged-2cb25acc-8605-44c3-aa08-dfcbd3d60424 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:21:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4aa15d4a-ee8b-4815-8cbd-e51e6d58862b req-a64c9240-c5e1-4fa7-89b0-b909c8872520 service nova] Acquiring lock "30dbb719-b373-431d-8590-7b7040fa3443-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4aa15d4a-ee8b-4815-8cbd-e51e6d58862b req-a64c9240-c5e1-4fa7-89b0-b909c8872520 service nova] Lock "30dbb719-b373-431d-8590-7b7040fa3443-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4aa15d4a-ee8b-4815-8cbd-e51e6d58862b req-a64c9240-c5e1-4fa7-89b0-b909c8872520 service nova] Lock "30dbb719-b373-431d-8590-7b7040fa3443-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:46 user nova-compute[73188]: DEBUG nova.compute.manager [req-4aa15d4a-ee8b-4815-8cbd-e51e6d58862b req-a64c9240-c5e1-4fa7-89b0-b909c8872520 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] No waiting events found dispatching network-vif-plugged-2cb25acc-8605-44c3-aa08-dfcbd3d60424 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:21:46 user nova-compute[73188]: WARNING nova.compute.manager [req-4aa15d4a-ee8b-4815-8cbd-e51e6d58862b req-a64c9240-c5e1-4fa7-89b0-b909c8872520 service nova] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Received unexpected event network-vif-plugged-2cb25acc-8605-44c3-aa08-dfcbd3d60424 for instance with vm_state active and task_state deleting.
Aug 15 19:21:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:46 user nova-compute[73188]: INFO nova.compute.manager [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Took 0.72 seconds to detach 1 volumes for instance.
Aug 15 19:21:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Deleting volume: 43de9cf6-e7c7-4fa6-80e7-edea2f02f3e0 {{(pid=73188) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 19:21:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:47 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:21:47 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:21:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:47 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Deleted allocations for instance 30dbb719-b373-431d-8590-7b7040fa3443
Aug 15 19:21:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-94a80df0-f358-4cb1-9325-8ff67d3e83af tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "30dbb719-b373-431d-8590-7b7040fa3443" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.417s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_power_states {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid 3d713d03-3e60-4dec-a295-a4652ac21842 {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid e00adf53-085f-436d-a09f-e97e92ca79cd {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid 139ccf1c-4792-4653-9475-c61b1f9c4846 {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid 215077af-60a1-4a82-b24e-1545349363d0 {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid 0ee7de87-76ad-48ae-8bcd-93b2792a96cd {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid 182d8fc2-0246-4164-9d1b-f970cec4dd1f {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid d8f302f1-7c20-483a-9eef-24566d51143d {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "3d713d03-3e60-4dec-a295-a4652ac21842" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "3d713d03-3e60-4dec-a295-a4652ac21842" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "e00adf53-085f-436d-a09f-e97e92ca79cd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "e00adf53-085f-436d-a09f-e97e92ca79cd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "139ccf1c-4792-4653-9475-c61b1f9c4846" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "215077af-60a1-4a82-b24e-1545349363d0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "215077af-60a1-4a82-b24e-1545349363d0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "d8f302f1-7c20-483a-9eef-24566d51143d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "d8f302f1-7c20-483a-9eef-24566d51143d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "e00adf53-085f-436d-a09f-e97e92ca79cd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "3d713d03-3e60-4dec-a295-a4652ac21842" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "215077af-60a1-4a82-b24e-1545349363d0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "d8f302f1-7c20-483a-9eef-24566d51143d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:21:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "d8f302f1-7c20-483a-9eef-24566d51143d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "d8f302f1-7c20-483a-9eef-24566d51143d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:56 user nova-compute[73188]: DEBUG nova.objects.instance [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lazy-loading 'flavor' on Instance uuid d8f302f1-7c20-483a-9eef-24566d51143d {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:21:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "d8f302f1-7c20-483a-9eef-24566d51143d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:21:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "d8f302f1-7c20-483a-9eef-24566d51143d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:21:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "d8f302f1-7c20-483a-9eef-24566d51143d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:21:56 user nova-compute[73188]: INFO nova.compute.manager [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Attaching volume 1dd8f2f7-1270-42d7-84c7-0849183b1640 to /dev/vdb
Aug 15 19:21:56 user nova-compute[73188]: DEBUG os_brick.utils [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:21:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7166c926-afa5-4405-b6ad-c0b350562b35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fd67f1-a6d3-48ea-bd1b-e5c6b65f99c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:21:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece7279b-a809-4bca-b972-8bdc599ef7d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[86065690-7253-483c-8991-aab5ba29a209]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:21:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:21:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:21:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:21:57 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:21:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fa9126-58fa-4329-b35d-06d3325f2815]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:21:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:21:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:21:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:21:57 user nova-compute[73188]: DEBUG os_brick.utils [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:21:57 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Updating existing volume attachment record: 6923122f-bfed-4ef9-bad1-c2f69da78d12 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:21:57 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127302.7121823, 9940ced5-da22-4d30-8895-a1fbe03821c8 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:21:57 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] VM Stopped (Lifecycle Event)
Aug 15 19:21:57 user nova-compute[73188]: DEBUG nova.compute.manager [None req-5ecabad9-8261-4614-ac88-62a85dd4d095 None None] [instance: 9940ced5-da22-4d30-8895-a1fbe03821c8] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:21:59 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127304.8402948, 30dbb719-b373-431d-8590-7b7040fa3443 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:21:59 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] VM Stopped (Lifecycle Event)
Aug 15 19:21:59 user nova-compute[73188]: DEBUG nova.compute.manager [None req-22fc090a-1c63-445b-a70e-3d4a36a00ad3 None None] [instance: 30dbb719-b373-431d-8590-7b7040fa3443] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:21:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Acquiring lock "a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:22:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:02 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:22:02 user nova-compute[73188]: INFO nova.compute.claims [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Claim successful on node user
Aug 15 19:22:02 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:22:02 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:22:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:22:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:22:02 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:22:02 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:22:02 user nova-compute[73188]: DEBUG nova.policy [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffd643862c1447868d962e4315a38d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cfc95d252dc44f79afe90be2f4324a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:22:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:22:03 user nova-compute[73188]: DEBUG nova.compute.manager [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:22:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:22:03 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Creating image(s)
Aug 15 19:22:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "/opt/stack/data/nova/instances/a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "/opt/stack/data/nova/instances/a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:03 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Successfully created port: a9cd3e25-b47c-4c93-8750-458e6800e9ff {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:22:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.203s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff/disk 1073741824" returned: 0 in 0.053s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.205s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:03 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:22:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:03 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Cannot resize image /opt/stack/data/nova/instances/a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:22:03 user nova-compute[73188]: DEBUG nova.objects.instance [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lazy-loading 'migration_context' on Instance uuid a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Ensure instance console log exists: /opt/stack/data/nova/instances/a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Successfully updated port: a9cd3e25-b47c-4c93-8750-458e6800e9ff {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Acquiring lock "refresh_cache-a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Acquired lock "refresh_cache-a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.compute.manager [req-14d8f231-cb21-4183-9b7c-c6ceeeabfcbc req-d018f2c1-4dbb-49a1-9eb1-a30f8a705cb3 service nova] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Received event network-changed-a9cd3e25-b47c-4c93-8750-458e6800e9ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.compute.manager [req-14d8f231-cb21-4183-9b7c-c6ceeeabfcbc req-d018f2c1-4dbb-49a1-9eb1-a30f8a705cb3 service nova] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Refreshing instance network info cache due to event network-changed-a9cd3e25-b47c-4c93-8750-458e6800e9ff. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-14d8f231-cb21-4183-9b7c-c6ceeeabfcbc req-d018f2c1-4dbb-49a1-9eb1-a30f8a705cb3 service nova] Acquiring lock "refresh_cache-a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.network.neutron [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Updating instance_info_cache with network_info: [{"id": "a9cd3e25-b47c-4c93-8750-458e6800e9ff", "address": "fa:16:3e:eb:06:47", "network": {"id": "67b69ed4-0c6f-4b67-a173-2570bbb4d6d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979729543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cfc95d252dc44f79afe90be2f4324a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9cd3e25-b4", "ovs_interfaceid": "a9cd3e25-b47c-4c93-8750-458e6800e9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Releasing lock "refresh_cache-a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.compute.manager [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Instance network_info: |[{"id": "a9cd3e25-b47c-4c93-8750-458e6800e9ff", "address": "fa:16:3e:eb:06:47", "network": {"id": "67b69ed4-0c6f-4b67-a173-2570bbb4d6d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979729543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cfc95d252dc44f79afe90be2f4324a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9cd3e25-b4", "ovs_interfaceid": "a9cd3e25-b47c-4c93-8750-458e6800e9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-14d8f231-cb21-4183-9b7c-c6ceeeabfcbc req-d018f2c1-4dbb-49a1-9eb1-a30f8a705cb3 service nova] Acquired lock "refresh_cache-a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.network.neutron [req-14d8f231-cb21-4183-9b7c-c6ceeeabfcbc req-d018f2c1-4dbb-49a1-9eb1-a30f8a705cb3 service nova] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Refreshing network info cache for port a9cd3e25-b47c-4c93-8750-458e6800e9ff {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Start _get_guest_xml network_info=[{"id": "a9cd3e25-b47c-4c93-8750-458e6800e9ff", "address": "fa:16:3e:eb:06:47", "network": {"id": "67b69ed4-0c6f-4b67-a173-2570bbb4d6d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979729543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cfc95d252dc44f79afe90be2f4324a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9cd3e25-b4", "ovs_interfaceid": "a9cd3e25-b47c-4c93-8750-458e6800e9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:22:04 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:22:04 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-67317540',display_name='tempest-VolumesActionsTest-instance-67317540',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-67317540',id=36,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cfc95d252dc44f79afe90be2f4324a6',ramdisk_id='',reservation_id='r-2udc4vay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1468435355',owner_user_name='tempest-VolumesActionsTest-1468435355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:22:03Z,user_data=None,user_id='ffd643862c1447868d962e4315a38d13',uuid=a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9cd3e25-b47c-4c93-8750-458e6800e9ff", "address": "fa:16:3e:eb:06:47", "network": {"id": "67b69ed4-0c6f-4b67-a173-2570bbb4d6d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979729543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cfc95d252dc44f79afe90be2f4324a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9cd3e25-b4", "ovs_interfaceid": "a9cd3e25-b47c-4c93-8750-458e6800e9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Converting VIF {"id": "a9cd3e25-b47c-4c93-8750-458e6800e9ff", "address": "fa:16:3e:eb:06:47", "network": {"id": "67b69ed4-0c6f-4b67-a173-2570bbb4d6d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979729543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cfc95d252dc44f79afe90be2f4324a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9cd3e25-b4", "ovs_interfaceid": "a9cd3e25-b47c-4c93-8750-458e6800e9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:06:47,bridge_name='br-int',has_traffic_filtering=True,id=a9cd3e25-b47c-4c93-8750-458e6800e9ff,network=Network(67b69ed4-0c6f-4b67-a173-2570bbb4d6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9cd3e25-b4') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.objects.instance [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lazy-loading 'pci_devices' on Instance uuid a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:22:04 user nova-compute[73188]:   <uuid>a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff</uuid>
Aug 15 19:22:04 user nova-compute[73188]:   <name>instance-00000024</name>
Aug 15 19:22:04 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:22:04 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:22:04 user nova-compute[73188]:   <metadata>
Aug 15 19:22:04 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:22:04 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:22:04 user nova-compute[73188]:       <nova:name>tempest-VolumesActionsTest-instance-67317540</nova:name>
Aug 15 19:22:04 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:22:04</nova:creationTime>
Aug 15 19:22:04 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:22:04 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:22:04 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:22:04 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:22:04 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:22:04 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:22:04 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:22:04 user nova-compute[73188]:       <nova:owner>
Aug 15 19:22:04 user nova-compute[73188]:         <nova:user uuid="ffd643862c1447868d962e4315a38d13">tempest-VolumesActionsTest-1468435355-project-member</nova:user>
Aug 15 19:22:04 user nova-compute[73188]:         <nova:project uuid="1cfc95d252dc44f79afe90be2f4324a6">tempest-VolumesActionsTest-1468435355</nova:project>
Aug 15 19:22:04 user nova-compute[73188]:       </nova:owner>
Aug 15 19:22:04 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:22:04 user nova-compute[73188]:       <nova:ports>
Aug 15 19:22:04 user nova-compute[73188]:         <nova:port uuid="a9cd3e25-b47c-4c93-8750-458e6800e9ff">
Aug 15 19:22:04 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 19:22:04 user nova-compute[73188]:         </nova:port>
Aug 15 19:22:04 user nova-compute[73188]:       </nova:ports>
Aug 15 19:22:04 user nova-compute[73188]:     </nova:instance>
Aug 15 19:22:04 user nova-compute[73188]:   </metadata>
Aug 15 19:22:04 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:22:04 user nova-compute[73188]:     <system>
Aug 15 19:22:04 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:22:04 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:22:04 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:22:04 user nova-compute[73188]:       <entry name="serial">a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff</entry>
Aug 15 19:22:04 user nova-compute[73188]:       <entry name="uuid">a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff</entry>
Aug 15 19:22:04 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:22:04 user nova-compute[73188]:     </system>
Aug 15 19:22:04 user nova-compute[73188]:   </sysinfo>
Aug 15 19:22:04 user nova-compute[73188]:   <os>
Aug 15 19:22:04 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:22:04 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:22:04 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:22:04 user nova-compute[73188]:   </os>
Aug 15 19:22:04 user nova-compute[73188]:   <features>
Aug 15 19:22:04 user nova-compute[73188]:     <acpi/>
Aug 15 19:22:04 user nova-compute[73188]:     <apic/>
Aug 15 19:22:04 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:22:04 user nova-compute[73188]:   </features>
Aug 15 19:22:04 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:22:04 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:22:04 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:22:04 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:22:04 user nova-compute[73188]:   </clock>
Aug 15 19:22:04 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:22:04 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:22:04 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:22:04 user nova-compute[73188]:   </cpu>
Aug 15 19:22:04 user nova-compute[73188]:   <devices>
Aug 15 19:22:04 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:22:04 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:22:04 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff/disk"/>
Aug 15 19:22:04 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:22:04 user nova-compute[73188]:     </disk>
Aug 15 19:22:04 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:22:04 user nova-compute[73188]:       <mac address="fa:16:3e:eb:06:47"/>
Aug 15 19:22:04 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:22:04 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:22:04 user nova-compute[73188]:       <target dev="tapa9cd3e25-b4"/>
Aug 15 19:22:04 user nova-compute[73188]:     </interface>
Aug 15 19:22:04 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:22:04 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff/console.log" append="off"/>
Aug 15 19:22:04 user nova-compute[73188]:     </serial>
Aug 15 19:22:04 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:22:04 user nova-compute[73188]:     <video>
Aug 15 19:22:04 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:22:04 user nova-compute[73188]:     </video>
Aug 15 19:22:04 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:22:04 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:22:04 user nova-compute[73188]:     </rng>
Aug 15 19:22:04 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:22:04 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:22:04 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:22:04 user nova-compute[73188]:     </memballoon>
Aug 15 19:22:04 user nova-compute[73188]:   </devices>
Aug 15 19:22:04 user nova-compute[73188]: </domain>
Aug 15 19:22:04 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-67317540',display_name='tempest-VolumesActionsTest-instance-67317540',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-67317540',id=36,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cfc95d252dc44f79afe90be2f4324a6',ramdisk_id='',reservation_id='r-2udc4vay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1468435355',owner_user_name='tempest-VolumesActionsTest-1468435355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:22:03Z,user_data=None,user_id='ffd643862c1447868d962e4315a38d13',uuid=a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9cd3e25-b47c-4c93-8750-458e6800e9ff", "address": "fa:16:3e:eb:06:47", "network": {"id": "67b69ed4-0c6f-4b67-a173-2570bbb4d6d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979729543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cfc95d252dc44f79afe90be2f4324a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9cd3e25-b4", "ovs_interfaceid": "a9cd3e25-b47c-4c93-8750-458e6800e9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Converting VIF {"id": "a9cd3e25-b47c-4c93-8750-458e6800e9ff", "address": "fa:16:3e:eb:06:47", "network": {"id": "67b69ed4-0c6f-4b67-a173-2570bbb4d6d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979729543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cfc95d252dc44f79afe90be2f4324a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9cd3e25-b4", "ovs_interfaceid": "a9cd3e25-b47c-4c93-8750-458e6800e9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:06:47,bridge_name='br-int',has_traffic_filtering=True,id=a9cd3e25-b47c-4c93-8750-458e6800e9ff,network=Network(67b69ed4-0c6f-4b67-a173-2570bbb4d6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9cd3e25-b4') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG os_vif [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:06:47,bridge_name='br-int',has_traffic_filtering=True,id=a9cd3e25-b47c-4c93-8750-458e6800e9ff,network=Network(67b69ed4-0c6f-4b67-a173-2570bbb4d6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9cd3e25-b4') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9cd3e25-b4, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9cd3e25-b4, col_values=(('external_ids', {'iface-id': 'a9cd3e25-b47c-4c93-8750-458e6800e9ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:06:47', 'vm-uuid': 'a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:04 user nova-compute[73188]: INFO os_vif [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:06:47,bridge_name='br-int',has_traffic_filtering=True,id=a9cd3e25-b47c-4c93-8750-458e6800e9ff,network=Network(67b69ed4-0c6f-4b67-a173-2570bbb4d6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9cd3e25-b4')
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:22:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] No VIF found with MAC fa:16:3e:eb:06:47, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:22:05 user nova-compute[73188]: DEBUG nova.network.neutron [req-14d8f231-cb21-4183-9b7c-c6ceeeabfcbc req-d018f2c1-4dbb-49a1-9eb1-a30f8a705cb3 service nova] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Updated VIF entry in instance network info cache for port a9cd3e25-b47c-4c93-8750-458e6800e9ff. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:22:05 user nova-compute[73188]: DEBUG nova.network.neutron [req-14d8f231-cb21-4183-9b7c-c6ceeeabfcbc req-d018f2c1-4dbb-49a1-9eb1-a30f8a705cb3 service nova] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Updating instance_info_cache with network_info: [{"id": "a9cd3e25-b47c-4c93-8750-458e6800e9ff", "address": "fa:16:3e:eb:06:47", "network": {"id": "67b69ed4-0c6f-4b67-a173-2570bbb4d6d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979729543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cfc95d252dc44f79afe90be2f4324a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9cd3e25-b4", "ovs_interfaceid": "a9cd3e25-b47c-4c93-8750-458e6800e9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:22:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-14d8f231-cb21-4183-9b7c-c6ceeeabfcbc req-d018f2c1-4dbb-49a1-9eb1-a30f8a705cb3 service nova] Releasing lock "refresh_cache-a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:22:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:06 user nova-compute[73188]: DEBUG nova.compute.manager [req-523b64a7-0c15-4ce6-8c73-7100fb079e85 req-3c51acf0-7582-40ee-897d-f2e75ffb7789 service nova] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Received event network-vif-plugged-a9cd3e25-b47c-4c93-8750-458e6800e9ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:22:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-523b64a7-0c15-4ce6-8c73-7100fb079e85 req-3c51acf0-7582-40ee-897d-f2e75ffb7789 service nova] Acquiring lock "a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-523b64a7-0c15-4ce6-8c73-7100fb079e85 req-3c51acf0-7582-40ee-897d-f2e75ffb7789 service nova] Lock "a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-523b64a7-0c15-4ce6-8c73-7100fb079e85 req-3c51acf0-7582-40ee-897d-f2e75ffb7789 service nova] Lock "a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:06 user nova-compute[73188]: DEBUG nova.compute.manager [req-523b64a7-0c15-4ce6-8c73-7100fb079e85 req-3c51acf0-7582-40ee-897d-f2e75ffb7789 service nova] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] No waiting events found dispatching network-vif-plugged-a9cd3e25-b47c-4c93-8750-458e6800e9ff {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:22:06 user nova-compute[73188]: WARNING nova.compute.manager [req-523b64a7-0c15-4ce6-8c73-7100fb079e85 req-3c51acf0-7582-40ee-897d-f2e75ffb7789 service nova] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Received unexpected event network-vif-plugged-a9cd3e25-b47c-4c93-8750-458e6800e9ff for instance with vm_state building and task_state spawning.
Aug 15 19:22:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqXKtJpR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:22:07 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:22:07 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:22:07 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d3e7db-aa04-40fe-8fce-33358db7b55a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:22:07 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4efa7e-e7db-4826-8ffc-bf0fc0a0d73c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640] added
Aug 15 19:22:07 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f531ac-b775-40ae-be04-34cf3b53b92a]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[146d7ec8-ef60-4a90-a9f6-45ba33413aa0]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HqXKtJpR {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HqXKtJpR" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca05062-693c-4005-b459-83ae0e340496]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HqXKtJpR'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[493a6a61-3662-40c9-b2b6-430a9bdd92b8]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[707c5f85-d899-4508-a3e8-40fe488b65e0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:22:07 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:22:07 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:22:07 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:22:07 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:22:07 user nova-compute[73188]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:22:07 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:22:07 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:22:07 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:22:07 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:22:07 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:22:07 user nova-compute[73188]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:22:07 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[af81162e-acae-4ed3-be40-db418a560a73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640, portal: 172.16.0.220,3260]
Aug 15 19:22:07 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640, portal: 172.16.0.220,3260] successful.
Aug 15 19:22:07 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d65165-31c0-43f6-972a-e37285e1401a]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76b1d26-2cc6-4523-a47a-b6a9178bd2ba]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:22:07 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:22:07 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:22:07 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:22:07 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:22:07 user nova-compute[73188]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:22:07 user nova-compute[73188]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)
Aug 15 19:22:07 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:22:07 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:22:07 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:22:07 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:22:07 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:22:07 user nova-compute[73188]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:22:07 user nova-compute[73188]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)
Aug 15 19:22:07 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[797480e7-7309-42c6-b7da-33391185ad4b]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:22:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqXKtJpR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127328.1762965, a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:22:08 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] VM Resumed (Lifecycle Event)
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.compute.manager [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:22:08 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Instance spawned successfully.
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:22:08 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127328.177337, a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:22:08 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] VM Started (Lifecycle Event)
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:22:08 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:22:08 user nova-compute[73188]: INFO nova.compute.manager [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Took 5.17 seconds to spawn the instance on the hypervisor.
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.compute.manager [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:22:08 user nova-compute[73188]: INFO nova.compute.manager [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Took 6.15 seconds to build instance.
Aug 15 19:22:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26238323438383263', 'path': '/dev/sdf'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238323438383263', 'path': '/dev/sdf'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-f26d880c-4cf3-41f2-97a8-5db1eae37fb0 req-47e1ebf4-192b-478e-87d3-eb8db6cf4229 service nova] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Received event network-vif-plugged-a9cd3e25-b47c-4c93-8750-458e6800e9ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f26d880c-4cf3-41f2-97a8-5db1eae37fb0 req-47e1ebf4-192b-478e-87d3-eb8db6cf4229 service nova] Acquiring lock "a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f26d880c-4cf3-41f2-97a8-5db1eae37fb0 req-47e1ebf4-192b-478e-87d3-eb8db6cf4229 service nova] Lock "a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f26d880c-4cf3-41f2-97a8-5db1eae37fb0 req-47e1ebf4-192b-478e-87d3-eb8db6cf4229 service nova] Lock "a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-f26d880c-4cf3-41f2-97a8-5db1eae37fb0 req-47e1ebf4-192b-478e-87d3-eb8db6cf4229 service nova] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] No waiting events found dispatching network-vif-plugged-a9cd3e25-b47c-4c93-8750-458e6800e9ff {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:22:08 user nova-compute[73188]: WARNING nova.compute.manager [req-f26d880c-4cf3-41f2-97a8-5db1eae37fb0 req-47e1ebf4-192b-478e-87d3-eb8db6cf4229 service nova] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Received unexpected event network-vif-plugged-a9cd3e25-b47c-4c93-8750-458e6800e9ff for instance with vm_state active and task_state None.
Aug 15 19:22:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cdf7e3e8-0ebe-48f5-b248-0280594551c4 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.244s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.objects.instance [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lazy-loading 'flavor' on Instance uuid d8f302f1-7c20-483a-9eef-24566d51143d {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:22:08 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:22:08 user nova-compute[73188]:   <source dev="/dev/sdf"/>
Aug 15 19:22:08 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:22:08 user nova-compute[73188]:   <serial>1dd8f2f7-1270-42d7-84c7-0849183b1640</serial>
Aug 15 19:22:08 user nova-compute[73188]: </disk>
Aug 15 19:22:08 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] No VIF found with MAC fa:16:3e:e6:c1:cc, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:22:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6cd7b4c6-0df1-419a-b4e7-2141ae153039 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "d8f302f1-7c20-483a-9eef-24566d51143d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.009s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-66603ba5-1acd-49d0-bd57-e12d8522d100 req-950bb505-e9be-4ee3-b6a0-0ef55147e12a service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Received event network-changed-11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:22:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-66603ba5-1acd-49d0-bd57-e12d8522d100 req-950bb505-e9be-4ee3-b6a0-0ef55147e12a service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Refreshing instance network info cache due to event network-changed-11b7dd56-8608-446d-9229-ccac461f89b2. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:22:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-66603ba5-1acd-49d0-bd57-e12d8522d100 req-950bb505-e9be-4ee3-b6a0-0ef55147e12a service nova] Acquiring lock "refresh_cache-d8f302f1-7c20-483a-9eef-24566d51143d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:22:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-66603ba5-1acd-49d0-bd57-e12d8522d100 req-950bb505-e9be-4ee3-b6a0-0ef55147e12a service nova] Acquired lock "refresh_cache-d8f302f1-7c20-483a-9eef-24566d51143d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:22:11 user nova-compute[73188]: DEBUG nova.network.neutron [req-66603ba5-1acd-49d0-bd57-e12d8522d100 req-950bb505-e9be-4ee3-b6a0-0ef55147e12a service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Refreshing network info cache for port 11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:22:12 user nova-compute[73188]: DEBUG nova.network.neutron [req-66603ba5-1acd-49d0-bd57-e12d8522d100 req-950bb505-e9be-4ee3-b6a0-0ef55147e12a service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Updated VIF entry in instance network info cache for port 11b7dd56-8608-446d-9229-ccac461f89b2. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:22:12 user nova-compute[73188]: DEBUG nova.network.neutron [req-66603ba5-1acd-49d0-bd57-e12d8522d100 req-950bb505-e9be-4ee3-b6a0-0ef55147e12a service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Updating instance_info_cache with network_info: [{"id": "11b7dd56-8608-446d-9229-ccac461f89b2", "address": "fa:16:3e:e6:c1:cc", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b7dd56-86", "ovs_interfaceid": "11b7dd56-8608-446d-9229-ccac461f89b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:22:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-66603ba5-1acd-49d0-bd57-e12d8522d100 req-950bb505-e9be-4ee3-b6a0-0ef55147e12a service nova] Releasing lock "refresh_cache-d8f302f1-7c20-483a-9eef-24566d51143d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:22:13 user nova-compute[73188]: DEBUG nova.compute.manager [req-82063cf5-001e-43ee-850f-9fb0126a8995 req-d04c4ead-9f21-467b-88b3-171f2f6b94cb service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Received event network-changed-11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:22:13 user nova-compute[73188]: DEBUG nova.compute.manager [req-82063cf5-001e-43ee-850f-9fb0126a8995 req-d04c4ead-9f21-467b-88b3-171f2f6b94cb service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Refreshing instance network info cache due to event network-changed-11b7dd56-8608-446d-9229-ccac461f89b2. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:22:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-82063cf5-001e-43ee-850f-9fb0126a8995 req-d04c4ead-9f21-467b-88b3-171f2f6b94cb service nova] Acquiring lock "refresh_cache-d8f302f1-7c20-483a-9eef-24566d51143d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:22:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-82063cf5-001e-43ee-850f-9fb0126a8995 req-d04c4ead-9f21-467b-88b3-171f2f6b94cb service nova] Acquired lock "refresh_cache-d8f302f1-7c20-483a-9eef-24566d51143d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:22:13 user nova-compute[73188]: DEBUG nova.network.neutron [req-82063cf5-001e-43ee-850f-9fb0126a8995 req-d04c4ead-9f21-467b-88b3-171f2f6b94cb service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Refreshing network info cache for port 11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:22:14 user nova-compute[73188]: DEBUG nova.network.neutron [req-82063cf5-001e-43ee-850f-9fb0126a8995 req-d04c4ead-9f21-467b-88b3-171f2f6b94cb service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Updated VIF entry in instance network info cache for port 11b7dd56-8608-446d-9229-ccac461f89b2. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:22:14 user nova-compute[73188]: DEBUG nova.network.neutron [req-82063cf5-001e-43ee-850f-9fb0126a8995 req-d04c4ead-9f21-467b-88b3-171f2f6b94cb service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Updating instance_info_cache with network_info: [{"id": "11b7dd56-8608-446d-9229-ccac461f89b2", "address": "fa:16:3e:e6:c1:cc", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b7dd56-86", "ovs_interfaceid": "11b7dd56-8608-446d-9229-ccac461f89b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:22:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-82063cf5-001e-43ee-850f-9fb0126a8995 req-d04c4ead-9f21-467b-88b3-171f2f6b94cb service nova] Releasing lock "refresh_cache-d8f302f1-7c20-483a-9eef-24566d51143d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:22:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4b3df0dd-c96b-40d3-a360-0433155abef2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "d8f302f1-7c20-483a-9eef-24566d51143d" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4b3df0dd-c96b-40d3-a360-0433155abef2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "d8f302f1-7c20-483a-9eef-24566d51143d" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:14 user nova-compute[73188]: INFO nova.compute.manager [None req-4b3df0dd-c96b-40d3-a360-0433155abef2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Rebooting instance
Aug 15 19:22:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4b3df0dd-c96b-40d3-a360-0433155abef2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "refresh_cache-d8f302f1-7c20-483a-9eef-24566d51143d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:22:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4b3df0dd-c96b-40d3-a360-0433155abef2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquired lock "refresh_cache-d8f302f1-7c20-483a-9eef-24566d51143d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:22:14 user nova-compute[73188]: DEBUG nova.network.neutron [None req-4b3df0dd-c96b-40d3-a360-0433155abef2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:22:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:14 user nova-compute[73188]: DEBUG nova.network.neutron [None req-4b3df0dd-c96b-40d3-a360-0433155abef2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Updating instance_info_cache with network_info: [{"id": "11b7dd56-8608-446d-9229-ccac461f89b2", "address": "fa:16:3e:e6:c1:cc", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b7dd56-86", "ovs_interfaceid": "11b7dd56-8608-446d-9229-ccac461f89b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:22:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4b3df0dd-c96b-40d3-a360-0433155abef2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Releasing lock "refresh_cache-d8f302f1-7c20-483a-9eef-24566d51143d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:22:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-4b3df0dd-c96b-40d3-a360-0433155abef2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:22:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-08caeaa8-543a-42c8-ba3e-672db4363568 req-5da0fa18-eac9-4d83-959c-fe54ef431b72 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Received event network-vif-unplugged-11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:22:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-08caeaa8-543a-42c8-ba3e-672db4363568 req-5da0fa18-eac9-4d83-959c-fe54ef431b72 service nova] Acquiring lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-08caeaa8-543a-42c8-ba3e-672db4363568 req-5da0fa18-eac9-4d83-959c-fe54ef431b72 service nova] Lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-08caeaa8-543a-42c8-ba3e-672db4363568 req-5da0fa18-eac9-4d83-959c-fe54ef431b72 service nova] Lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-08caeaa8-543a-42c8-ba3e-672db4363568 req-5da0fa18-eac9-4d83-959c-fe54ef431b72 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] No waiting events found dispatching network-vif-unplugged-11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:22:17 user nova-compute[73188]: WARNING nova.compute.manager [req-08caeaa8-543a-42c8-ba3e-672db4363568 req-5da0fa18-eac9-4d83-959c-fe54ef431b72 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Received unexpected event network-vif-unplugged-11b7dd56-8608-446d-9229-ccac461f89b2 for instance with vm_state active and task_state reboot_started.
Aug 15 19:22:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:17 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-4b3df0dd-c96b-40d3-a360-0433155abef2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Instance shutdown successfully.
Aug 15 19:22:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:19 user nova-compute[73188]: DEBUG nova.compute.manager [req-6619fa6e-c44c-4bd3-b296-1d29d28df052 req-3fd2b065-466e-4d7b-9d82-c0556dc54111 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Received event network-vif-plugged-11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:22:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6619fa6e-c44c-4bd3-b296-1d29d28df052 req-3fd2b065-466e-4d7b-9d82-c0556dc54111 service nova] Acquiring lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6619fa6e-c44c-4bd3-b296-1d29d28df052 req-3fd2b065-466e-4d7b-9d82-c0556dc54111 service nova] Lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6619fa6e-c44c-4bd3-b296-1d29d28df052 req-3fd2b065-466e-4d7b-9d82-c0556dc54111 service nova] Lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:19 user nova-compute[73188]: DEBUG nova.compute.manager [req-6619fa6e-c44c-4bd3-b296-1d29d28df052 req-3fd2b065-466e-4d7b-9d82-c0556dc54111 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] No waiting events found dispatching network-vif-plugged-11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:22:19 user nova-compute[73188]: WARNING nova.compute.manager [req-6619fa6e-c44c-4bd3-b296-1d29d28df052 req-3fd2b065-466e-4d7b-9d82-c0556dc54111 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Received unexpected event network-vif-plugged-11b7dd56-8608-446d-9229-ccac461f89b2 for instance with vm_state active and task_state reboot_started.
Aug 15 19:22:19 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:22:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-7bcfb3c7-fd5f-479f-8b47-6420faaf6bd5 req-90c00e29-8f5a-49d5-82a6-2acf6015e202 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Received event network-vif-plugged-11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:22:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7bcfb3c7-fd5f-479f-8b47-6420faaf6bd5 req-90c00e29-8f5a-49d5-82a6-2acf6015e202 service nova] Acquiring lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7bcfb3c7-fd5f-479f-8b47-6420faaf6bd5 req-90c00e29-8f5a-49d5-82a6-2acf6015e202 service nova] Lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7bcfb3c7-fd5f-479f-8b47-6420faaf6bd5 req-90c00e29-8f5a-49d5-82a6-2acf6015e202 service nova] Lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-7bcfb3c7-fd5f-479f-8b47-6420faaf6bd5 req-90c00e29-8f5a-49d5-82a6-2acf6015e202 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] No waiting events found dispatching network-vif-plugged-11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:22:21 user nova-compute[73188]: WARNING nova.compute.manager [req-7bcfb3c7-fd5f-479f-8b47-6420faaf6bd5 req-90c00e29-8f5a-49d5-82a6-2acf6015e202 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Received unexpected event network-vif-plugged-11b7dd56-8608-446d-9229-ccac461f89b2 for instance with vm_state active and task_state reboot_started.
Aug 15 19:22:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-7bcfb3c7-fd5f-479f-8b47-6420faaf6bd5 req-90c00e29-8f5a-49d5-82a6-2acf6015e202 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Received event network-vif-plugged-11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:22:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7bcfb3c7-fd5f-479f-8b47-6420faaf6bd5 req-90c00e29-8f5a-49d5-82a6-2acf6015e202 service nova] Acquiring lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7bcfb3c7-fd5f-479f-8b47-6420faaf6bd5 req-90c00e29-8f5a-49d5-82a6-2acf6015e202 service nova] Lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7bcfb3c7-fd5f-479f-8b47-6420faaf6bd5 req-90c00e29-8f5a-49d5-82a6-2acf6015e202 service nova] Lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-7bcfb3c7-fd5f-479f-8b47-6420faaf6bd5 req-90c00e29-8f5a-49d5-82a6-2acf6015e202 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] No waiting events found dispatching network-vif-plugged-11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:22:21 user nova-compute[73188]: WARNING nova.compute.manager [req-7bcfb3c7-fd5f-479f-8b47-6420faaf6bd5 req-90c00e29-8f5a-49d5-82a6-2acf6015e202 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Received unexpected event network-vif-plugged-11b7dd56-8608-446d-9229-ccac461f89b2 for instance with vm_state active and task_state reboot_started.
Aug 15 19:22:21 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Removed pending event for d8f302f1-7c20-483a-9eef-24566d51143d due to event {{(pid=73188) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 19:22:21 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127341.4826221, d8f302f1-7c20-483a-9eef-24566d51143d => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:22:21 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] VM Resumed (Lifecycle Event)
Aug 15 19:22:21 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Instance running successfully.
Aug 15 19:22:21 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-4b3df0dd-c96b-40d3-a360-0433155abef2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Instance soft rebooted successfully.
Aug 15 19:22:21 user nova-compute[73188]: DEBUG nova.compute.manager [None req-4b3df0dd-c96b-40d3-a360-0433155abef2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:22:21 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:22:21 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:22:21 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 15 19:22:21 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127341.4855182, d8f302f1-7c20-483a-9eef-24566d51143d => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:22:21 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] VM Started (Lifecycle Event)
Aug 15 19:22:21 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:22:21 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:22:21 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 15 19:22:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4b3df0dd-c96b-40d3-a360-0433155abef2 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "d8f302f1-7c20-483a-9eef-24566d51143d" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.268s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:23 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:22:23 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:22:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-e00adf53-085f-436d-a09f-e97e92ca79cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:22:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-e00adf53-085f-436d-a09f-e97e92ca79cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:22:23 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Updating instance_info_cache with network_info: [{"id": "4646dbfd-e829-4653-9e76-e34901f8ad33", "address": "fa:16:3e:db:be:12", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4646dbfd-e8", "ovs_interfaceid": "4646dbfd-e829-4653-9e76-e34901f8ad33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-e00adf53-085f-436d-a09f-e97e92ca79cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:24 user nova-compute[73188]: INFO nova.compute.manager [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Terminating instance
Aug 15 19:22:24 user nova-compute[73188]: DEBUG nova.compute.manager [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG nova.compute.manager [req-de2e8075-3d03-43c0-beb5-569c32905585 req-238d964b-0254-46e3-982b-23f1cee4cd3a service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received event network-vif-unplugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-de2e8075-3d03-43c0-beb5-569c32905585 req-238d964b-0254-46e3-982b-23f1cee4cd3a service nova] Acquiring lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-de2e8075-3d03-43c0-beb5-569c32905585 req-238d964b-0254-46e3-982b-23f1cee4cd3a service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-de2e8075-3d03-43c0-beb5-569c32905585 req-238d964b-0254-46e3-982b-23f1cee4cd3a service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG nova.compute.manager [req-de2e8075-3d03-43c0-beb5-569c32905585 req-238d964b-0254-46e3-982b-23f1cee4cd3a service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] No waiting events found dispatching network-vif-unplugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG nova.compute.manager [req-de2e8075-3d03-43c0-beb5-569c32905585 req-238d964b-0254-46e3-982b-23f1cee4cd3a service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received event network-vif-unplugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:22:25 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Instance destroyed successfully.
Aug 15 19:22:25 user nova-compute[73188]: DEBUG nova.objects.instance [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'resources' on Instance uuid 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-689162011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-689162011',id=27,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:18:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ab4e1cccd434f6c83f2f9e4687d274e',ramdisk_id='',reservation_id='r-uzmnlu74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:20:38Z,user_data=None,user_id='bad952eceaec400396fd0a28c438c761',uuid=7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "address": "fa:16:3e:11:3f:a6", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da073c1-08", "ovs_interfaceid": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converting VIF {"id": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "address": "fa:16:3e:11:3f:a6", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da073c1-08", "ovs_interfaceid": "6da073c1-0834-4a3c-92e1-9d89e1bc5fe0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:3f:a6,bridge_name='br-int',has_traffic_filtering=True,id=6da073c1-0834-4a3c-92e1-9d89e1bc5fe0,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da073c1-08') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG os_vif [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:3f:a6,bridge_name='br-int',has_traffic_filtering=True,id=6da073c1-0834-4a3c-92e1-9d89e1bc5fe0,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da073c1-08') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6da073c1-08, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:22:25 user nova-compute[73188]: INFO os_vif [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:3f:a6,bridge_name='br-int',has_traffic_filtering=True,id=6da073c1-0834-4a3c-92e1-9d89e1bc5fe0,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da073c1-08')
Aug 15 19:22:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AJRehkFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:22:25 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:22:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c9a678-0b53-4b9e-aae3-9cc9baef1d11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[653c6c40-2b2a-4933-88f7-7a7eab0a95f3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:22:25 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:22:25 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:22:25 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:22:25 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:22:25 user nova-compute[73188]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:22:25 user nova-compute[73188]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)
Aug 15 19:22:25 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:22:25 user nova-compute[73188]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 (non-flash)
Aug 15 19:22:25 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:22:25 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:22:25 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:22:25 user nova-compute[73188]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:22:25 user nova-compute[73188]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)
Aug 15 19:22:25 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2808783eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54'): ({'sdc'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Removing single pathed devices sdc {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c612ba2b-1f99-4f4f-b24e-37630917bb1f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[69237a9d-c77c-42d7-bc8e-8d7c4fff3452]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Flushing IO for device /dev/sdc {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ec73fa-f837-416f-ac72-7389d661fbcd]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8beda7ce-55f3-43e5-931c-2cc395c79237]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] SCSI volumes sdc have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ad5922-b829-444f-8a97-2dcca2a1c110]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b144a440-daf7-4889-81f5-dd4c45439149]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54, portal: 172.16.0.220,3260]
Aug 15 19:22:25 user nova-compute[73188]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54, portal: 172.16.0.220,3260] successful.
Aug 15 19:22:25 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:757d7792-2f2c-4169-b1d1-c818a7576c54 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d6806c-b6ab-4c0c-b9e3-a9d75b3eadd1]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] <== disconnect_volume: return (319ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:22:25 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Deleting instance files /opt/stack/data/nova/instances/7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430_del
Aug 15 19:22:25 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Deletion of /opt/stack/data/nova/instances/7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430_del complete
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:25 user nova-compute[73188]: INFO nova.compute.manager [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Took 1.33 seconds to destroy the instance on the hypervisor.
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:26 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:22:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:26 user nova-compute[73188]: DEBUG nova.compute.manager [req-95892266-81c8-4f83-92ac-061b34c34ca0 req-11e1fdd4-90e3-473f-a605-13d56f45b947 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received event network-vif-deleted-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:22:26 user nova-compute[73188]: INFO nova.compute.manager [req-95892266-81c8-4f83-92ac-061b34c34ca0 req-11e1fdd4-90e3-473f-a605-13d56f45b947 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Neutron deleted interface 6da073c1-0834-4a3c-92e1-9d89e1bc5fe0; detaching it from the instance and deleting it from the info cache
Aug 15 19:22:26 user nova-compute[73188]: DEBUG nova.network.neutron [req-95892266-81c8-4f83-92ac-061b34c34ca0 req-11e1fdd4-90e3-473f-a605-13d56f45b947 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:22:26 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Took 0.88 seconds to deallocate network for instance.
Aug 15 19:22:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:26 user nova-compute[73188]: DEBUG nova.compute.manager [req-95892266-81c8-4f83-92ac-061b34c34ca0 req-11e1fdd4-90e3-473f-a605-13d56f45b947 service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Detach interface failed, port_id=6da073c1-0834-4a3c-92e1-9d89e1bc5fe0, reason: Instance 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:22:26 user nova-compute[73188]: DEBUG nova.compute.manager [req-e891907d-f1e7-436f-bdc1-66cb3018bb85 req-2f19e3ad-de5f-4dd8-ba86-44f1487cbd3a service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received event network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:22:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e891907d-f1e7-436f-bdc1-66cb3018bb85 req-2f19e3ad-de5f-4dd8-ba86-44f1487cbd3a service nova] Acquiring lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e891907d-f1e7-436f-bdc1-66cb3018bb85 req-2f19e3ad-de5f-4dd8-ba86-44f1487cbd3a service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e891907d-f1e7-436f-bdc1-66cb3018bb85 req-2f19e3ad-de5f-4dd8-ba86-44f1487cbd3a service nova] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:26 user nova-compute[73188]: DEBUG nova.compute.manager [req-e891907d-f1e7-436f-bdc1-66cb3018bb85 req-2f19e3ad-de5f-4dd8-ba86-44f1487cbd3a service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] No waiting events found dispatching network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:22:26 user nova-compute[73188]: WARNING nova.compute.manager [req-e891907d-f1e7-436f-bdc1-66cb3018bb85 req-2f19e3ad-de5f-4dd8-ba86-44f1487cbd3a service nova] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Received unexpected event network-vif-plugged-6da073c1-0834-4a3c-92e1-9d89e1bc5fe0 for instance with vm_state active and task_state deleting.
Aug 15 19:22:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:22:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:22:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:27 user nova-compute[73188]: INFO nova.compute.manager [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Took 0.82 seconds to detach 1 volumes for instance.
Aug 15 19:22:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:22:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:28 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:22:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:28 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:22:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.524s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:28 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Deleted allocations for instance 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430
Aug 15 19:22:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d2c4f626-7e1a-4ede-8881-39ec55c8da4d tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.767s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:28 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:22:28 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:22:28 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=7109MB free_disk=25.009628295898438GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:22:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3d713d03-3e60-4dec-a295-a4652ac21842 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e00adf53-085f-436d-a09f-e97e92ca79cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 139ccf1c-4792-4653-9475-c61b1f9c4846 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 215077af-60a1-4a82-b24e-1545349363d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 0ee7de87-76ad-48ae-8bcd-93b2792a96cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance b3dd183e-7ab1-40ae-b282-40575a9e47df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 182d8fc2-0246-4164-9d1b-f970cec4dd1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance d8f302f1-7c20-483a-9eef-24566d51143d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:22:29 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:22:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:39 user nova-compute[73188]: INFO nova.compute.manager [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Terminating instance
Aug 15 19:22:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:22:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-146dcaa8-c1df-4504-be7f-74a9962ddde8 req-68f71578-edc3-4273-b043-ac624b76fd2c service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Received event network-vif-unplugged-0cbee9cd-128c-4c6d-ae87-7368a786fc4a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-146dcaa8-c1df-4504-be7f-74a9962ddde8 req-68f71578-edc3-4273-b043-ac624b76fd2c service nova] Acquiring lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-146dcaa8-c1df-4504-be7f-74a9962ddde8 req-68f71578-edc3-4273-b043-ac624b76fd2c service nova] Lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-146dcaa8-c1df-4504-be7f-74a9962ddde8 req-68f71578-edc3-4273-b043-ac624b76fd2c service nova] Lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-146dcaa8-c1df-4504-be7f-74a9962ddde8 req-68f71578-edc3-4273-b043-ac624b76fd2c service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] No waiting events found dispatching network-vif-unplugged-0cbee9cd-128c-4c6d-ae87-7368a786fc4a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-146dcaa8-c1df-4504-be7f-74a9962ddde8 req-68f71578-edc3-4273-b043-ac624b76fd2c service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Received event network-vif-unplugged-0cbee9cd-128c-4c6d-ae87-7368a786fc4a for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127345.2850318, 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:22:40 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] VM Stopped (Lifecycle Event)
Aug 15 19:22:40 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3ca25728-57f6-499c-ac8e-d0862f217e65 None None] [instance: 7bf6cd67-4ced-4dd4-8b8f-9cd6c4151430] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:40 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Instance destroyed successfully.
Aug 15 19:22:40 user nova-compute[73188]: DEBUG nova.objects.instance [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lazy-loading 'resources' on Instance uuid 182d8fc2-0246-4164-9d1b-f970cec4dd1f {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:17:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1194111157',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1194111157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1194111157',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPm9uRwYTSBr41Ixw3dA9zOUiH+SXU/WNc83Riw/EuxfKCbSUKOM/Rk3SNnV+mTZTHOX/QJ7Q/VUhKG65xfkeV7xJzkhCvXhhNedknho65gyrjSf6wYu6j707o+CzVPGBQ==',key_name='tempest-keypair-1108957145',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:18:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18eadba32f4547ad9436aca9285b7aad',ramdisk_id='',reservation_id='r-9rw82irz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2114363476',owner_user_name='tempest-TestVolumeBootPattern-2114363476-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9503705066e5402cb569fae3b2bd8976',uuid=182d8fc2-0246-4164-9d1b-f970cec4dd1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cbee9cd-128c-4c6d-ae87-7368a786fc4a", "address": "fa:16:3e:b8:b6:ca", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cbee9cd-12", "ovs_interfaceid": "0cbee9cd-128c-4c6d-ae87-7368a786fc4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converting VIF {"id": "0cbee9cd-128c-4c6d-ae87-7368a786fc4a", "address": "fa:16:3e:b8:b6:ca", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cbee9cd-12", "ovs_interfaceid": "0cbee9cd-128c-4c6d-ae87-7368a786fc4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:b6:ca,bridge_name='br-int',has_traffic_filtering=True,id=0cbee9cd-128c-4c6d-ae87-7368a786fc4a,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cbee9cd-12') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG os_vif [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:b6:ca,bridge_name='br-int',has_traffic_filtering=True,id=0cbee9cd-128c-4c6d-ae87-7368a786fc4a,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cbee9cd-12') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cbee9cd-12, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:22:40 user nova-compute[73188]: INFO os_vif [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:b6:ca,bridge_name='br-int',has_traffic_filtering=True,id=0cbee9cd-128c-4c6d-ae87-7368a786fc4a,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cbee9cd-12')
Aug 15 19:22:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYUJsDQH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:22:40 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:22:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a8f728-cbb0-46ba-92d0-a01f8279982e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d49339-8daa-4617-90bc-5fb3774d8b43]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:22:40 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:22:40 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:22:40 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:22:40 user nova-compute[73188]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:22:40 user nova-compute[73188]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)
Aug 15 19:22:40 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:22:40 user nova-compute[73188]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 (non-flash)
Aug 15 19:22:40 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:22:40 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:22:40 user nova-compute[73188]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:22:40 user nova-compute[73188]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)
Aug 15 19:22:40 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f280818a290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5'): ({'sdd'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Removing single pathed devices sdd {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b351881b-32f4-45f5-a69f-25775dbcaeb2]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[382c0b88-6cc0-4ebd-b1db-c68a1b3bdfbe]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Flushing IO for device /dev/sdd {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d723df7-b7d9-4f7a-bf2c-5b115a6acd97]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c44d4f6-ebcc-49e8-bb6e-0032877da1d2]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] SCSI volumes sdd have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23737663263646634', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bda8b8c', '/dev/disk/by-id/scsi-1SCST_BIObda8b8c-77f2cdf481db9292') {{(pid=83967) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[865a7ef0-c11a-4cc8-897a-0daf0dbfd777]: (4, None) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[122d2b75-39e7-4228-a661-a9c969717d47]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7337510c-1b22-4f80-98b0-886091f9b6a5]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5, portal: 172.16.0.220,3260]
Aug 15 19:22:40 user nova-compute[73188]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5, portal: 172.16.0.220,3260] successful.
Aug 15 19:22:40 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a60ae2c3-8dfc-437a-ad71-0caf688c19f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30d9679-8653-448f-a1d7-78f98ca55606]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] <== disconnect_volume: return (325ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:22:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:22:40 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Deleting instance files /opt/stack/data/nova/instances/182d8fc2-0246-4164-9d1b-f970cec4dd1f_del
Aug 15 19:22:40 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Deletion of /opt/stack/data/nova/instances/182d8fc2-0246-4164-9d1b-f970cec4dd1f_del complete
Aug 15 19:22:41 user nova-compute[73188]: INFO nova.compute.manager [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 15 19:22:41 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:22:41 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:22:41 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:22:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:41 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:22:41 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Took 0.85 seconds to deallocate network for instance.
Aug 15 19:22:42 user nova-compute[73188]: DEBUG nova.compute.manager [req-fc27621c-470c-4453-8d7c-98b90aa27ee1 req-b960994c-c049-4a10-8229-09f8ff20ad57 service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Received event network-vif-plugged-0cbee9cd-128c-4c6d-ae87-7368a786fc4a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:22:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fc27621c-470c-4453-8d7c-98b90aa27ee1 req-b960994c-c049-4a10-8229-09f8ff20ad57 service nova] Acquiring lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fc27621c-470c-4453-8d7c-98b90aa27ee1 req-b960994c-c049-4a10-8229-09f8ff20ad57 service nova] Lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fc27621c-470c-4453-8d7c-98b90aa27ee1 req-b960994c-c049-4a10-8229-09f8ff20ad57 service nova] Lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:42 user nova-compute[73188]: DEBUG nova.compute.manager [req-fc27621c-470c-4453-8d7c-98b90aa27ee1 req-b960994c-c049-4a10-8229-09f8ff20ad57 service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] No waiting events found dispatching network-vif-plugged-0cbee9cd-128c-4c6d-ae87-7368a786fc4a {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:22:42 user nova-compute[73188]: WARNING nova.compute.manager [req-fc27621c-470c-4453-8d7c-98b90aa27ee1 req-b960994c-c049-4a10-8229-09f8ff20ad57 service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Received unexpected event network-vif-plugged-0cbee9cd-128c-4c6d-ae87-7368a786fc4a for instance with vm_state active and task_state deleting.
Aug 15 19:22:42 user nova-compute[73188]: DEBUG nova.compute.manager [req-fc27621c-470c-4453-8d7c-98b90aa27ee1 req-b960994c-c049-4a10-8229-09f8ff20ad57 service nova] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Received event network-vif-deleted-0cbee9cd-128c-4c6d-ae87-7368a786fc4a {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:22:42 user nova-compute[73188]: INFO nova.compute.manager [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Took 0.77 seconds to detach 1 volumes for instance.
Aug 15 19:22:42 user nova-compute[73188]: DEBUG nova.compute.manager [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Deleting volume: a60ae2c3-8dfc-437a-ad71-0caf688c19f5 {{(pid=73188) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 19:22:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:43 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:22:43 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:22:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:43 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Deleted allocations for instance 182d8fc2-0246-4164-9d1b-f970cec4dd1f
Aug 15 19:22:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-692f3447-23ba-4953-881a-e1e62278e865 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "182d8fc2-0246-4164-9d1b-f970cec4dd1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.463s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:55 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127360.5886543, 182d8fc2-0246-4164-9d1b-f970cec4dd1f => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:22:55 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] VM Stopped (Lifecycle Event)
Aug 15 19:22:55 user nova-compute[73188]: DEBUG nova.compute.manager [None req-0e6fde62-5a5b-4bf0-856e-18211204f2f4 None None] [instance: 182d8fc2-0246-4164-9d1b-f970cec4dd1f] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:22:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:55 user nova-compute[73188]: DEBUG nova.compute.manager [req-f7790848-3800-4a51-99ec-07758c2ce593 req-790f5c45-88a9-4447-ba47-8495acc3db73 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Received event network-changed-4646dbfd-e829-4653-9e76-e34901f8ad33 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:22:55 user nova-compute[73188]: DEBUG nova.compute.manager [req-f7790848-3800-4a51-99ec-07758c2ce593 req-790f5c45-88a9-4447-ba47-8495acc3db73 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Refreshing instance network info cache due to event network-changed-4646dbfd-e829-4653-9e76-e34901f8ad33. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:22:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f7790848-3800-4a51-99ec-07758c2ce593 req-790f5c45-88a9-4447-ba47-8495acc3db73 service nova] Acquiring lock "refresh_cache-e00adf53-085f-436d-a09f-e97e92ca79cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:22:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f7790848-3800-4a51-99ec-07758c2ce593 req-790f5c45-88a9-4447-ba47-8495acc3db73 service nova] Acquired lock "refresh_cache-e00adf53-085f-436d-a09f-e97e92ca79cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:22:55 user nova-compute[73188]: DEBUG nova.network.neutron [req-f7790848-3800-4a51-99ec-07758c2ce593 req-790f5c45-88a9-4447-ba47-8495acc3db73 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Refreshing network info cache for port 4646dbfd-e829-4653-9e76-e34901f8ad33 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:22:56 user nova-compute[73188]: DEBUG nova.network.neutron [req-f7790848-3800-4a51-99ec-07758c2ce593 req-790f5c45-88a9-4447-ba47-8495acc3db73 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Updated VIF entry in instance network info cache for port 4646dbfd-e829-4653-9e76-e34901f8ad33. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:22:56 user nova-compute[73188]: DEBUG nova.network.neutron [req-f7790848-3800-4a51-99ec-07758c2ce593 req-790f5c45-88a9-4447-ba47-8495acc3db73 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Updating instance_info_cache with network_info: [{"id": "4646dbfd-e829-4653-9e76-e34901f8ad33", "address": "fa:16:3e:db:be:12", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4646dbfd-e8", "ovs_interfaceid": "4646dbfd-e829-4653-9e76-e34901f8ad33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:22:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f7790848-3800-4a51-99ec-07758c2ce593 req-790f5c45-88a9-4447-ba47-8495acc3db73 service nova] Releasing lock "refresh_cache-e00adf53-085f-436d-a09f-e97e92ca79cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:22:57 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Stashing vm_state: active {{(pid=73188) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 15 19:22:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:57 user nova-compute[73188]: DEBUG nova.objects.instance [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'pci_requests' on Instance uuid e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:22:57 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:22:57 user nova-compute[73188]: INFO nova.compute.claims [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Claim successful on node user
Aug 15 19:22:57 user nova-compute[73188]: DEBUG nova.objects.instance [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'resources' on Instance uuid e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:22:57 user nova-compute[73188]: DEBUG nova.objects.instance [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'pci_devices' on Instance uuid e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:22:57 user nova-compute[73188]: INFO nova.compute.resource_tracker [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Updating resource usage from migration 4a3ee4d1-3b41-46d2-a271-c65e9470eca5
Aug 15 19:22:57 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:22:57 user nova-compute[73188]: DEBUG nova.compute.manager [req-9f985e96-5870-4c2b-b2b3-c172d5b1ef56 req-24179f17-3eee-4c46-bf7a-3604a4c1d933 service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Received event network-changed-35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:22:57 user nova-compute[73188]: DEBUG nova.compute.manager [req-9f985e96-5870-4c2b-b2b3-c172d5b1ef56 req-24179f17-3eee-4c46-bf7a-3604a4c1d933 service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Refreshing instance network info cache due to event network-changed-35b20fd1-f9c9-4cd7-8744-77f418bd0428. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:22:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9f985e96-5870-4c2b-b2b3-c172d5b1ef56 req-24179f17-3eee-4c46-bf7a-3604a4c1d933 service nova] Acquiring lock "refresh_cache-e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:22:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9f985e96-5870-4c2b-b2b3-c172d5b1ef56 req-24179f17-3eee-4c46-bf7a-3604a4c1d933 service nova] Acquired lock "refresh_cache-e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:22:57 user nova-compute[73188]: DEBUG nova.network.neutron [req-9f985e96-5870-4c2b-b2b3-c172d5b1ef56 req-24179f17-3eee-4c46-bf7a-3604a4c1d933 service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Refreshing network info cache for port 35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:22:57 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:22:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.456s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:57 user nova-compute[73188]: INFO nova.compute.manager [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Migrating
Aug 15 19:22:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "refresh_cache-e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:22:58 user nova-compute[73188]: DEBUG nova.network.neutron [req-9f985e96-5870-4c2b-b2b3-c172d5b1ef56 req-24179f17-3eee-4c46-bf7a-3604a4c1d933 service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Updated VIF entry in instance network info cache for port 35b20fd1-f9c9-4cd7-8744-77f418bd0428. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:22:58 user nova-compute[73188]: DEBUG nova.network.neutron [req-9f985e96-5870-4c2b-b2b3-c172d5b1ef56 req-24179f17-3eee-4c46-bf7a-3604a4c1d933 service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Updating instance_info_cache with network_info: [{"id": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "address": "fa:16:3e:20:ae:90", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b20fd1-f9", "ovs_interfaceid": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:22:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9f985e96-5870-4c2b-b2b3-c172d5b1ef56 req-24179f17-3eee-4c46-bf7a-3604a4c1d933 service nova] Releasing lock "refresh_cache-e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:22:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquired lock "refresh_cache-e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:22:58 user nova-compute[73188]: DEBUG nova.network.neutron [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:22:58 user nova-compute[73188]: DEBUG nova.network.neutron [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Updating instance_info_cache with network_info: [{"id": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "address": "fa:16:3e:20:ae:90", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b20fd1-f9", "ovs_interfaceid": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:22:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Releasing lock "refresh_cache-e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:22:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Starting migrate_disk_and_power_off {{(pid=73188) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 15 19:22:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:59 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Instance destroyed successfully.
Aug 15 19:22:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1831045405',display_name='tempest-ServerActionsTestOtherA-server-1831045405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1831045405',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIh7IYSXIzW76yUh0lcXYRIDkLihwOuaxeqKxDoqlHxog01X1wGWUVb+WSkm+7EoRfQvo2EKI4l4BqBnCc2BP7hJFNq/yIn4BoRVp0zONEwe3FPB6tn+4jOCYVx7bU/R3g==',key_name='tempest-keypair-1497630278',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:21:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3c085a0ccf841e297d98037c07a7111',ramdisk_id='',reservation_id='r-gn04qlii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2026424764',owner_user_name='tempest-ServerActionsTestOtherA-2026424764-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:22:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30de55a2834422c8f6df816899b881e',uuid=e0d0b28d-602f-47dd-a798-2d9c54b1a2c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "address": "fa:16:3e:20:ae:90", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-473389578-network", "vif_mac": "fa:16:3e:20:ae:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b20fd1-f9", "ovs_interfaceid": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converting VIF {"id": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "address": "fa:16:3e:20:ae:90", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-473389578-network", "vif_mac": "fa:16:3e:20:ae:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b20fd1-f9", "ovs_interfaceid": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:ae:90,bridge_name='br-int',has_traffic_filtering=True,id=35b20fd1-f9c9-4cd7-8744-77f418bd0428,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35b20fd1-f9') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG os_vif [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:ae:90,bridge_name='br-int',has_traffic_filtering=True,id=35b20fd1-f9c9-4cd7-8744-77f418bd0428,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35b20fd1-f9') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35b20fd1-f9, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:22:59 user nova-compute[73188]: INFO os_vif [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:ae:90,bridge_name='br-int',has_traffic_filtering=True,id=35b20fd1-f9c9-4cd7-8744-77f418bd0428,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35b20fd1-f9')
Aug 15 19:22:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RbgQdsPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:22:59 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:22:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d362f99-5a78-4200-931f-6ede68a353b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[253132a4-de58-4622-99a2-eb8f4476ad10]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:22:59 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:22:59 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:22:59 user nova-compute[73188]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:22:59 user nova-compute[73188]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)
Aug 15 19:22:59 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:22:59 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:22:59 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:22:59 user nova-compute[73188]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:22:59 user nova-compute[73188]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)
Aug 15 19:22:59 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f280832a050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69'): ({'sdi'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Removing single pathed devices sdi {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3599ce-2671-47e1-a4a6-c16ab114aab8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ccd767-6aea-4860-b77a-7d8da2000532]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Flushing IO for device /dev/sdi {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG nova.compute.manager [req-b3839859-6684-4927-b41b-6b298569d131 req-8e1c72f2-91a0-4cda-a888-6cb2b085453a service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Received event network-vif-unplugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b3839859-6684-4927-b41b-6b298569d131 req-8e1c72f2-91a0-4cda-a888-6cb2b085453a service nova] Acquiring lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b3839859-6684-4927-b41b-6b298569d131 req-8e1c72f2-91a0-4cda-a888-6cb2b085453a service nova] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b3839859-6684-4927-b41b-6b298569d131 req-8e1c72f2-91a0-4cda-a888-6cb2b085453a service nova] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG nova.compute.manager [req-b3839859-6684-4927-b41b-6b298569d131 req-8e1c72f2-91a0-4cda-a888-6cb2b085453a service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] No waiting events found dispatching network-vif-unplugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:22:59 user nova-compute[73188]: WARNING nova.compute.manager [req-b3839859-6684-4927-b41b-6b298569d131 req-8e1c72f2-91a0-4cda-a888-6cb2b085453a service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Received unexpected event network-vif-unplugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 for instance with vm_state active and task_state resize_migrating.
Aug 15 19:22:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb2bfb5-a1d0-4f23-b7a4-cd18481d5d2e]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:22:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.046s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d511f94-cf48-4b6f-ad43-0fff35085728]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] SCSI volumes sdi have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_907b1451', '/dev/disk/by-id/scsi-1SCST_BIO907b1451-b3910d69a43a6962', '/dev/disk/by-id/scsi-26233393130643639') {{(pid=83967) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[247ff63e-0221-4d36-82dd-305934756611]: (4, None) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86a6d8d-a406-4c8d-bea1-ce390d5ee7eb]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a76e71b-ce18-47bb-ae09-75dd9de01fb0]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69, portal: 172.16.0.220,3260]
Aug 15 19:23:00 user nova-compute[73188]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69, portal: 172.16.0.220,3260] successful.
Aug 15 19:23:00 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b90661-69bc-4cd8-839e-6da6c0d5a592]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] <== disconnect_volume: return (321ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:23:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] skipping disk /dev/sdi (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:23:01 user nova-compute[73188]: DEBUG nova.network.neutron [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Port 35b20fd1-f9c9-4cd7-8744-77f418bd0428 binding to destination host user is already ACTIVE {{(pid=73188) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 19:23:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "refresh_cache-e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:23:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquired lock "refresh_cache-e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:23:01 user nova-compute[73188]: DEBUG nova.network.neutron [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:23:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "3e0ab835-00ac-4db2-a93f-257559fa29b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "3e0ab835-00ac-4db2-a93f-257559fa29b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:01 user nova-compute[73188]: DEBUG nova.compute.manager [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:23:01 user nova-compute[73188]: DEBUG nova.network.neutron [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Updating instance_info_cache with network_info: [{"id": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "address": "fa:16:3e:20:ae:90", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b20fd1-f9", "ovs_interfaceid": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:23:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Releasing lock "refresh_cache-e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:23:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:01 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:23:01 user nova-compute[73188]: INFO nova.compute.claims [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Claim successful on node user
Aug 15 19:23:01 user nova-compute[73188]: DEBUG os_brick.utils [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:23:01 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:01 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:01 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01ce11f-fe33-4fb3-a21d-3dc81ccfe660]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c8534e-1abd-4ad5-9866-c5c5ead38eeb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc065d07-426b-40e4-a0b2-1a6aa25ff102]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68fa055-96cb-46c6-96ee-821127002803]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG nova.compute.manager [req-7a2777f8-5a25-4766-bbdd-7dea1b0556e4 req-f22e45ff-49ad-4484-a355-e096e05e71ea service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Received event network-vif-plugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7a2777f8-5a25-4766-bbdd-7dea1b0556e4 req-f22e45ff-49ad-4484-a355-e096e05e71ea service nova] Acquiring lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7a2777f8-5a25-4766-bbdd-7dea1b0556e4 req-f22e45ff-49ad-4484-a355-e096e05e71ea service nova] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7a2777f8-5a25-4766-bbdd-7dea1b0556e4 req-f22e45ff-49ad-4484-a355-e096e05e71ea service nova] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG nova.compute.manager [req-7a2777f8-5a25-4766-bbdd-7dea1b0556e4 req-f22e45ff-49ad-4484-a355-e096e05e71ea service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] No waiting events found dispatching network-vif-plugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:23:02 user nova-compute[73188]: WARNING nova.compute.manager [req-7a2777f8-5a25-4766-bbdd-7dea1b0556e4 req-f22e45ff-49ad-4484-a355-e096e05e71ea service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Received unexpected event network-vif-plugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 for instance with vm_state active and task_state resize_finish.
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:23:02 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f971aa84-6cb9-4aa8-9610-c9a79d3e01fb]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG os_brick.utils [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG nova.network.neutron [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:23:02 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:23:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG nova.policy [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b8737b83c944ab2bed468f6ea5cd8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72b50bc97b84e3dac8161b6a36f50ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:23:02 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Creating image(s)
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "/opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "/opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.179s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.196s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/disk 1073741824" returned: 0 in 0.049s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:03 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:23:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:03 user nova-compute[73188]: DEBUG nova.network.neutron [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Successfully created port: 793141da-bf20-4bd2-9fec-c6ecde2601ff {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:23:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:03 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Cannot resize image /opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:23:03 user nova-compute[73188]: DEBUG nova.objects.instance [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lazy-loading 'migration_context' on Instance uuid 3e0ab835-00ac-4db2-a93f-257559fa29b6 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:23:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:23:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Ensure instance console log exists: /opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:23:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:04 user nova-compute[73188]: DEBUG nova.network.neutron [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Successfully updated port: 793141da-bf20-4bd2-9fec-c6ecde2601ff {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:23:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "refresh_cache-3e0ab835-00ac-4db2-a93f-257559fa29b6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:23:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquired lock "refresh_cache-3e0ab835-00ac-4db2-a93f-257559fa29b6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:23:04 user nova-compute[73188]: DEBUG nova.network.neutron [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:23:04 user nova-compute[73188]: DEBUG nova.compute.manager [req-ceeec737-161d-48b5-a586-ef163ccfce6f req-4d5f3ae7-4d2b-40bb-b1a3-7abf4df8def4 service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Received event network-changed-793141da-bf20-4bd2-9fec-c6ecde2601ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:23:04 user nova-compute[73188]: DEBUG nova.compute.manager [req-ceeec737-161d-48b5-a586-ef163ccfce6f req-4d5f3ae7-4d2b-40bb-b1a3-7abf4df8def4 service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Refreshing instance network info cache due to event network-changed-793141da-bf20-4bd2-9fec-c6ecde2601ff. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:23:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ceeec737-161d-48b5-a586-ef163ccfce6f req-4d5f3ae7-4d2b-40bb-b1a3-7abf4df8def4 service nova] Acquiring lock "refresh_cache-3e0ab835-00ac-4db2-a93f-257559fa29b6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:23:04 user nova-compute[73188]: DEBUG nova.network.neutron [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:23:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.network.neutron [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Updating instance_info_cache with network_info: [{"id": "793141da-bf20-4bd2-9fec-c6ecde2601ff", "address": "fa:16:3e:3b:96:24", "network": {"id": "852c135b-1d66-4329-8090-3770310ffce0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1628017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72b50bc97b84e3dac8161b6a36f50ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793141da-bf", "ovs_interfaceid": "793141da-bf20-4bd2-9fec-c6ecde2601ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Releasing lock "refresh_cache-3e0ab835-00ac-4db2-a93f-257559fa29b6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Instance network_info: |[{"id": "793141da-bf20-4bd2-9fec-c6ecde2601ff", "address": "fa:16:3e:3b:96:24", "network": {"id": "852c135b-1d66-4329-8090-3770310ffce0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1628017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72b50bc97b84e3dac8161b6a36f50ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793141da-bf", "ovs_interfaceid": "793141da-bf20-4bd2-9fec-c6ecde2601ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ceeec737-161d-48b5-a586-ef163ccfce6f req-4d5f3ae7-4d2b-40bb-b1a3-7abf4df8def4 service nova] Acquired lock "refresh_cache-3e0ab835-00ac-4db2-a93f-257559fa29b6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.network.neutron [req-ceeec737-161d-48b5-a586-ef163ccfce6f req-4d5f3ae7-4d2b-40bb-b1a3-7abf4df8def4 service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Refreshing network info cache for port 793141da-bf20-4bd2-9fec-c6ecde2601ff {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Start _get_guest_xml network_info=[{"id": "793141da-bf20-4bd2-9fec-c6ecde2601ff", "address": "fa:16:3e:3b:96:24", "network": {"id": "852c135b-1d66-4329-8090-3770310ffce0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1628017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72b50bc97b84e3dac8161b6a36f50ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793141da-bf", "ovs_interfaceid": "793141da-bf20-4bd2-9fec-c6ecde2601ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:23:05 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:23:05 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:23:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1725827429',display_name='tempest-VolumesSnapshotTestJSON-instance-1725827429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1725827429',id=37,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8dd34O2k+aiK3dRfEhHchtPUkWEYMWBCi4bGQxayK4YhAgavRbDKE8DArC5ouNgilgGSKOb/hzkRIDwU3NL5GKb6T9KMYVn6IkVI+IpF5C/wdbOpvcbTY8mScX4sOLug==',key_name='tempest-keypair-1398743821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f72b50bc97b84e3dac8161b6a36f50ab',ramdisk_id='',reservation_id='r-sv9anlld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-564329204',owner_user_name='tempest-VolumesSnapshotTestJSON-564329204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b8737b83c944ab2bed468f6ea5cd8ee',uuid=3e0ab835-00ac-4db2-a93f-257559fa29b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "793141da-bf20-4bd2-9fec-c6ecde2601ff", "address": "fa:16:3e:3b:96:24", "network": {"id": "852c135b-1d66-4329-8090-3770310ffce0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1628017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72b50bc97b84e3dac8161b6a36f50ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793141da-bf", "ovs_interfaceid": "793141da-bf20-4bd2-9fec-c6ecde2601ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Converting VIF {"id": "793141da-bf20-4bd2-9fec-c6ecde2601ff", "address": "fa:16:3e:3b:96:24", "network": {"id": "852c135b-1d66-4329-8090-3770310ffce0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1628017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72b50bc97b84e3dac8161b6a36f50ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793141da-bf", "ovs_interfaceid": "793141da-bf20-4bd2-9fec-c6ecde2601ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:96:24,bridge_name='br-int',has_traffic_filtering=True,id=793141da-bf20-4bd2-9fec-c6ecde2601ff,network=Network(852c135b-1d66-4329-8090-3770310ffce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793141da-bf') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.objects.instance [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e0ab835-00ac-4db2-a93f-257559fa29b6 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:23:05 user nova-compute[73188]:   <uuid>3e0ab835-00ac-4db2-a93f-257559fa29b6</uuid>
Aug 15 19:23:05 user nova-compute[73188]:   <name>instance-00000025</name>
Aug 15 19:23:05 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:23:05 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:23:05 user nova-compute[73188]:   <metadata>
Aug 15 19:23:05 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:23:05 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:23:05 user nova-compute[73188]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1725827429</nova:name>
Aug 15 19:23:05 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:23:05</nova:creationTime>
Aug 15 19:23:05 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:23:05 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:23:05 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:23:05 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:23:05 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:23:05 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:23:05 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:23:05 user nova-compute[73188]:       <nova:owner>
Aug 15 19:23:05 user nova-compute[73188]:         <nova:user uuid="0b8737b83c944ab2bed468f6ea5cd8ee">tempest-VolumesSnapshotTestJSON-564329204-project-member</nova:user>
Aug 15 19:23:05 user nova-compute[73188]:         <nova:project uuid="f72b50bc97b84e3dac8161b6a36f50ab">tempest-VolumesSnapshotTestJSON-564329204</nova:project>
Aug 15 19:23:05 user nova-compute[73188]:       </nova:owner>
Aug 15 19:23:05 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:23:05 user nova-compute[73188]:       <nova:ports>
Aug 15 19:23:05 user nova-compute[73188]:         <nova:port uuid="793141da-bf20-4bd2-9fec-c6ecde2601ff">
Aug 15 19:23:05 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 19:23:05 user nova-compute[73188]:         </nova:port>
Aug 15 19:23:05 user nova-compute[73188]:       </nova:ports>
Aug 15 19:23:05 user nova-compute[73188]:     </nova:instance>
Aug 15 19:23:05 user nova-compute[73188]:   </metadata>
Aug 15 19:23:05 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:23:05 user nova-compute[73188]:     <system>
Aug 15 19:23:05 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:23:05 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:23:05 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:23:05 user nova-compute[73188]:       <entry name="serial">3e0ab835-00ac-4db2-a93f-257559fa29b6</entry>
Aug 15 19:23:05 user nova-compute[73188]:       <entry name="uuid">3e0ab835-00ac-4db2-a93f-257559fa29b6</entry>
Aug 15 19:23:05 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:23:05 user nova-compute[73188]:     </system>
Aug 15 19:23:05 user nova-compute[73188]:   </sysinfo>
Aug 15 19:23:05 user nova-compute[73188]:   <os>
Aug 15 19:23:05 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:23:05 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:23:05 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:23:05 user nova-compute[73188]:   </os>
Aug 15 19:23:05 user nova-compute[73188]:   <features>
Aug 15 19:23:05 user nova-compute[73188]:     <acpi/>
Aug 15 19:23:05 user nova-compute[73188]:     <apic/>
Aug 15 19:23:05 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:23:05 user nova-compute[73188]:   </features>
Aug 15 19:23:05 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:23:05 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:23:05 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:23:05 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:23:05 user nova-compute[73188]:   </clock>
Aug 15 19:23:05 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:23:05 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:23:05 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:23:05 user nova-compute[73188]:   </cpu>
Aug 15 19:23:05 user nova-compute[73188]:   <devices>
Aug 15 19:23:05 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:23:05 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:23:05 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/disk"/>
Aug 15 19:23:05 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:23:05 user nova-compute[73188]:     </disk>
Aug 15 19:23:05 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:23:05 user nova-compute[73188]:       <mac address="fa:16:3e:3b:96:24"/>
Aug 15 19:23:05 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:23:05 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:23:05 user nova-compute[73188]:       <target dev="tap793141da-bf"/>
Aug 15 19:23:05 user nova-compute[73188]:     </interface>
Aug 15 19:23:05 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:23:05 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/console.log" append="off"/>
Aug 15 19:23:05 user nova-compute[73188]:     </serial>
Aug 15 19:23:05 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:23:05 user nova-compute[73188]:     <video>
Aug 15 19:23:05 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:23:05 user nova-compute[73188]:     </video>
Aug 15 19:23:05 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:23:05 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:23:05 user nova-compute[73188]:     </rng>
Aug 15 19:23:05 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:23:05 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:23:05 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:23:05 user nova-compute[73188]:     </memballoon>
Aug 15 19:23:05 user nova-compute[73188]:   </devices>
Aug 15 19:23:05 user nova-compute[73188]: </domain>
Aug 15 19:23:05 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:23:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1725827429',display_name='tempest-VolumesSnapshotTestJSON-instance-1725827429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1725827429',id=37,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8dd34O2k+aiK3dRfEhHchtPUkWEYMWBCi4bGQxayK4YhAgavRbDKE8DArC5ouNgilgGSKOb/hzkRIDwU3NL5GKb6T9KMYVn6IkVI+IpF5C/wdbOpvcbTY8mScX4sOLug==',key_name='tempest-keypair-1398743821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f72b50bc97b84e3dac8161b6a36f50ab',ramdisk_id='',reservation_id='r-sv9anlld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-564329204',owner_user_name='tempest-VolumesSnapshotTestJSON-564329204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b8737b83c944ab2bed468f6ea5cd8ee',uuid=3e0ab835-00ac-4db2-a93f-257559fa29b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "793141da-bf20-4bd2-9fec-c6ecde2601ff", "address": "fa:16:3e:3b:96:24", "network": {"id": "852c135b-1d66-4329-8090-3770310ffce0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1628017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72b50bc97b84e3dac8161b6a36f50ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793141da-bf", "ovs_interfaceid": "793141da-bf20-4bd2-9fec-c6ecde2601ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Converting VIF {"id": "793141da-bf20-4bd2-9fec-c6ecde2601ff", "address": "fa:16:3e:3b:96:24", "network": {"id": "852c135b-1d66-4329-8090-3770310ffce0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1628017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72b50bc97b84e3dac8161b6a36f50ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793141da-bf", "ovs_interfaceid": "793141da-bf20-4bd2-9fec-c6ecde2601ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:96:24,bridge_name='br-int',has_traffic_filtering=True,id=793141da-bf20-4bd2-9fec-c6ecde2601ff,network=Network(852c135b-1d66-4329-8090-3770310ffce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793141da-bf') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG os_vif [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:96:24,bridge_name='br-int',has_traffic_filtering=True,id=793141da-bf20-4bd2-9fec-c6ecde2601ff,network=Network(852c135b-1d66-4329-8090-3770310ffce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793141da-bf') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap793141da-bf, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap793141da-bf, col_values=(('external_ids', {'iface-id': '793141da-bf20-4bd2-9fec-c6ecde2601ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:96:24', 'vm-uuid': '3e0ab835-00ac-4db2-a93f-257559fa29b6'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:05 user nova-compute[73188]: INFO os_vif [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:96:24,bridge_name='br-int',has_traffic_filtering=True,id=793141da-bf20-4bd2-9fec-c6ecde2601ff,network=Network(852c135b-1d66-4329-8090-3770310ffce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793141da-bf')
Aug 15 19:23:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:05 user nova-compute[73188]: INFO nova.compute.manager [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Detaching volume b3f95f50-bd8d-4060-84ed-1f597c7a09ab
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] No VIF found with MAC fa:16:3e:3b:96:24, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:23:05 user nova-compute[73188]: INFO nova.virt.block_device [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Attempting to driver detach volume b3f95f50-bd8d-4060-84ed-1f597c7a09ab from mountpoint /dev/vdb
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Attempting to detach device vdb from instance b3dd183e-7ab1-40ae-b282-40575a9e47df from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:23:05 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:23:05 user nova-compute[73188]:   <source dev="/dev/sde"/>
Aug 15 19:23:05 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:23:05 user nova-compute[73188]:   <serial>b3f95f50-bd8d-4060-84ed-1f597c7a09ab</serial>
Aug 15 19:23:05 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 19:23:05 user nova-compute[73188]: </disk>
Aug 15 19:23:05 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:23:05 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Successfully detached device vdb from instance b3dd183e-7ab1-40ae-b282-40575a9e47df from the persistent domain config.
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b3dd183e-7ab1-40ae-b282-40575a9e47df from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:23:05 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:23:05 user nova-compute[73188]:   <source dev="/dev/sde"/>
Aug 15 19:23:05 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:23:05 user nova-compute[73188]:   <serial>b3f95f50-bd8d-4060-84ed-1f597c7a09ab</serial>
Aug 15 19:23:05 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 19:23:05 user nova-compute[73188]: </disk>
Aug 15 19:23:05 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.network.neutron [req-ceeec737-161d-48b5-a586-ef163ccfce6f req-4d5f3ae7-4d2b-40bb-b1a3-7abf4df8def4 service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Updated VIF entry in instance network info cache for port 793141da-bf20-4bd2-9fec-c6ecde2601ff. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.network.neutron [req-ceeec737-161d-48b5-a586-ef163ccfce6f req-4d5f3ae7-4d2b-40bb-b1a3-7abf4df8def4 service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Updating instance_info_cache with network_info: [{"id": "793141da-bf20-4bd2-9fec-c6ecde2601ff", "address": "fa:16:3e:3b:96:24", "network": {"id": "852c135b-1d66-4329-8090-3770310ffce0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1628017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72b50bc97b84e3dac8161b6a36f50ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793141da-bf", "ovs_interfaceid": "793141da-bf20-4bd2-9fec-c6ecde2601ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ceeec737-161d-48b5-a586-ef163ccfce6f req-4d5f3ae7-4d2b-40bb-b1a3-7abf4df8def4 service nova] Releasing lock "refresh_cache-3e0ab835-00ac-4db2-a93f-257559fa29b6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692127385.877724, b3dd183e-7ab1-40ae-b282-40575a9e47df => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:23:05 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Successfully detached device vdb from instance b3dd183e-7ab1-40ae-b282-40575a9e47df from the live domain config.
Aug 15 19:23:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpyxgIPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:23:05 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:23:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[edae332d-581a-418a-acc8-d25708d0b174]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3f4042-dcde-4ecf-b80e-1466a6321479]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:23:05 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:23:05 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:23:05 user nova-compute[73188]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)
Aug 15 19:23:05 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:23:05 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:23:05 user nova-compute[73188]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab (non-flash)
Aug 15 19:23:05 user nova-compute[73188]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)
Aug 15 19:23:05 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2808783be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab'): ({'sde'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Removing single pathed devices sde {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50559bc-5b66-4b23-9ab8-a69827b75367]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee98971-28ce-46a1-b29f-73ecd4e43a34]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Flushing IO for device /dev/sde {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:23:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fb8769-68f8-4b6d-bf74-ff04606d1f32]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d8f09f-6281-4640-b891-2d7d8d9f1d81]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] SCSI volumes sde have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b04b0b-135d-4ab5-9d1b-d2202bba100a]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffe9927-ce29-4213-9020-51ef5efacd09]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab, portal: 172.16.0.220,3260]
Aug 15 19:23:06 user nova-compute[73188]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab, portal: 172.16.0.220,3260] successful.
Aug 15 19:23:06 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f95f50-bd8d-4060-84ed-1f597c7a09ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db67e8c-8a1a-443d-b2e3-919e002598b4]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] <== disconnect_volume: return (273ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG nova.objects.instance [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'flavor' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:23:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-994eb50c-63a2-432c-94f3-abe48ecbe97a tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.770s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-6b93b799-43e6-453a-83f7-6fa4f86bb7ec req-6854665a-e426-437c-a4f3-d6eb303cb512 service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Received event network-vif-plugged-793141da-bf20-4bd2-9fec-c6ecde2601ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:23:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6b93b799-43e6-453a-83f7-6fa4f86bb7ec req-6854665a-e426-437c-a4f3-d6eb303cb512 service nova] Acquiring lock "3e0ab835-00ac-4db2-a93f-257559fa29b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6b93b799-43e6-453a-83f7-6fa4f86bb7ec req-6854665a-e426-437c-a4f3-d6eb303cb512 service nova] Lock "3e0ab835-00ac-4db2-a93f-257559fa29b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6b93b799-43e6-453a-83f7-6fa4f86bb7ec req-6854665a-e426-437c-a4f3-d6eb303cb512 service nova] Lock "3e0ab835-00ac-4db2-a93f-257559fa29b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-6b93b799-43e6-453a-83f7-6fa4f86bb7ec req-6854665a-e426-437c-a4f3-d6eb303cb512 service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] No waiting events found dispatching network-vif-plugged-793141da-bf20-4bd2-9fec-c6ecde2601ff {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:23:07 user nova-compute[73188]: WARNING nova.compute.manager [req-6b93b799-43e6-453a-83f7-6fa4f86bb7ec req-6854665a-e426-437c-a4f3-d6eb303cb512 service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Received unexpected event network-vif-plugged-793141da-bf20-4bd2-9fec-c6ecde2601ff for instance with vm_state building and task_state spawning.
Aug 15 19:23:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5a3a70b1-f43f-4b23-864e-d69a779697aa tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5a3a70b1-f43f-4b23-864e-d69a779697aa tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:07 user nova-compute[73188]: DEBUG nova.compute.manager [None req-5a3a70b1-f43f-4b23-864e-d69a779697aa tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:23:07 user nova-compute[73188]: DEBUG nova.compute.manager [None req-5a3a70b1-f43f-4b23-864e-d69a779697aa tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73188) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 15 19:23:07 user nova-compute[73188]: DEBUG nova.objects.instance [None req-5a3a70b1-f43f-4b23-864e-d69a779697aa tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'flavor' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:23:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-161964a8-b610-4be1-b486-9c912f43c597 req-7d6f4a91-1683-451e-8b16-7e1836fc343c service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received event network-vif-unplugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:23:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-161964a8-b610-4be1-b486-9c912f43c597 req-7d6f4a91-1683-451e-8b16-7e1836fc343c service nova] Acquiring lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-161964a8-b610-4be1-b486-9c912f43c597 req-7d6f4a91-1683-451e-8b16-7e1836fc343c service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-161964a8-b610-4be1-b486-9c912f43c597 req-7d6f4a91-1683-451e-8b16-7e1836fc343c service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-161964a8-b610-4be1-b486-9c912f43c597 req-7d6f4a91-1683-451e-8b16-7e1836fc343c service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] No waiting events found dispatching network-vif-unplugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:23:07 user nova-compute[73188]: WARNING nova.compute.manager [req-161964a8-b610-4be1-b486-9c912f43c597 req-7d6f4a91-1683-451e-8b16-7e1836fc343c service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received unexpected event network-vif-unplugged-0546e618-e785-46c7-aa82-d527ec295deb for instance with vm_state active and task_state powering-off.
Aug 15 19:23:08 user nova-compute[73188]: INFO nova.compute.manager [None req-b4018686-dca2-4000-b918-4d7a4abf692f tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Unrescuing
Aug 15 19:23:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b4018686-dca2-4000-b918-4d7a4abf692f tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "refresh_cache-5c2929f0-0a13-4279-ba1a-085ffdb2cd83" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:23:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b4018686-dca2-4000-b918-4d7a4abf692f tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquired lock "refresh_cache-5c2929f0-0a13-4279-ba1a-085ffdb2cd83" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:23:08 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b4018686-dca2-4000-b918-4d7a4abf692f tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:23:08 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Instance destroyed successfully.
Aug 15 19:23:08 user nova-compute[73188]: DEBUG nova.compute.manager [None req-5a3a70b1-f43f-4b23-864e-d69a779697aa tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:23:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5a3a70b1-f43f-4b23-864e-d69a779697aa tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.878s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:08 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b4018686-dca2-4000-b918-4d7a4abf692f tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Updating instance_info_cache with network_info: [{"id": "6225a308-7ed4-4b5e-baf9-217609c291e5", "address": "fa:16:3e:a1:7a:2a", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6225a308-7e", "ovs_interfaceid": "6225a308-7ed4-4b5e-baf9-217609c291e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:23:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b4018686-dca2-4000-b918-4d7a4abf692f tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Releasing lock "refresh_cache-5c2929f0-0a13-4279-ba1a-085ffdb2cd83" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:23:08 user nova-compute[73188]: DEBUG nova.objects.instance [None req-b4018686-dca2-4000-b918-4d7a4abf692f tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'flavor' on Instance uuid 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:23:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:09 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127389.0308888, 3e0ab835-00ac-4db2-a93f-257559fa29b6 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:23:09 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] VM Resumed (Lifecycle Event)
Aug 15 19:23:09 user nova-compute[73188]: DEBUG nova.compute.manager [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:23:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:23:09 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Instance spawned successfully.
Aug 15 19:23:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:23:09 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:23:09 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:23:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:23:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:23:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:23:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:23:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:23:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:23:09 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:23:09 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127389.0354645, 3e0ab835-00ac-4db2-a93f-257559fa29b6 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:23:09 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] VM Started (Lifecycle Event)
Aug 15 19:23:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-0716593d-cf8a-4a6e-a258-abac136d2988 req-cb8b7050-1b7e-433f-8d97-dcd1d024472f service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Received event network-vif-plugged-793141da-bf20-4bd2-9fec-c6ecde2601ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:23:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0716593d-cf8a-4a6e-a258-abac136d2988 req-cb8b7050-1b7e-433f-8d97-dcd1d024472f service nova] Acquiring lock "3e0ab835-00ac-4db2-a93f-257559fa29b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0716593d-cf8a-4a6e-a258-abac136d2988 req-cb8b7050-1b7e-433f-8d97-dcd1d024472f service nova] Lock "3e0ab835-00ac-4db2-a93f-257559fa29b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0716593d-cf8a-4a6e-a258-abac136d2988 req-cb8b7050-1b7e-433f-8d97-dcd1d024472f service nova] Lock "3e0ab835-00ac-4db2-a93f-257559fa29b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-0716593d-cf8a-4a6e-a258-abac136d2988 req-cb8b7050-1b7e-433f-8d97-dcd1d024472f service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] No waiting events found dispatching network-vif-plugged-793141da-bf20-4bd2-9fec-c6ecde2601ff {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:23:09 user nova-compute[73188]: WARNING nova.compute.manager [req-0716593d-cf8a-4a6e-a258-abac136d2988 req-cb8b7050-1b7e-433f-8d97-dcd1d024472f service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Received unexpected event network-vif-plugged-793141da-bf20-4bd2-9fec-c6ecde2601ff for instance with vm_state building and task_state spawning.
Aug 15 19:23:09 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:23:09 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:23:09 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:23:09 user nova-compute[73188]: INFO nova.compute.manager [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Took 6.55 seconds to spawn the instance on the hypervisor.
Aug 15 19:23:09 user nova-compute[73188]: DEBUG nova.compute.manager [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:23:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:09 user nova-compute[73188]: INFO nova.compute.manager [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Took 7.40 seconds to build instance.
Aug 15 19:23:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-33ec4aa7-517a-4b3f-a955-9c2dbadca837 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "3e0ab835-00ac-4db2-a93f-257559fa29b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.503s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:09 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Instance destroyed successfully.
Aug 15 19:23:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-6ecc7c0c-1e4f-459b-91d9-c4cf162b9d47 req-868bb2c9-bba4-43ca-93b5-e7ab82c4e113 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received event network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:23:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6ecc7c0c-1e4f-459b-91d9-c4cf162b9d47 req-868bb2c9-bba4-43ca-93b5-e7ab82c4e113 service nova] Acquiring lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6ecc7c0c-1e4f-459b-91d9-c4cf162b9d47 req-868bb2c9-bba4-43ca-93b5-e7ab82c4e113 service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6ecc7c0c-1e4f-459b-91d9-c4cf162b9d47 req-868bb2c9-bba4-43ca-93b5-e7ab82c4e113 service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-6ecc7c0c-1e4f-459b-91d9-c4cf162b9d47 req-868bb2c9-bba4-43ca-93b5-e7ab82c4e113 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] No waiting events found dispatching network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:23:09 user nova-compute[73188]: WARNING nova.compute.manager [req-6ecc7c0c-1e4f-459b-91d9-c4cf162b9d47 req-868bb2c9-bba4-43ca-93b5-e7ab82c4e113 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received unexpected event network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb for instance with vm_state stopped and task_state None.
Aug 15 19:23:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-309180b9-846c-482d-9ce3-2400d7d39a2f req-5e468caa-1c35-4738-8264-98c5b026caa3 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received event network-vif-unplugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:23:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-309180b9-846c-482d-9ce3-2400d7d39a2f req-5e468caa-1c35-4738-8264-98c5b026caa3 service nova] Acquiring lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-309180b9-846c-482d-9ce3-2400d7d39a2f req-5e468caa-1c35-4738-8264-98c5b026caa3 service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-309180b9-846c-482d-9ce3-2400d7d39a2f req-5e468caa-1c35-4738-8264-98c5b026caa3 service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-309180b9-846c-482d-9ce3-2400d7d39a2f req-5e468caa-1c35-4738-8264-98c5b026caa3 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] No waiting events found dispatching network-vif-unplugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:23:11 user nova-compute[73188]: WARNING nova.compute.manager [req-309180b9-846c-482d-9ce3-2400d7d39a2f req-5e468caa-1c35-4738-8264-98c5b026caa3 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received unexpected event network-vif-unplugged-6225a308-7ed4-4b5e-baf9-217609c291e5 for instance with vm_state rescued and task_state unrescuing.
Aug 15 19:23:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-309180b9-846c-482d-9ce3-2400d7d39a2f req-5e468caa-1c35-4738-8264-98c5b026caa3 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received event network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:23:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-309180b9-846c-482d-9ce3-2400d7d39a2f req-5e468caa-1c35-4738-8264-98c5b026caa3 service nova] Acquiring lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-309180b9-846c-482d-9ce3-2400d7d39a2f req-5e468caa-1c35-4738-8264-98c5b026caa3 service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-309180b9-846c-482d-9ce3-2400d7d39a2f req-5e468caa-1c35-4738-8264-98c5b026caa3 service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-309180b9-846c-482d-9ce3-2400d7d39a2f req-5e468caa-1c35-4738-8264-98c5b026caa3 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] No waiting events found dispatching network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:23:11 user nova-compute[73188]: WARNING nova.compute.manager [req-309180b9-846c-482d-9ce3-2400d7d39a2f req-5e468caa-1c35-4738-8264-98c5b026caa3 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received unexpected event network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 for instance with vm_state rescued and task_state unrescuing.
Aug 15 19:23:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-309180b9-846c-482d-9ce3-2400d7d39a2f req-5e468caa-1c35-4738-8264-98c5b026caa3 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received event network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:23:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-309180b9-846c-482d-9ce3-2400d7d39a2f req-5e468caa-1c35-4738-8264-98c5b026caa3 service nova] Acquiring lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-309180b9-846c-482d-9ce3-2400d7d39a2f req-5e468caa-1c35-4738-8264-98c5b026caa3 service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-309180b9-846c-482d-9ce3-2400d7d39a2f req-5e468caa-1c35-4738-8264-98c5b026caa3 service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-309180b9-846c-482d-9ce3-2400d7d39a2f req-5e468caa-1c35-4738-8264-98c5b026caa3 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] No waiting events found dispatching network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:23:11 user nova-compute[73188]: WARNING nova.compute.manager [req-309180b9-846c-482d-9ce3-2400d7d39a2f req-5e468caa-1c35-4738-8264-98c5b026caa3 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received unexpected event network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 for instance with vm_state rescued and task_state unrescuing.
Aug 15 19:23:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Starting finish_migration {{(pid=73188) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Instance directory exists: not creating {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 19:23:12 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Creating image(s)
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Did not create local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Ensure instance console log exists: /opt/stack/data/nova/instances/e0d0b28d-602f-47dd-a798-2d9c54b1a2c7/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Start _get_guest_xml network_info=[{"id": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "address": "fa:16:3e:20:ae:90", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-473389578-network", "vif_mac": "fa:16:3e:20:ae:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b20fd1-f9", "ovs_interfaceid": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RbgQdsPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e0d0b28d-602f-47dd-a798-2d9c54b1a2c7', 'attached_at': '2023-08-15T19:23:12.000000', 'detached_at': '', 'volume_id': 'a7f56af9-f1ab-443d-a7ec-63468e65fb69', 'serial': 'a7f56af9-f1ab-443d-a7ec-63468e65fb69'}, 'attachment_id': '8d785703-7679-4261-b62a-05cbdad42189', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:23:12 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:23:12 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.objects.instance [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'vcpu_model' on Instance uuid e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RbgQdsPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:23:12 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:23:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:23:12 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:23:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:23:12 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58a13c3-5c10-4614-87b4-4e42d9667309]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:23:12 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee3adf4-44be-457a-8742-0bdd38be80b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69] added
Aug 15 19:23:12 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d5b3ce-9ce8-468e-adba-17ea81bf7df5]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2638d6f5-a6c7-4c3c-8e36-4dc4a338f690]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RbgQdsPB {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RbgQdsPB" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16f4362-e221-4880-924c-64903af8eb87]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RbgQdsPB'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d97b05-6670-4ceb-9edb-a1a8dff09d0f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28fc696-96da-4af3-a63d-99ea277c676b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:23:12 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:23:12 user nova-compute[73188]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)
Aug 15 19:23:12 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:23:12 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:23:12 user nova-compute[73188]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)
Aug 15 19:23:12 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6208e58-da5a-4640-a028-d4a87b35cae1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69, portal: 172.16.0.220,3260]
Aug 15 19:23:12 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69, portal: 172.16.0.220,3260] successful.
Aug 15 19:23:12 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2b7c84-88b7-4f8f-94e8-3735e7ef12f3]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9061fea-577f-483f-a7bb-850777370d2f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:23:12 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:23:12 user nova-compute[73188]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)
Aug 15 19:23:12 user nova-compute[73188]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:23:12 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:23:12 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:23:12 user nova-compute[73188]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)
Aug 15 19:23:12 user nova-compute[73188]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:23:12 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03eabd3-8209-4dc5-bf59-8dcc58d40381]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:12 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: None {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Removed pending event for 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 due to event {{(pid=73188) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127393.188261, 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:23:13 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] VM Resumed (Lifecycle Event)
Aug 15 19:23:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b4018686-dca2-4000-b918-4d7a4abf692f tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:23:13 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 19:23:13 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127393.190996, 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:23:13 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] VM Started (Lifecycle Event)
Aug 15 19:23:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG nova.compute.manager [req-8e7df508-cf23-4144-af9a-2ed2c302bf5b req-61eb202d-e8f4-45c9-bd48-ccecd83d8717 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received event network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8e7df508-cf23-4144-af9a-2ed2c302bf5b req-61eb202d-e8f4-45c9-bd48-ccecd83d8717 service nova] Acquiring lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8e7df508-cf23-4144-af9a-2ed2c302bf5b req-61eb202d-e8f4-45c9-bd48-ccecd83d8717 service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8e7df508-cf23-4144-af9a-2ed2c302bf5b req-61eb202d-e8f4-45c9-bd48-ccecd83d8717 service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG nova.compute.manager [req-8e7df508-cf23-4144-af9a-2ed2c302bf5b req-61eb202d-e8f4-45c9-bd48-ccecd83d8717 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] No waiting events found dispatching network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:23:13 user nova-compute[73188]: WARNING nova.compute.manager [req-8e7df508-cf23-4144-af9a-2ed2c302bf5b req-61eb202d-e8f4-45c9-bd48-ccecd83d8717 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received unexpected event network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 for instance with vm_state active and task_state None.
Aug 15 19:23:13 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RbgQdsPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26233393130643639', 'path': '/dev/sdc'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233393130643639', 'path': '/dev/sdc'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1831045405',display_name='tempest-ServerActionsTestOtherA-server-1831045405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1831045405',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIh7IYSXIzW76yUh0lcXYRIDkLihwOuaxeqKxDoqlHxog01X1wGWUVb+WSkm+7EoRfQvo2EKI4l4BqBnCc2BP7hJFNq/yIn4BoRVp0zONEwe3FPB6tn+4jOCYVx7bU/R3g==',key_name='tempest-keypair-1497630278',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:21:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3c085a0ccf841e297d98037c07a7111',ramdisk_id='',reservation_id='r-gn04qlii',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2026424764',owner_user_name='tempest-ServerActionsTestOtherA-2026424764-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:23:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30de55a2834422c8f6df816899b881e',uuid=e0d0b28d-602f-47dd-a798-2d9c54b1a2c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "address": "fa:16:3e:20:ae:90", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-473389578-network", "vif_mac": "fa:16:3e:20:ae:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b20fd1-f9", "ovs_interfaceid": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converting VIF {"id": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "address": "fa:16:3e:20:ae:90", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-473389578-network", "vif_mac": "fa:16:3e:20:ae:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b20fd1-f9", "ovs_interfaceid": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:ae:90,bridge_name='br-int',has_traffic_filtering=True,id=35b20fd1-f9c9-4cd7-8744-77f418bd0428,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35b20fd1-f9') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:23:13 user nova-compute[73188]:   <uuid>e0d0b28d-602f-47dd-a798-2d9c54b1a2c7</uuid>
Aug 15 19:23:13 user nova-compute[73188]:   <name>instance-00000023</name>
Aug 15 19:23:13 user nova-compute[73188]:   <memory>2097152</memory>
Aug 15 19:23:13 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:23:13 user nova-compute[73188]:   <metadata>
Aug 15 19:23:13 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:23:13 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:23:13 user nova-compute[73188]:       <nova:name>tempest-ServerActionsTestOtherA-server-1831045405</nova:name>
Aug 15 19:23:13 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:23:12</nova:creationTime>
Aug 15 19:23:13 user nova-compute[73188]:       <nova:flavor name="m1.small">
Aug 15 19:23:13 user nova-compute[73188]:         <nova:memory>2048</nova:memory>
Aug 15 19:23:13 user nova-compute[73188]:         <nova:disk>20</nova:disk>
Aug 15 19:23:13 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:23:13 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:23:13 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:23:13 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:23:13 user nova-compute[73188]:       <nova:owner>
Aug 15 19:23:13 user nova-compute[73188]:         <nova:user uuid="c30de55a2834422c8f6df816899b881e">tempest-ServerActionsTestOtherA-2026424764-project-member</nova:user>
Aug 15 19:23:13 user nova-compute[73188]:         <nova:project uuid="a3c085a0ccf841e297d98037c07a7111">tempest-ServerActionsTestOtherA-2026424764</nova:project>
Aug 15 19:23:13 user nova-compute[73188]:       </nova:owner>
Aug 15 19:23:13 user nova-compute[73188]:       <nova:ports>
Aug 15 19:23:13 user nova-compute[73188]:         <nova:port uuid="35b20fd1-f9c9-4cd7-8744-77f418bd0428">
Aug 15 19:23:13 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 19:23:13 user nova-compute[73188]:         </nova:port>
Aug 15 19:23:13 user nova-compute[73188]:       </nova:ports>
Aug 15 19:23:13 user nova-compute[73188]:     </nova:instance>
Aug 15 19:23:13 user nova-compute[73188]:   </metadata>
Aug 15 19:23:13 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:23:13 user nova-compute[73188]:     <system>
Aug 15 19:23:13 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:23:13 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:23:13 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:23:13 user nova-compute[73188]:       <entry name="serial">e0d0b28d-602f-47dd-a798-2d9c54b1a2c7</entry>
Aug 15 19:23:13 user nova-compute[73188]:       <entry name="uuid">e0d0b28d-602f-47dd-a798-2d9c54b1a2c7</entry>
Aug 15 19:23:13 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:23:13 user nova-compute[73188]:     </system>
Aug 15 19:23:13 user nova-compute[73188]:   </sysinfo>
Aug 15 19:23:13 user nova-compute[73188]:   <os>
Aug 15 19:23:13 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:23:13 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:23:13 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:23:13 user nova-compute[73188]:   </os>
Aug 15 19:23:13 user nova-compute[73188]:   <features>
Aug 15 19:23:13 user nova-compute[73188]:     <acpi/>
Aug 15 19:23:13 user nova-compute[73188]:     <apic/>
Aug 15 19:23:13 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:23:13 user nova-compute[73188]:   </features>
Aug 15 19:23:13 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:23:13 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:23:13 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:23:13 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:23:13 user nova-compute[73188]:   </clock>
Aug 15 19:23:13 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:23:13 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:23:13 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:23:13 user nova-compute[73188]:   </cpu>
Aug 15 19:23:13 user nova-compute[73188]:   <devices>
Aug 15 19:23:13 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:23:13 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:23:13 user nova-compute[73188]:       <source dev="/dev/sdc"/>
Aug 15 19:23:13 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:23:13 user nova-compute[73188]:       <serial>a7f56af9-f1ab-443d-a7ec-63468e65fb69</serial>
Aug 15 19:23:13 user nova-compute[73188]:     </disk>
Aug 15 19:23:13 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:23:13 user nova-compute[73188]:       <mac address="fa:16:3e:20:ae:90"/>
Aug 15 19:23:13 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:23:13 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:23:13 user nova-compute[73188]:       <target dev="tap35b20fd1-f9"/>
Aug 15 19:23:13 user nova-compute[73188]:     </interface>
Aug 15 19:23:13 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:23:13 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/e0d0b28d-602f-47dd-a798-2d9c54b1a2c7/console.log" append="off"/>
Aug 15 19:23:13 user nova-compute[73188]:     </serial>
Aug 15 19:23:13 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:23:13 user nova-compute[73188]:     <video>
Aug 15 19:23:13 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:23:13 user nova-compute[73188]:     </video>
Aug 15 19:23:13 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:23:13 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:23:13 user nova-compute[73188]:     </rng>
Aug 15 19:23:13 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:23:13 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:23:13 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:23:13 user nova-compute[73188]:     </memballoon>
Aug 15 19:23:13 user nova-compute[73188]:   </devices>
Aug 15 19:23:13 user nova-compute[73188]: </domain>
Aug 15 19:23:13 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1831045405',display_name='tempest-ServerActionsTestOtherA-server-1831045405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1831045405',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIh7IYSXIzW76yUh0lcXYRIDkLihwOuaxeqKxDoqlHxog01X1wGWUVb+WSkm+7EoRfQvo2EKI4l4BqBnCc2BP7hJFNq/yIn4BoRVp0zONEwe3FPB6tn+4jOCYVx7bU/R3g==',key_name='tempest-keypair-1497630278',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:21:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3c085a0ccf841e297d98037c07a7111',ramdisk_id='',reservation_id='r-gn04qlii',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2026424764',owner_user_name='tempest-ServerActionsTestOtherA-2026424764-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:23:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30de55a2834422c8f6df816899b881e',uuid=e0d0b28d-602f-47dd-a798-2d9c54b1a2c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "address": "fa:16:3e:20:ae:90", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-473389578-network", "vif_mac": "fa:16:3e:20:ae:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b20fd1-f9", "ovs_interfaceid": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converting VIF {"id": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "address": "fa:16:3e:20:ae:90", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-473389578-network", "vif_mac": "fa:16:3e:20:ae:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b20fd1-f9", "ovs_interfaceid": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:ae:90,bridge_name='br-int',has_traffic_filtering=True,id=35b20fd1-f9c9-4cd7-8744-77f418bd0428,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35b20fd1-f9') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG os_vif [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:ae:90,bridge_name='br-int',has_traffic_filtering=True,id=35b20fd1-f9c9-4cd7-8744-77f418bd0428,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35b20fd1-f9') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35b20fd1-f9, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap35b20fd1-f9, col_values=(('external_ids', {'iface-id': '35b20fd1-f9c9-4cd7-8744-77f418bd0428', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:ae:90', 'vm-uuid': 'e0d0b28d-602f-47dd-a798-2d9c54b1a2c7'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:13 user nova-compute[73188]: INFO os_vif [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:ae:90,bridge_name='br-int',has_traffic_filtering=True,id=35b20fd1-f9c9-4cd7-8744-77f418bd0428,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35b20fd1-f9')
Aug 15 19:23:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:23:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] No VIF found with MAC fa:16:3e:20:ae:90, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:23:14 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127379.8360198, e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:23:14 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] VM Stopped (Lifecycle Event)
Aug 15 19:23:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-11917faf-3025-4b0f-8044-d071561785d0 None None] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:23:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:15 user nova-compute[73188]: DEBUG nova.compute.manager [req-f0753ae0-b564-4a07-919e-2e1ba67407d6 req-c48738d9-0a87-4bbb-8b93-7ae697f476bb service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Received event network-vif-plugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:23:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f0753ae0-b564-4a07-919e-2e1ba67407d6 req-c48738d9-0a87-4bbb-8b93-7ae697f476bb service nova] Acquiring lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f0753ae0-b564-4a07-919e-2e1ba67407d6 req-c48738d9-0a87-4bbb-8b93-7ae697f476bb service nova] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f0753ae0-b564-4a07-919e-2e1ba67407d6 req-c48738d9-0a87-4bbb-8b93-7ae697f476bb service nova] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:15 user nova-compute[73188]: DEBUG nova.compute.manager [req-f0753ae0-b564-4a07-919e-2e1ba67407d6 req-c48738d9-0a87-4bbb-8b93-7ae697f476bb service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] No waiting events found dispatching network-vif-plugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:23:15 user nova-compute[73188]: WARNING nova.compute.manager [req-f0753ae0-b564-4a07-919e-2e1ba67407d6 req-c48738d9-0a87-4bbb-8b93-7ae697f476bb service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Received unexpected event network-vif-plugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 for instance with vm_state active and task_state resize_finish.
Aug 15 19:23:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:15 user nova-compute[73188]: INFO nova.compute.manager [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Terminating instance
Aug 15 19:23:15 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:23:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:16 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Instance destroyed successfully.
Aug 15 19:23:16 user nova-compute[73188]: DEBUG nova.objects.instance [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'resources' on Instance uuid 0ee7de87-76ad-48ae-8bcd-93b2792a96cd {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:23:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:13:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1906080092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1906080092',id=25,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:13:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ab4e1cccd434f6c83f2f9e4687d274e',ramdisk_id='',reservation_id='r-0ck2f0wd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:15:50Z,user_data=None,user_id='bad952eceaec400396fd0a28c438c761',uuid=0ee7de87-76ad-48ae-8bcd-93b2792a96cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7", "address": "fa:16:3e:05:76:cf", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b9fe2a-e4", "ovs_interfaceid": "03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:23:16 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converting VIF {"id": "03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7", "address": "fa:16:3e:05:76:cf", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b9fe2a-e4", "ovs_interfaceid": "03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:23:16 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:76:cf,bridge_name='br-int',has_traffic_filtering=True,id=03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03b9fe2a-e4') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:23:16 user nova-compute[73188]: DEBUG os_vif [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:76:cf,bridge_name='br-int',has_traffic_filtering=True,id=03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03b9fe2a-e4') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:23:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03b9fe2a-e4, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:23:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:23:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:16 user nova-compute[73188]: INFO os_vif [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:76:cf,bridge_name='br-int',has_traffic_filtering=True,id=03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03b9fe2a-e4')
Aug 15 19:23:16 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Deleting instance files /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd_del
Aug 15 19:23:16 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Deletion of /opt/stack/data/nova/instances/0ee7de87-76ad-48ae-8bcd-93b2792a96cd_del complete
Aug 15 19:23:16 user nova-compute[73188]: INFO nova.compute.manager [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 15 19:23:16 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:23:16 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:23:16 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:23:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:16 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:23:16 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Took 0.64 seconds to deallocate network for instance.
Aug 15 19:23:16 user nova-compute[73188]: DEBUG nova.compute.manager [req-44af4cf6-bfef-44fd-9c48-f2466b94f999 req-e84d3138-b17c-49a3-be56-2a7df5929661 service nova] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Received event network-vif-deleted-03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:23:16 user nova-compute[73188]: INFO nova.compute.manager [req-44af4cf6-bfef-44fd-9c48-f2466b94f999 req-e84d3138-b17c-49a3-be56-2a7df5929661 service nova] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Neutron deleted interface 03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7; detaching it from the instance and deleting it from the info cache
Aug 15 19:23:16 user nova-compute[73188]: DEBUG nova.network.neutron [req-44af4cf6-bfef-44fd-9c48-f2466b94f999 req-e84d3138-b17c-49a3-be56-2a7df5929661 service nova] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:23:16 user nova-compute[73188]: DEBUG nova.compute.manager [req-44af4cf6-bfef-44fd-9c48-f2466b94f999 req-e84d3138-b17c-49a3-be56-2a7df5929661 service nova] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Detach interface failed, port_id=03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7, reason: Instance 0ee7de87-76ad-48ae-8bcd-93b2792a96cd could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:23:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:17 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:23:17 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:23:17 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127397.324753, e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:23:17 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] VM Resumed (Lifecycle Event)
Aug 15 19:23:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:23:17 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Instance running successfully.
Aug 15 19:23:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Failed to set time: agent not configured {{(pid=73188) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 15 19:23:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e954a302-0461-41bb-b7e3-f8473750c643 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] finish_migration finished successfully. {{(pid=73188) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 15 19:23:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:23:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:23:17 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Deleted allocations for instance 0ee7de87-76ad-48ae-8bcd-93b2792a96cd
Aug 15 19:23:17 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 19:23:17 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127397.3286257, e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:23:17 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] VM Started (Lifecycle Event)
Aug 15 19:23:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:23:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:23:17 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 19:23:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-82d2008d-2cdd-4913-8f89-afd2bb8838ea req-7f4e6ec4-cb05-4cf9-906d-7939b98e5a5f service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Received event network-vif-plugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:23:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-82d2008d-2cdd-4913-8f89-afd2bb8838ea req-7f4e6ec4-cb05-4cf9-906d-7939b98e5a5f service nova] Acquiring lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-82d2008d-2cdd-4913-8f89-afd2bb8838ea req-7f4e6ec4-cb05-4cf9-906d-7939b98e5a5f service nova] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-82d2008d-2cdd-4913-8f89-afd2bb8838ea req-7f4e6ec4-cb05-4cf9-906d-7939b98e5a5f service nova] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-82d2008d-2cdd-4913-8f89-afd2bb8838ea req-7f4e6ec4-cb05-4cf9-906d-7939b98e5a5f service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] No waiting events found dispatching network-vif-plugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:23:17 user nova-compute[73188]: WARNING nova.compute.manager [req-82d2008d-2cdd-4913-8f89-afd2bb8838ea req-7f4e6ec4-cb05-4cf9-906d-7939b98e5a5f service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Received unexpected event network-vif-plugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 for instance with vm_state active and task_state resize_finish.
Aug 15 19:23:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-82d2008d-2cdd-4913-8f89-afd2bb8838ea req-7f4e6ec4-cb05-4cf9-906d-7939b98e5a5f service nova] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Received event network-vif-unplugged-03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:23:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-82d2008d-2cdd-4913-8f89-afd2bb8838ea req-7f4e6ec4-cb05-4cf9-906d-7939b98e5a5f service nova] Acquiring lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-82d2008d-2cdd-4913-8f89-afd2bb8838ea req-7f4e6ec4-cb05-4cf9-906d-7939b98e5a5f service nova] Lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-82d2008d-2cdd-4913-8f89-afd2bb8838ea req-7f4e6ec4-cb05-4cf9-906d-7939b98e5a5f service nova] Lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-82d2008d-2cdd-4913-8f89-afd2bb8838ea req-7f4e6ec4-cb05-4cf9-906d-7939b98e5a5f service nova] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] No waiting events found dispatching network-vif-unplugged-03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:23:17 user nova-compute[73188]: WARNING nova.compute.manager [req-82d2008d-2cdd-4913-8f89-afd2bb8838ea req-7f4e6ec4-cb05-4cf9-906d-7939b98e5a5f service nova] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Received unexpected event network-vif-unplugged-03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7 for instance with vm_state deleted and task_state None.
Aug 15 19:23:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-82d2008d-2cdd-4913-8f89-afd2bb8838ea req-7f4e6ec4-cb05-4cf9-906d-7939b98e5a5f service nova] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Received event network-vif-plugged-03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:23:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-82d2008d-2cdd-4913-8f89-afd2bb8838ea req-7f4e6ec4-cb05-4cf9-906d-7939b98e5a5f service nova] Acquiring lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-82d2008d-2cdd-4913-8f89-afd2bb8838ea req-7f4e6ec4-cb05-4cf9-906d-7939b98e5a5f service nova] Lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-82d2008d-2cdd-4913-8f89-afd2bb8838ea req-7f4e6ec4-cb05-4cf9-906d-7939b98e5a5f service nova] Lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-82d2008d-2cdd-4913-8f89-afd2bb8838ea req-7f4e6ec4-cb05-4cf9-906d-7939b98e5a5f service nova] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] No waiting events found dispatching network-vif-plugged-03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:23:17 user nova-compute[73188]: WARNING nova.compute.manager [req-82d2008d-2cdd-4913-8f89-afd2bb8838ea req-7f4e6ec4-cb05-4cf9-906d-7939b98e5a5f service nova] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Received unexpected event network-vif-plugged-03b9fe2a-e49e-4fc1-b5f0-f4e894b92be7 for instance with vm_state deleted and task_state None.
Aug 15 19:23:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e48b0ccd-161c-4ad9-90cd-fb8e1f781bef tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "0ee7de87-76ad-48ae-8bcd-93b2792a96cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.038s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:21 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:23:23 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127388.3527663, b3dd183e-7ab1-40ae-b282-40575a9e47df => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:23:23 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] VM Stopped (Lifecycle Event)
Aug 15 19:23:23 user nova-compute[73188]: DEBUG nova.compute.manager [None req-366b6cad-4fed-494c-947a-1b5296301a8e None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:23:23 user nova-compute[73188]: DEBUG nova.compute.manager [None req-366b6cad-4fed-494c-947a-1b5296301a8e None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:23:23 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:23:24 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:23:24 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:23:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:24 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:23:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:23:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:23:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:23:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:23:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:28 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:23:28 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:23:28 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=7266MB free_disk=25.094261169433594GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:23:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Applying migration context for instance e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 as it has an incoming, in-progress migration 4a3ee4d1-3b41-46d2-a271-c65e9470eca5. Migration status is finished {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 19:23:29 user nova-compute[73188]: INFO nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Updating resource usage from migration 4a3ee4d1-3b41-46d2-a271-c65e9470eca5
Aug 15 19:23:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:23:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3d713d03-3e60-4dec-a295-a4652ac21842 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:23:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e00adf53-085f-436d-a09f-e97e92ca79cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:23:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 139ccf1c-4792-4653-9475-c61b1f9c4846 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:23:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 215077af-60a1-4a82-b24e-1545349363d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:23:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance b3dd183e-7ab1-40ae-b282-40575a9e47df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:23:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:23:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance d8f302f1-7c20-483a-9eef-24566d51143d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:23:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:23:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Migration 4a3ee4d1-3b41-46d2-a271-c65e9470eca5 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 19:23:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:23:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3e0ab835-00ac-4db2-a93f-257559fa29b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:23:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:23:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:23:29 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:23:29 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:23:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:23:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.543s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:30 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:23:30 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:23:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-139ccf1c-4792-4653-9475-c61b1f9c4846" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:23:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-139ccf1c-4792-4653-9475-c61b1f9c4846" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:23:30 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:23:30 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Updating instance_info_cache with network_info: [{"id": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "address": "fa:16:3e:49:14:b8", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2485f75-d3", "ovs_interfaceid": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:23:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-139ccf1c-4792-4653-9475-c61b1f9c4846" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:23:31 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:23:31 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:23:31 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:23:31 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:23:31 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:23:31 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127396.084676, 0ee7de87-76ad-48ae-8bcd-93b2792a96cd => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:23:31 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] VM Stopped (Lifecycle Event)
Aug 15 19:23:31 user nova-compute[73188]: DEBUG nova.compute.manager [None req-0557dad1-da19-4ff1-ade6-7613172b2b8c None None] [instance: 0ee7de87-76ad-48ae-8bcd-93b2792a96cd] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:23:31 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:23:31 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:23:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "4c2064b9-f23d-4c26-bf0a-8fa748829b43" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "4c2064b9-f23d-4c26-bf0a-8fa748829b43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:42 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:23:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:23:42 user nova-compute[73188]: INFO nova.compute.claims [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Claim successful on node user
Aug 15 19:23:42 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:23:42 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:23:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:42 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:23:42 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:23:42 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:23:42 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:23:43 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:23:43 user nova-compute[73188]: INFO nova.virt.block_device [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Booting with volume f0d1c0ed-fb02-4031-a56f-4e15a01873b2 at /dev/vda
Aug 15 19:23:43 user nova-compute[73188]: DEBUG nova.policy [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9503705066e5402cb569fae3b2bd8976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18eadba32f4547ad9436aca9285b7aad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:23:43 user nova-compute[73188]: DEBUG os_brick.utils [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:23:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb829d7-6933-49f9-ac90-493d604d8e2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[095fc0ea-00a5-45bb-9dc1-5fa6d8bc7c42]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c01f29-1798-4176-b343-2ae346bd833a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e32048c-fa57-446f-a3c4-5bd867ff3434]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:23:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:23:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:23:43 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:23:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3207a22-722d-4497-869e-b83c81290382]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:23:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:23:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:23:43 user nova-compute[73188]: DEBUG os_brick.utils [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:23:43 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Updating existing volume attachment record: 2054329e-243b-46d4-ad5f-138f83dce73e {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:23:43 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Successfully created port: df969754-62c7-4735-8936-c3736b57aef4 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:23:44 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Successfully updated port: df969754-62c7-4735-8936-c3736b57aef4 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:23:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "refresh_cache-4c2064b9-f23d-4c26-bf0a-8fa748829b43" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:23:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquired lock "refresh_cache-4c2064b9-f23d-4c26-bf0a-8fa748829b43" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:23:44 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:23:44 user nova-compute[73188]: DEBUG nova.compute.manager [req-d2bf1228-638a-4160-adb8-db25bab7cdaa req-4c66aa5b-b221-4e8a-81ba-1cc255c80d64 service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Received event network-changed-df969754-62c7-4735-8936-c3736b57aef4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:23:44 user nova-compute[73188]: DEBUG nova.compute.manager [req-d2bf1228-638a-4160-adb8-db25bab7cdaa req-4c66aa5b-b221-4e8a-81ba-1cc255c80d64 service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Refreshing instance network info cache due to event network-changed-df969754-62c7-4735-8936-c3736b57aef4. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:23:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d2bf1228-638a-4160-adb8-db25bab7cdaa req-4c66aa5b-b221-4e8a-81ba-1cc255c80d64 service nova] Acquiring lock "refresh_cache-4c2064b9-f23d-4c26-bf0a-8fa748829b43" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:23:44 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:23:44 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Updating instance_info_cache with network_info: [{"id": "df969754-62c7-4735-8936-c3736b57aef4", "address": "fa:16:3e:4a:d2:00", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf969754-62", "ovs_interfaceid": "df969754-62c7-4735-8936-c3736b57aef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:23:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Releasing lock "refresh_cache-4c2064b9-f23d-4c26-bf0a-8fa748829b43" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:23:44 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Instance network_info: |[{"id": "df969754-62c7-4735-8936-c3736b57aef4", "address": "fa:16:3e:4a:d2:00", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf969754-62", "ovs_interfaceid": "df969754-62c7-4735-8936-c3736b57aef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:23:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d2bf1228-638a-4160-adb8-db25bab7cdaa req-4c66aa5b-b221-4e8a-81ba-1cc255c80d64 service nova] Acquired lock "refresh_cache-4c2064b9-f23d-4c26-bf0a-8fa748829b43" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:23:44 user nova-compute[73188]: DEBUG nova.network.neutron [req-d2bf1228-638a-4160-adb8-db25bab7cdaa req-4c66aa5b-b221-4e8a-81ba-1cc255c80d64 service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Refreshing network info cache for port df969754-62c7-4735-8936-c3736b57aef4 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:23:45 user nova-compute[73188]: DEBUG nova.network.neutron [req-d2bf1228-638a-4160-adb8-db25bab7cdaa req-4c66aa5b-b221-4e8a-81ba-1cc255c80d64 service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Updated VIF entry in instance network info cache for port df969754-62c7-4735-8936-c3736b57aef4. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:23:45 user nova-compute[73188]: DEBUG nova.network.neutron [req-d2bf1228-638a-4160-adb8-db25bab7cdaa req-4c66aa5b-b221-4e8a-81ba-1cc255c80d64 service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Updating instance_info_cache with network_info: [{"id": "df969754-62c7-4735-8936-c3736b57aef4", "address": "fa:16:3e:4a:d2:00", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf969754-62", "ovs_interfaceid": "df969754-62c7-4735-8936-c3736b57aef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:23:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d2bf1228-638a-4160-adb8-db25bab7cdaa req-4c66aa5b-b221-4e8a-81ba-1cc255c80d64 service nova] Releasing lock "refresh_cache-4c2064b9-f23d-4c26-bf0a-8fa748829b43" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:23:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:23:53 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Creating image(s)
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Did not create local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Ensure instance console log exists: /opt/stack/data/nova/instances/4c2064b9-f23d-4c26-bf0a-8fa748829b43/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Start _get_guest_xml network_info=[{"id": "df969754-62c7-4735-8936-c3736b57aef4", "address": "fa:16:3e:4a:d2:00", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf969754-62", "ovs_interfaceid": "df969754-62c7-4735-8936-c3736b57aef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLhRyXDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4c2064b9-f23d-4c26-bf0a-8fa748829b43', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0d1c0ed-fb02-4031-a56f-4e15a01873b2', 'serial': 'f0d1c0ed-fb02-4031-a56f-4e15a01873b2'}, 'attachment_id': '2054329e-243b-46d4-ad5f-138f83dce73e', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Acquiring lock "a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Acquiring lock "a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:53 user nova-compute[73188]: INFO nova.compute.manager [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Terminating instance
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.compute.manager [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:23:53 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:23:53 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLhRyXDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:23:53 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:23:53 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:23:53 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8aac03f-353c-498f-b8a7-7311f2d9bc4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:23:53 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12f5587-80c6-46ec-bf24-449a75cb8f9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2] added
Aug 15 19:23:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f007febc-bd0f-491e-ba69-3a8f43ddc7c6]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee5a801-25cf-4a18-ab67-0f9fa099ffa3]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pLhRyXDQ {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pLhRyXDQ" returned: 0 in 0.031s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc0ee02-4269-4899-a2cc-869d6864f3b9]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pLhRyXDQ'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[86004db0-afc9-4553-8adb-867f048b8f49]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2deed7ba-f2ec-49a8-9001-bb2ee4567094]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:23:53 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:23:53 user nova-compute[73188]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)
Aug 15 19:23:53 user nova-compute[73188]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:23:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:23:53 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:23:53 user nova-compute[73188]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)
Aug 15 19:23:53 user nova-compute[73188]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:23:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0218148-9e88-491f-9b98-e64d02d4b0ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2, portal: 172.16.0.220,3260]
Aug 15 19:23:53 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2, portal: 172.16.0.220,3260] successful.
Aug 15 19:23:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd85845-b8de-43b7-bc65-78c91f2f1150]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c601edd7-1fb1-4c37-bb87-d249e6797d84]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:23:53 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:23:53 user nova-compute[73188]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)
Aug 15 19:23:53 user nova-compute[73188]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:23:53 user nova-compute[73188]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:23:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:23:53 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:23:53 user nova-compute[73188]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)
Aug 15 19:23:53 user nova-compute[73188]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:23:53 user nova-compute[73188]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:23:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb59d63-2954-44d1-9753-70b3a790bee3]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLhRyXDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.compute.manager [req-af42134f-eee9-44df-a920-0a29aa4500cc req-04914842-17cf-4ffb-8da0-3df50ab42323 service nova] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Received event network-vif-unplugged-a9cd3e25-b47c-4c93-8750-458e6800e9ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-af42134f-eee9-44df-a920-0a29aa4500cc req-04914842-17cf-4ffb-8da0-3df50ab42323 service nova] Acquiring lock "a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-af42134f-eee9-44df-a920-0a29aa4500cc req-04914842-17cf-4ffb-8da0-3df50ab42323 service nova] Lock "a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-af42134f-eee9-44df-a920-0a29aa4500cc req-04914842-17cf-4ffb-8da0-3df50ab42323 service nova] Lock "a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.compute.manager [req-af42134f-eee9-44df-a920-0a29aa4500cc req-04914842-17cf-4ffb-8da0-3df50ab42323 service nova] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] No waiting events found dispatching network-vif-unplugged-a9cd3e25-b47c-4c93-8750-458e6800e9ff {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.compute.manager [req-af42134f-eee9-44df-a920-0a29aa4500cc req-04914842-17cf-4ffb-8da0-3df50ab42323 service nova] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Received event network-vif-unplugged-a9cd3e25-b47c-4c93-8750-458e6800e9ff for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:23:53 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Instance destroyed successfully.
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.objects.instance [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lazy-loading 'resources' on Instance uuid a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-67317540',display_name='tempest-VolumesActionsTest-instance-67317540',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-67317540',id=36,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:22:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1cfc95d252dc44f79afe90be2f4324a6',ramdisk_id='',reservation_id='r-2udc4vay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1468435355',owner_user_name='tempest-VolumesActionsTest-1468435355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:22:08Z,user_data=None,user_id='ffd643862c1447868d962e4315a38d13',uuid=a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9cd3e25-b47c-4c93-8750-458e6800e9ff", "address": "fa:16:3e:eb:06:47", "network": {"id": "67b69ed4-0c6f-4b67-a173-2570bbb4d6d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979729543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cfc95d252dc44f79afe90be2f4324a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9cd3e25-b4", "ovs_interfaceid": "a9cd3e25-b47c-4c93-8750-458e6800e9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Converting VIF {"id": "a9cd3e25-b47c-4c93-8750-458e6800e9ff", "address": "fa:16:3e:eb:06:47", "network": {"id": "67b69ed4-0c6f-4b67-a173-2570bbb4d6d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1979729543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cfc95d252dc44f79afe90be2f4324a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9cd3e25-b4", "ovs_interfaceid": "a9cd3e25-b47c-4c93-8750-458e6800e9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:06:47,bridge_name='br-int',has_traffic_filtering=True,id=a9cd3e25-b47c-4c93-8750-458e6800e9ff,network=Network(67b69ed4-0c6f-4b67-a173-2570bbb4d6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9cd3e25-b4') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG os_vif [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:06:47,bridge_name='br-int',has_traffic_filtering=True,id=a9cd3e25-b47c-4c93-8750-458e6800e9ff,network=Network(67b69ed4-0c6f-4b67-a173-2570bbb4d6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9cd3e25-b4') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9cd3e25-b4, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:23:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:53 user nova-compute[73188]: INFO os_vif [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:06:47,bridge_name='br-int',has_traffic_filtering=True,id=a9cd3e25-b47c-4c93-8750-458e6800e9ff,network=Network(67b69ed4-0c6f-4b67-a173-2570bbb4d6d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9cd3e25-b4')
Aug 15 19:23:53 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Deleting instance files /opt/stack/data/nova/instances/a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff_del
Aug 15 19:23:53 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Deletion of /opt/stack/data/nova/instances/a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff_del complete
Aug 15 19:23:53 user nova-compute[73188]: INFO nova.compute.manager [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 15 19:23:53 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23263363033363438', 'path': '/dev/sdd'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263363033363438', 'path': '/dev/sdd'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1894120181',display_name='tempest-TestVolumeBootPattern-server-1894120181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1894120181',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdjONelCosej3I/pGPD4UfCZO2hIpepMykeX7dOlXZGpPLQP0eHCaELWxQF5jeHsky1dPgp1Jk+Jsu/dHFRA3/Yz5MW9r+VfrqEngMakotyTy6CftX4lIdZFQ2vRevOkg==',key_name='tempest-TestVolumeBootPattern-1653977396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18eadba32f4547ad9436aca9285b7aad',ramdisk_id='',reservation_id='r-175c3klf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2114363476',owner_user_name='tempest-TestVolumeBootPattern-2114363476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:23:43Z,user_data=None,user_id='9503705066e5402cb569fae3b2bd8976',uuid=4c2064b9-f23d-4c26-bf0a-8fa748829b43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df969754-62c7-4735-8936-c3736b57aef4", "address": "fa:16:3e:4a:d2:00", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf969754-62", "ovs_interfaceid": "df969754-62c7-4735-8936-c3736b57aef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converting VIF {"id": "df969754-62c7-4735-8936-c3736b57aef4", "address": "fa:16:3e:4a:d2:00", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf969754-62", "ovs_interfaceid": "df969754-62c7-4735-8936-c3736b57aef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:d2:00,bridge_name='br-int',has_traffic_filtering=True,id=df969754-62c7-4735-8936-c3736b57aef4,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf969754-62') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG nova.objects.instance [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c2064b9-f23d-4c26-bf0a-8fa748829b43 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:23:54 user nova-compute[73188]:   <uuid>4c2064b9-f23d-4c26-bf0a-8fa748829b43</uuid>
Aug 15 19:23:54 user nova-compute[73188]:   <name>instance-00000026</name>
Aug 15 19:23:54 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:23:54 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:23:54 user nova-compute[73188]:   <metadata>
Aug 15 19:23:54 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:23:54 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:23:54 user nova-compute[73188]:       <nova:name>tempest-TestVolumeBootPattern-server-1894120181</nova:name>
Aug 15 19:23:54 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:23:53</nova:creationTime>
Aug 15 19:23:54 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:23:54 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:23:54 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:23:54 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:23:54 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:23:54 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:23:54 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:23:54 user nova-compute[73188]:       <nova:owner>
Aug 15 19:23:54 user nova-compute[73188]:         <nova:user uuid="9503705066e5402cb569fae3b2bd8976">tempest-TestVolumeBootPattern-2114363476-project-member</nova:user>
Aug 15 19:23:54 user nova-compute[73188]:         <nova:project uuid="18eadba32f4547ad9436aca9285b7aad">tempest-TestVolumeBootPattern-2114363476</nova:project>
Aug 15 19:23:54 user nova-compute[73188]:       </nova:owner>
Aug 15 19:23:54 user nova-compute[73188]:       <nova:ports>
Aug 15 19:23:54 user nova-compute[73188]:         <nova:port uuid="df969754-62c7-4735-8936-c3736b57aef4">
Aug 15 19:23:54 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 19:23:54 user nova-compute[73188]:         </nova:port>
Aug 15 19:23:54 user nova-compute[73188]:       </nova:ports>
Aug 15 19:23:54 user nova-compute[73188]:     </nova:instance>
Aug 15 19:23:54 user nova-compute[73188]:   </metadata>
Aug 15 19:23:54 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:23:54 user nova-compute[73188]:     <system>
Aug 15 19:23:54 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:23:54 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:23:54 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:23:54 user nova-compute[73188]:       <entry name="serial">4c2064b9-f23d-4c26-bf0a-8fa748829b43</entry>
Aug 15 19:23:54 user nova-compute[73188]:       <entry name="uuid">4c2064b9-f23d-4c26-bf0a-8fa748829b43</entry>
Aug 15 19:23:54 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:23:54 user nova-compute[73188]:     </system>
Aug 15 19:23:54 user nova-compute[73188]:   </sysinfo>
Aug 15 19:23:54 user nova-compute[73188]:   <os>
Aug 15 19:23:54 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:23:54 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:23:54 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:23:54 user nova-compute[73188]:   </os>
Aug 15 19:23:54 user nova-compute[73188]:   <features>
Aug 15 19:23:54 user nova-compute[73188]:     <acpi/>
Aug 15 19:23:54 user nova-compute[73188]:     <apic/>
Aug 15 19:23:54 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:23:54 user nova-compute[73188]:   </features>
Aug 15 19:23:54 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:23:54 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:23:54 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:23:54 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:23:54 user nova-compute[73188]:   </clock>
Aug 15 19:23:54 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:23:54 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:23:54 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:23:54 user nova-compute[73188]:   </cpu>
Aug 15 19:23:54 user nova-compute[73188]:   <devices>
Aug 15 19:23:54 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:23:54 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:23:54 user nova-compute[73188]:       <source dev="/dev/sdd"/>
Aug 15 19:23:54 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:23:54 user nova-compute[73188]:       <serial>f0d1c0ed-fb02-4031-a56f-4e15a01873b2</serial>
Aug 15 19:23:54 user nova-compute[73188]:     </disk>
Aug 15 19:23:54 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:23:54 user nova-compute[73188]:       <mac address="fa:16:3e:4a:d2:00"/>
Aug 15 19:23:54 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:23:54 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:23:54 user nova-compute[73188]:       <target dev="tapdf969754-62"/>
Aug 15 19:23:54 user nova-compute[73188]:     </interface>
Aug 15 19:23:54 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:23:54 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/4c2064b9-f23d-4c26-bf0a-8fa748829b43/console.log" append="off"/>
Aug 15 19:23:54 user nova-compute[73188]:     </serial>
Aug 15 19:23:54 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:23:54 user nova-compute[73188]:     <video>
Aug 15 19:23:54 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:23:54 user nova-compute[73188]:     </video>
Aug 15 19:23:54 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:23:54 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:23:54 user nova-compute[73188]:     </rng>
Aug 15 19:23:54 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:23:54 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:23:54 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:23:54 user nova-compute[73188]:     </memballoon>
Aug 15 19:23:54 user nova-compute[73188]:   </devices>
Aug 15 19:23:54 user nova-compute[73188]: </domain>
Aug 15 19:23:54 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1894120181',display_name='tempest-TestVolumeBootPattern-server-1894120181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1894120181',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdjONelCosej3I/pGPD4UfCZO2hIpepMykeX7dOlXZGpPLQP0eHCaELWxQF5jeHsky1dPgp1Jk+Jsu/dHFRA3/Yz5MW9r+VfrqEngMakotyTy6CftX4lIdZFQ2vRevOkg==',key_name='tempest-TestVolumeBootPattern-1653977396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18eadba32f4547ad9436aca9285b7aad',ramdisk_id='',reservation_id='r-175c3klf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2114363476',owner_user_name='tempest-TestVolumeBootPattern-2114363476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:23:43Z,user_data=None,user_id='9503705066e5402cb569fae3b2bd8976',uuid=4c2064b9-f23d-4c26-bf0a-8fa748829b43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df969754-62c7-4735-8936-c3736b57aef4", "address": "fa:16:3e:4a:d2:00", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf969754-62", "ovs_interfaceid": "df969754-62c7-4735-8936-c3736b57aef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converting VIF {"id": "df969754-62c7-4735-8936-c3736b57aef4", "address": "fa:16:3e:4a:d2:00", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf969754-62", "ovs_interfaceid": "df969754-62c7-4735-8936-c3736b57aef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:d2:00,bridge_name='br-int',has_traffic_filtering=True,id=df969754-62c7-4735-8936-c3736b57aef4,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf969754-62') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG os_vif [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:d2:00,bridge_name='br-int',has_traffic_filtering=True,id=df969754-62c7-4735-8936-c3736b57aef4,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf969754-62') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf969754-62, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf969754-62, col_values=(('external_ids', {'iface-id': 'df969754-62c7-4735-8936-c3736b57aef4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:d2:00', 'vm-uuid': '4c2064b9-f23d-4c26-bf0a-8fa748829b43'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:54 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Took 0.54 seconds to deallocate network for instance.
Aug 15 19:23:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:54 user nova-compute[73188]: INFO os_vif [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:d2:00,bridge_name='br-int',has_traffic_filtering=True,id=df969754-62c7-4735-8936-c3736b57aef4,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf969754-62')
Aug 15 19:23:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] No VIF found with MAC fa:16:3e:4a:d2:00, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:23:54 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:23:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:55 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Deleted allocations for instance a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff
Aug 15 19:23:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-81e1bfef-3d32-43a4-bafb-8502456ab175 tempest-VolumesActionsTest-1468435355 tempest-VolumesActionsTest-1468435355-project-member] Lock "a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.092s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:55 user nova-compute[73188]: DEBUG nova.compute.manager [req-a93404f3-51a4-4eca-8790-d725462738e8 req-d831b9a8-a8ef-4add-a5cf-42e3a97c2d8b service nova] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Received event network-vif-plugged-a9cd3e25-b47c-4c93-8750-458e6800e9ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:23:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a93404f3-51a4-4eca-8790-d725462738e8 req-d831b9a8-a8ef-4add-a5cf-42e3a97c2d8b service nova] Acquiring lock "a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a93404f3-51a4-4eca-8790-d725462738e8 req-d831b9a8-a8ef-4add-a5cf-42e3a97c2d8b service nova] Lock "a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a93404f3-51a4-4eca-8790-d725462738e8 req-d831b9a8-a8ef-4add-a5cf-42e3a97c2d8b service nova] Lock "a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:55 user nova-compute[73188]: DEBUG nova.compute.manager [req-a93404f3-51a4-4eca-8790-d725462738e8 req-d831b9a8-a8ef-4add-a5cf-42e3a97c2d8b service nova] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] No waiting events found dispatching network-vif-plugged-a9cd3e25-b47c-4c93-8750-458e6800e9ff {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:23:55 user nova-compute[73188]: WARNING nova.compute.manager [req-a93404f3-51a4-4eca-8790-d725462738e8 req-d831b9a8-a8ef-4add-a5cf-42e3a97c2d8b service nova] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Received unexpected event network-vif-plugged-a9cd3e25-b47c-4c93-8750-458e6800e9ff for instance with vm_state deleted and task_state None.
Aug 15 19:23:55 user nova-compute[73188]: DEBUG nova.compute.manager [req-a93404f3-51a4-4eca-8790-d725462738e8 req-d831b9a8-a8ef-4add-a5cf-42e3a97c2d8b service nova] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Received event network-vif-deleted-a9cd3e25-b47c-4c93-8750-458e6800e9ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:23:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:56 user nova-compute[73188]: DEBUG nova.compute.manager [req-dd55bc97-9c47-4f85-a1a5-315f7ee5ed94 req-d68a7167-2b1a-414b-8fc7-f71d9a052412 service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Received event network-vif-plugged-df969754-62c7-4735-8936-c3736b57aef4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:23:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-dd55bc97-9c47-4f85-a1a5-315f7ee5ed94 req-d68a7167-2b1a-414b-8fc7-f71d9a052412 service nova] Acquiring lock "4c2064b9-f23d-4c26-bf0a-8fa748829b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-dd55bc97-9c47-4f85-a1a5-315f7ee5ed94 req-d68a7167-2b1a-414b-8fc7-f71d9a052412 service nova] Lock "4c2064b9-f23d-4c26-bf0a-8fa748829b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-dd55bc97-9c47-4f85-a1a5-315f7ee5ed94 req-d68a7167-2b1a-414b-8fc7-f71d9a052412 service nova] Lock "4c2064b9-f23d-4c26-bf0a-8fa748829b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:56 user nova-compute[73188]: DEBUG nova.compute.manager [req-dd55bc97-9c47-4f85-a1a5-315f7ee5ed94 req-d68a7167-2b1a-414b-8fc7-f71d9a052412 service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] No waiting events found dispatching network-vif-plugged-df969754-62c7-4735-8936-c3736b57aef4 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:23:56 user nova-compute[73188]: WARNING nova.compute.manager [req-dd55bc97-9c47-4f85-a1a5-315f7ee5ed94 req-d68a7167-2b1a-414b-8fc7-f71d9a052412 service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Received unexpected event network-vif-plugged-df969754-62c7-4735-8936-c3736b57aef4 for instance with vm_state building and task_state spawning.
Aug 15 19:23:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:23:57 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127437.9237647, 4c2064b9-f23d-4c26-bf0a-8fa748829b43 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:23:57 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] VM Resumed (Lifecycle Event)
Aug 15 19:23:57 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:23:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:23:57 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Instance spawned successfully.
Aug 15 19:23:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:23:57 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:23:57 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:23:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:23:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:23:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:23:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:23:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:23:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:23:57 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:23:57 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127437.9275746, 4c2064b9-f23d-4c26-bf0a-8fa748829b43 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:23:57 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] VM Started (Lifecycle Event)
Aug 15 19:23:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:23:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:23:58 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:23:58 user nova-compute[73188]: INFO nova.compute.manager [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Took 5.08 seconds to spawn the instance on the hypervisor.
Aug 15 19:23:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:23:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-d81c767c-9a9b-43e3-8402-23a022182624 req-9129a208-2abf-429d-84dc-95d3432c0c01 service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Received event network-vif-plugged-df969754-62c7-4735-8936-c3736b57aef4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:23:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d81c767c-9a9b-43e3-8402-23a022182624 req-9129a208-2abf-429d-84dc-95d3432c0c01 service nova] Acquiring lock "4c2064b9-f23d-4c26-bf0a-8fa748829b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:23:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d81c767c-9a9b-43e3-8402-23a022182624 req-9129a208-2abf-429d-84dc-95d3432c0c01 service nova] Lock "4c2064b9-f23d-4c26-bf0a-8fa748829b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:23:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d81c767c-9a9b-43e3-8402-23a022182624 req-9129a208-2abf-429d-84dc-95d3432c0c01 service nova] Lock "4c2064b9-f23d-4c26-bf0a-8fa748829b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-d81c767c-9a9b-43e3-8402-23a022182624 req-9129a208-2abf-429d-84dc-95d3432c0c01 service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] No waiting events found dispatching network-vif-plugged-df969754-62c7-4735-8936-c3736b57aef4 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:23:58 user nova-compute[73188]: WARNING nova.compute.manager [req-d81c767c-9a9b-43e3-8402-23a022182624 req-9129a208-2abf-429d-84dc-95d3432c0c01 service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Received unexpected event network-vif-plugged-df969754-62c7-4735-8936-c3736b57aef4 for instance with vm_state building and task_state spawning.
Aug 15 19:23:58 user nova-compute[73188]: INFO nova.compute.manager [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Took 15.76 seconds to build instance.
Aug 15 19:23:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ba0186a0-cd16-4611-a176-7ee85a3ee385 tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "4c2064b9-f23d-4c26-bf0a-8fa748829b43" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.853s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:23:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:05 user nova-compute[73188]: DEBUG nova.compute.manager [req-9f09aa2b-4b3a-4ab3-8fd6-e62c9a7d4f9d req-67172d3d-113c-42ba-a499-c23788ffb4d9 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Received event network-changed-11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:24:05 user nova-compute[73188]: DEBUG nova.compute.manager [req-9f09aa2b-4b3a-4ab3-8fd6-e62c9a7d4f9d req-67172d3d-113c-42ba-a499-c23788ffb4d9 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Refreshing instance network info cache due to event network-changed-11b7dd56-8608-446d-9229-ccac461f89b2. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:24:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9f09aa2b-4b3a-4ab3-8fd6-e62c9a7d4f9d req-67172d3d-113c-42ba-a499-c23788ffb4d9 service nova] Acquiring lock "refresh_cache-d8f302f1-7c20-483a-9eef-24566d51143d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:24:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9f09aa2b-4b3a-4ab3-8fd6-e62c9a7d4f9d req-67172d3d-113c-42ba-a499-c23788ffb4d9 service nova] Acquired lock "refresh_cache-d8f302f1-7c20-483a-9eef-24566d51143d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:24:05 user nova-compute[73188]: DEBUG nova.network.neutron [req-9f09aa2b-4b3a-4ab3-8fd6-e62c9a7d4f9d req-67172d3d-113c-42ba-a499-c23788ffb4d9 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Refreshing network info cache for port 11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "3d713d03-3e60-4dec-a295-a4652ac21842" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "3d713d03-3e60-4dec-a295-a4652ac21842" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:24:06 user nova-compute[73188]: INFO nova.compute.manager [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Terminating instance
Aug 15 19:24:06 user nova-compute[73188]: DEBUG nova.compute.manager [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:06 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Instance destroyed successfully.
Aug 15 19:24:06 user nova-compute[73188]: DEBUG nova.objects.instance [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'resources' on Instance uuid 3d713d03-3e60-4dec-a295-a4652ac21842 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1431736966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1431736966',id=13,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:10:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ab4e1cccd434f6c83f2f9e4687d274e',ramdisk_id='',reservation_id='r-kff5lb5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:12:03Z,user_data=None,user_id='bad952eceaec400396fd0a28c438c761',uuid=3d713d03-3e60-4dec-a295-a4652ac21842,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "address": "fa:16:3e:b4:8c:fd", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8c4e95-fc", "ovs_interfaceid": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converting VIF {"id": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "address": "fa:16:3e:b4:8c:fd", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a8c4e95-fc", "ovs_interfaceid": "3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:8c:fd,bridge_name='br-int',has_traffic_filtering=True,id=3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8c4e95-fc') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG os_vif [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:8c:fd,bridge_name='br-int',has_traffic_filtering=True,id=3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8c4e95-fc') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a8c4e95-fc, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:06 user nova-compute[73188]: INFO os_vif [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:8c:fd,bridge_name='br-int',has_traffic_filtering=True,id=3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a8c4e95-fc')
Aug 15 19:24:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELbiNtlV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:24:06 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:24:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d0744c-1066-4b51-b3dc-a7ff065382b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc29703-90c6-4ab9-b42a-65a4388f8bfb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:24:06 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:24:06 user nova-compute[73188]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)
Aug 15 19:24:06 user nova-compute[73188]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:24:06 user nova-compute[73188]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:24:06 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c (non-flash)
Aug 15 19:24:06 user nova-compute[73188]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:24:06 user nova-compute[73188]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)
Aug 15 19:24:06 user nova-compute[73188]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:24:06 user nova-compute[73188]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:24:06 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28101e9fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c'): ({'sdb'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Removing single pathed devices sdb {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:24:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-c84b2423-d288-4780-b3a9-9383b9d8d9c9 req-35f3f703-d3f0-4085-8fb0-decdd4b5386b service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received event network-vif-unplugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c84b2423-d288-4780-b3a9-9383b9d8d9c9 req-35f3f703-d3f0-4085-8fb0-decdd4b5386b service nova] Acquiring lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c84b2423-d288-4780-b3a9-9383b9d8d9c9 req-35f3f703-d3f0-4085-8fb0-decdd4b5386b service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c84b2423-d288-4780-b3a9-9383b9d8d9c9 req-35f3f703-d3f0-4085-8fb0-decdd4b5386b service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-c84b2423-d288-4780-b3a9-9383b9d8d9c9 req-35f3f703-d3f0-4085-8fb0-decdd4b5386b service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] No waiting events found dispatching network-vif-unplugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-c84b2423-d288-4780-b3a9-9383b9d8d9c9 req-35f3f703-d3f0-4085-8fb0-decdd4b5386b service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received event network-vif-unplugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[087290c9-9c66-4ee1-bf33-3c6c1f856814]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed214ab-3873-45f8-973f-01f1506ce694]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Flushing IO for device /dev/sdb {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6543b10b-9a3a-4da6-a1cd-8355b554cb3e]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8250c4a-d7ee-43bd-af5d-a3ad5e07a297]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e177d67b-3639-42b7-946c-3f79e04a7fff]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b9e1ed-903a-402d-9956-82bb19187fd4]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c, portal: 172.16.0.220,3260]
Aug 15 19:24:07 user nova-compute[73188]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c, portal: 172.16.0.220,3260] successful.
Aug 15 19:24:07 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f900015-9127-4c92-b74d-568597372c4c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6372c253-cde5-49ee-9d33-38143efc7f5d]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] <== disconnect_volume: return (337ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:24:07 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Deleting instance files /opt/stack/data/nova/instances/3d713d03-3e60-4dec-a295-a4652ac21842_del
Aug 15 19:24:07 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Deletion of /opt/stack/data/nova/instances/3d713d03-3e60-4dec-a295-a4652ac21842_del complete
Aug 15 19:24:07 user nova-compute[73188]: DEBUG nova.network.neutron [req-9f09aa2b-4b3a-4ab3-8fd6-e62c9a7d4f9d req-67172d3d-113c-42ba-a499-c23788ffb4d9 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Updated VIF entry in instance network info cache for port 11b7dd56-8608-446d-9229-ccac461f89b2. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG nova.network.neutron [req-9f09aa2b-4b3a-4ab3-8fd6-e62c9a7d4f9d req-67172d3d-113c-42ba-a499-c23788ffb4d9 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Updating instance_info_cache with network_info: [{"id": "11b7dd56-8608-446d-9229-ccac461f89b2", "address": "fa:16:3e:e6:c1:cc", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b7dd56-86", "ovs_interfaceid": "11b7dd56-8608-446d-9229-ccac461f89b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9f09aa2b-4b3a-4ab3-8fd6-e62c9a7d4f9d req-67172d3d-113c-42ba-a499-c23788ffb4d9 service nova] Releasing lock "refresh_cache-d8f302f1-7c20-483a-9eef-24566d51143d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:24:07 user nova-compute[73188]: INFO nova.compute.manager [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-c453a3ca-24e4-474c-b63a-e0b9ce9be30f req-3bfcfba4-7555-41b6-bc28-cb3501acf367 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Received event network-changed-11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-c453a3ca-24e4-474c-b63a-e0b9ce9be30f req-3bfcfba4-7555-41b6-bc28-cb3501acf367 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Refreshing instance network info cache due to event network-changed-11b7dd56-8608-446d-9229-ccac461f89b2. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c453a3ca-24e4-474c-b63a-e0b9ce9be30f req-3bfcfba4-7555-41b6-bc28-cb3501acf367 service nova] Acquiring lock "refresh_cache-d8f302f1-7c20-483a-9eef-24566d51143d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c453a3ca-24e4-474c-b63a-e0b9ce9be30f req-3bfcfba4-7555-41b6-bc28-cb3501acf367 service nova] Acquired lock "refresh_cache-d8f302f1-7c20-483a-9eef-24566d51143d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG nova.network.neutron [req-c453a3ca-24e4-474c-b63a-e0b9ce9be30f req-3bfcfba4-7555-41b6-bc28-cb3501acf367 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Refreshing network info cache for port 11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "d8f302f1-7c20-483a-9eef-24566d51143d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "d8f302f1-7c20-483a-9eef-24566d51143d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:24:07 user nova-compute[73188]: INFO nova.compute.manager [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Detaching volume 1dd8f2f7-1270-42d7-84c7-0849183b1640
Aug 15 19:24:07 user nova-compute[73188]: INFO nova.virt.block_device [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Attempting to driver detach volume 1dd8f2f7-1270-42d7-84c7-0849183b1640 from mountpoint /dev/vdb
Aug 15 19:24:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Attempting to detach device vdb from instance d8f302f1-7c20-483a-9eef-24566d51143d from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:24:07 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:24:07 user nova-compute[73188]:   <source dev="/dev/sdf"/>
Aug 15 19:24:07 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:24:07 user nova-compute[73188]:   <serial>1dd8f2f7-1270-42d7-84c7-0849183b1640</serial>
Aug 15 19:24:07 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:24:07 user nova-compute[73188]: </disk>
Aug 15 19:24:07 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:24:07 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Successfully detached device vdb from instance d8f302f1-7c20-483a-9eef-24566d51143d from the persistent domain config.
Aug 15 19:24:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d8f302f1-7c20-483a-9eef-24566d51143d from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:24:07 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:24:07 user nova-compute[73188]:   <source dev="/dev/sdf"/>
Aug 15 19:24:07 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:24:07 user nova-compute[73188]:   <serial>1dd8f2f7-1270-42d7-84c7-0849183b1640</serial>
Aug 15 19:24:07 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:24:07 user nova-compute[73188]: </disk>
Aug 15 19:24:07 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG nova.network.neutron [req-c453a3ca-24e4-474c-b63a-e0b9ce9be30f req-3bfcfba4-7555-41b6-bc28-cb3501acf367 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Updated VIF entry in instance network info cache for port 11b7dd56-8608-446d-9229-ccac461f89b2. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG nova.network.neutron [req-c453a3ca-24e4-474c-b63a-e0b9ce9be30f req-3bfcfba4-7555-41b6-bc28-cb3501acf367 service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Updating instance_info_cache with network_info: [{"id": "11b7dd56-8608-446d-9229-ccac461f89b2", "address": "fa:16:3e:e6:c1:cc", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b7dd56-86", "ovs_interfaceid": "11b7dd56-8608-446d-9229-ccac461f89b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c453a3ca-24e4-474c-b63a-e0b9ce9be30f req-3bfcfba4-7555-41b6-bc28-cb3501acf367 service nova] Releasing lock "refresh_cache-d8f302f1-7c20-483a-9eef-24566d51143d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:24:07 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:24:07 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Took 0.56 seconds to deallocate network for instance.
Aug 15 19:24:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692127448.0480487, d8f302f1-7c20-483a-9eef-24566d51143d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d8f302f1-7c20-483a-9eef-24566d51143d {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:24:08 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Successfully detached device vdb from instance d8f302f1-7c20-483a-9eef-24566d51143d from the live domain config.
Aug 15 19:24:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqXKtJpR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:24:08 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:24:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[10684579-ebe0-4af2-9545-16045a357e51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cc12c5-ca87-4328-8bbd-c930532dd436]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:24:08 user nova-compute[73188]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)
Aug 15 19:24:08 user nova-compute[73188]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:24:08 user nova-compute[73188]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:24:08 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:24:08 user nova-compute[73188]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 (non-flash)
Aug 15 19:24:08 user nova-compute[73188]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:24:08 user nova-compute[73188]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:24:08 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28082b8820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640'): ({'sdf'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Removing single pathed devices sdf {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5874a698-fdbf-41a7-9535-661a8acba548]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cffaca-5010-4930-b192-a88a004218d2]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Flushing IO for device /dev/sdf {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[156507ff-3b95-4f0f-aeb0-df4b37b42c64]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a148d2-0839-4f55-94c5-f90071a5c86e]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] SCSI volumes sdf have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[71324fe8-0daf-4b86-b5d1-eec56c89485f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dc1034-b4cb-42e6-903c-7f8c30bdede7]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640, portal: 172.16.0.220,3260]
Aug 15 19:24:08 user nova-compute[73188]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640, portal: 172.16.0.220,3260] successful.
Aug 15 19:24:08 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dd8f2f7-1270-42d7-84c7-0849183b1640 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5331e2-cbea-4c22-8634-cf9aa3d2484f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] <== disconnect_volume: return (285ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:24:08 user nova-compute[73188]: INFO nova.compute.manager [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Took 0.77 seconds to detach 1 volumes for instance.
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:24:08 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127433.8070273, a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:24:08 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] VM Stopped (Lifecycle Event)
Aug 15 19:24:08 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3669ee6a-d463-41f7-81c5-22c6539e93be None None] [instance: a2ec86ce-ab4a-4bdc-b4f4-2f62adbb7dff] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:24:09 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:24:09 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:24:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-dbb107b6-098f-4c79-8da2-7aff02bff7f6 req-75c40495-ad0a-437d-b836-1de55d9fb547 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received event network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:24:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-dbb107b6-098f-4c79-8da2-7aff02bff7f6 req-75c40495-ad0a-437d-b836-1de55d9fb547 service nova] Acquiring lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:24:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-dbb107b6-098f-4c79-8da2-7aff02bff7f6 req-75c40495-ad0a-437d-b836-1de55d9fb547 service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:24:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-dbb107b6-098f-4c79-8da2-7aff02bff7f6 req-75c40495-ad0a-437d-b836-1de55d9fb547 service nova] Lock "3d713d03-3e60-4dec-a295-a4652ac21842-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:24:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-dbb107b6-098f-4c79-8da2-7aff02bff7f6 req-75c40495-ad0a-437d-b836-1de55d9fb547 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] No waiting events found dispatching network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:24:09 user nova-compute[73188]: WARNING nova.compute.manager [req-dbb107b6-098f-4c79-8da2-7aff02bff7f6 req-75c40495-ad0a-437d-b836-1de55d9fb547 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received unexpected event network-vif-plugged-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d for instance with vm_state deleted and task_state None.
Aug 15 19:24:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-dbb107b6-098f-4c79-8da2-7aff02bff7f6 req-75c40495-ad0a-437d-b836-1de55d9fb547 service nova] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Received event network-vif-deleted-3a8c4e95-fcd6-4aac-a7fe-fcd433f63b6d {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:24:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:24:09 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Deleted allocations for instance 3d713d03-3e60-4dec-a295-a4652ac21842
Aug 15 19:24:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6fe458ae-cbfc-4411-a90f-97a8ea2fb883 tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "3d713d03-3e60-4dec-a295-a4652ac21842" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.202s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:24:09 user nova-compute[73188]: DEBUG nova.objects.instance [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lazy-loading 'flavor' on Instance uuid d8f302f1-7c20-483a-9eef-24566d51143d {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:24:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c26a9268-61e6-415d-9583-dfeda3a8a864 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "d8f302f1-7c20-483a-9eef-24566d51143d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.860s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:24:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:21 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127446.8429475, 3d713d03-3e60-4dec-a295-a4652ac21842 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:24:21 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] VM Stopped (Lifecycle Event)
Aug 15 19:24:21 user nova-compute[73188]: DEBUG nova.compute.manager [None req-6038ca72-f291-4ce4-93ff-7b5efa9eaa3e None None] [instance: 3d713d03-3e60-4dec-a295-a4652ac21842] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:24:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:22 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:24:24 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:24:24 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:24:25 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:24:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:24:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:24:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:24:25 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:24:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:24:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:24:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:24:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:29 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:24:29 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:24:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=7341MB free_disk=25.10150909423828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:24:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:24:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:24:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Applying migration context for instance e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 as it has an incoming, in-progress migration 4a3ee4d1-3b41-46d2-a271-c65e9470eca5. Migration status is finished {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 19:24:29 user nova-compute[73188]: INFO nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Updating resource usage from migration 4a3ee4d1-3b41-46d2-a271-c65e9470eca5
Aug 15 19:24:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:24:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e00adf53-085f-436d-a09f-e97e92ca79cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:24:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 139ccf1c-4792-4653-9475-c61b1f9c4846 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:24:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 215077af-60a1-4a82-b24e-1545349363d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:24:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance b3dd183e-7ab1-40ae-b282-40575a9e47df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:24:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:24:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance d8f302f1-7c20-483a-9eef-24566d51143d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:24:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Migration 4a3ee4d1-3b41-46d2-a271-c65e9470eca5 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 19:24:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:24:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3e0ab835-00ac-4db2-a93f-257559fa29b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:24:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 4c2064b9-f23d-4c26-bf0a-8fa748829b43 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:24:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:24:29 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:24:30 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:24:30 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:24:30 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:24:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:24:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:32 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:24:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:24:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-215077af-60a1-4a82-b24e-1545349363d0" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:24:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-215077af-60a1-4a82-b24e-1545349363d0" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:24:32 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:24:32 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Updating instance_info_cache with network_info: [{"id": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "address": "fa:16:3e:d0:70:59", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38266cdc-3c", "ovs_interfaceid": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:24:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-215077af-60a1-4a82-b24e-1545349363d0" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:24:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:24:32 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:24:32 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:24:32 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:24:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:24:33 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:24:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:24:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ff16f752-38d2-40df-90af-3c045e5d29ab tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:24:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ff16f752-38d2-40df-90af-3c045e5d29ab tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:24:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ff16f752-38d2-40df-90af-3c045e5d29ab tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Going to confirm migration 2 {{(pid=73188) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 15 19:24:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ff16f752-38d2-40df-90af-3c045e5d29ab tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "refresh_cache-e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:24:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ff16f752-38d2-40df-90af-3c045e5d29ab tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquired lock "refresh_cache-e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:24:47 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ff16f752-38d2-40df-90af-3c045e5d29ab tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:24:47 user nova-compute[73188]: DEBUG nova.objects.instance [None req-ff16f752-38d2-40df-90af-3c045e5d29ab tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'info_cache' on Instance uuid e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:24:47 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ff16f752-38d2-40df-90af-3c045e5d29ab tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Updating instance_info_cache with network_info: [{"id": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "address": "fa:16:3e:20:ae:90", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b20fd1-f9", "ovs_interfaceid": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:24:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ff16f752-38d2-40df-90af-3c045e5d29ab tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Releasing lock "refresh_cache-e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:24:47 user nova-compute[73188]: DEBUG nova.objects.instance [None req-ff16f752-38d2-40df-90af-3c045e5d29ab tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'migration_context' on Instance uuid e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:24:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ff16f752-38d2-40df-90af-3c045e5d29ab tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:24:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ff16f752-38d2-40df-90af-3c045e5d29ab tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:24:48 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-ff16f752-38d2-40df-90af-3c045e5d29ab tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:24:48 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-ff16f752-38d2-40df-90af-3c045e5d29ab tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:24:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ff16f752-38d2-40df-90af-3c045e5d29ab tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.359s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:24:48 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-ff16f752-38d2-40df-90af-3c045e5d29ab tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Deleted allocation for migration 4a3ee4d1-3b41-46d2-a271-c65e9470eca5
Aug 15 19:24:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ff16f752-38d2-40df-90af-3c045e5d29ab tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.492s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:24:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:24:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:24:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:24:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:24:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-e6778286-1de6-4105-b70c-a85af0fc3c6a req-34a17543-fd29-4b21-b44a-216b1e3863e1 service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Received event network-changed-793141da-bf20-4bd2-9fec-c6ecde2601ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:24:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-e6778286-1de6-4105-b70c-a85af0fc3c6a req-34a17543-fd29-4b21-b44a-216b1e3863e1 service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Refreshing instance network info cache due to event network-changed-793141da-bf20-4bd2-9fec-c6ecde2601ff. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:24:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e6778286-1de6-4105-b70c-a85af0fc3c6a req-34a17543-fd29-4b21-b44a-216b1e3863e1 service nova] Acquiring lock "refresh_cache-3e0ab835-00ac-4db2-a93f-257559fa29b6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:24:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e6778286-1de6-4105-b70c-a85af0fc3c6a req-34a17543-fd29-4b21-b44a-216b1e3863e1 service nova] Acquired lock "refresh_cache-3e0ab835-00ac-4db2-a93f-257559fa29b6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:24:52 user nova-compute[73188]: DEBUG nova.network.neutron [req-e6778286-1de6-4105-b70c-a85af0fc3c6a req-34a17543-fd29-4b21-b44a-216b1e3863e1 service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Refreshing network info cache for port 793141da-bf20-4bd2-9fec-c6ecde2601ff {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "3e0ab835-00ac-4db2-a93f-257559fa29b6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "3e0ab835-00ac-4db2-a93f-257559fa29b6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG nova.objects.instance [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lazy-loading 'flavor' on Instance uuid 3e0ab835-00ac-4db2-a93f-257559fa29b6 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:24:53 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Ignoring supplied device name: /dev/vdb
Aug 15 19:24:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "3e0ab835-00ac-4db2-a93f-257559fa29b6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.341s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "3e0ab835-00ac-4db2-a93f-257559fa29b6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "3e0ab835-00ac-4db2-a93f-257559fa29b6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:24:53 user nova-compute[73188]: INFO nova.compute.manager [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Attaching volume e78510ba-ac5b-4386-ba99-361ec5f65e40 to /dev/vdb
Aug 15 19:24:53 user nova-compute[73188]: DEBUG os_brick.utils [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ef51b0-3e2b-4882-acc2-68e164a12cb0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG nova.network.neutron [req-e6778286-1de6-4105-b70c-a85af0fc3c6a req-34a17543-fd29-4b21-b44a-216b1e3863e1 service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Updated VIF entry in instance network info cache for port 793141da-bf20-4bd2-9fec-c6ecde2601ff. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG nova.network.neutron [req-e6778286-1de6-4105-b70c-a85af0fc3c6a req-34a17543-fd29-4b21-b44a-216b1e3863e1 service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Updating instance_info_cache with network_info: [{"id": "793141da-bf20-4bd2-9fec-c6ecde2601ff", "address": "fa:16:3e:3b:96:24", "network": {"id": "852c135b-1d66-4329-8090-3770310ffce0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1628017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72b50bc97b84e3dac8161b6a36f50ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793141da-bf", "ovs_interfaceid": "793141da-bf20-4bd2-9fec-c6ecde2601ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f5158c-2a7a-4266-b53e-47e49307c554]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e6778286-1de6-4105-b70c-a85af0fc3c6a req-34a17543-fd29-4b21-b44a-216b1e3863e1 service nova] Releasing lock "refresh_cache-3e0ab835-00ac-4db2-a93f-257559fa29b6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de7a2d1-4e08-4486-9885-78ca36e017a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9ecff3-afb1-45ae-b354-8a68f7ad5b6a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:24:53 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:24:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19e266a-89a1-438d-87db-8e85bf7590fc]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG os_brick.utils [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:24:53 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Updating existing volume attachment record: a4700a26-5be1-40c4-92d4-e9dea77a858b {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:24:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:24:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:24:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:24:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:24:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:24:56 user nova-compute[73188]: INFO nova.compute.manager [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Terminating instance
Aug 15 19:24:56 user nova-compute[73188]: DEBUG nova.compute.manager [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:24:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:57 user nova-compute[73188]: DEBUG nova.compute.manager [req-fa2efeb9-376e-49c3-91c9-48c502008325 req-4ef10990-36bf-42c5-8f72-96bd2ecc95e8 service nova] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Received event network-vif-unplugged-85966f51-bc7f-46ed-8065-ecec627cfeb7 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:24:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fa2efeb9-376e-49c3-91c9-48c502008325 req-4ef10990-36bf-42c5-8f72-96bd2ecc95e8 service nova] Acquiring lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:24:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fa2efeb9-376e-49c3-91c9-48c502008325 req-4ef10990-36bf-42c5-8f72-96bd2ecc95e8 service nova] Lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:24:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fa2efeb9-376e-49c3-91c9-48c502008325 req-4ef10990-36bf-42c5-8f72-96bd2ecc95e8 service nova] Lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:24:57 user nova-compute[73188]: DEBUG nova.compute.manager [req-fa2efeb9-376e-49c3-91c9-48c502008325 req-4ef10990-36bf-42c5-8f72-96bd2ecc95e8 service nova] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] No waiting events found dispatching network-vif-unplugged-85966f51-bc7f-46ed-8065-ecec627cfeb7 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:24:57 user nova-compute[73188]: DEBUG nova.compute.manager [req-fa2efeb9-376e-49c3-91c9-48c502008325 req-4ef10990-36bf-42c5-8f72-96bd2ecc95e8 service nova] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Received event network-vif-unplugged-85966f51-bc7f-46ed-8065-ecec627cfeb7 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:24:57 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Instance destroyed successfully.
Aug 15 19:24:57 user nova-compute[73188]: DEBUG nova.objects.instance [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lazy-loading 'resources' on Instance uuid ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:24:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:05:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-978893005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-978893005',id=1,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:05:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ab4e1cccd434f6c83f2f9e4687d274e',ramdisk_id='',reservation_id='r-asjt4bjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:07:12Z,user_data=None,user_id='bad952eceaec400396fd0a28c438c761',uuid=ff4ca43e-3c17-458a-bd3e-4204a6d96fd6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "address": "fa:16:3e:df:71:ad", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85966f51-bc", "ovs_interfaceid": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:24:57 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converting VIF {"id": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "address": "fa:16:3e:df:71:ad", "network": {"id": "4469d281-fb9d-449a-9d9d-a403422d4205", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1951894683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab4e1cccd434f6c83f2f9e4687d274e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85966f51-bc", "ovs_interfaceid": "85966f51-bc7f-46ed-8065-ecec627cfeb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:24:57 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:71:ad,bridge_name='br-int',has_traffic_filtering=True,id=85966f51-bc7f-46ed-8065-ecec627cfeb7,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85966f51-bc') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:24:57 user nova-compute[73188]: DEBUG os_vif [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:71:ad,bridge_name='br-int',has_traffic_filtering=True,id=85966f51-bc7f-46ed-8065-ecec627cfeb7,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85966f51-bc') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:24:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85966f51-bc, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:24:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:24:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:57 user nova-compute[73188]: INFO os_vif [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:71:ad,bridge_name='br-int',has_traffic_filtering=True,id=85966f51-bc7f-46ed-8065-ecec627cfeb7,network=Network(4469d281-fb9d-449a-9d9d-a403422d4205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85966f51-bc')
Aug 15 19:24:57 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Deleting instance files /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6_del
Aug 15 19:24:57 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Deletion of /opt/stack/data/nova/instances/ff4ca43e-3c17-458a-bd3e-4204a6d96fd6_del complete
Aug 15 19:24:57 user nova-compute[73188]: INFO nova.compute.manager [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Took 0.75 seconds to destroy the instance on the hypervisor.
Aug 15 19:24:57 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:24:57 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:24:57 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:24:58 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:24:58 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Took 0.95 seconds to deallocate network for instance.
Aug 15 19:24:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-e229c543-af03-4103-9379-5783ae57f299 req-7be46d0b-5a99-4f21-970d-eefccd097ac6 service nova] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Received event network-vif-deleted-85966f51-bc7f-46ed-8065-ecec627cfeb7 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:24:58 user nova-compute[73188]: DEBUG nova.objects.instance [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'flavor' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:24:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "refresh_cache-b3dd183e-7ab1-40ae-b282-40575a9e47df" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:24:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquired lock "refresh_cache-b3dd183e-7ab1-40ae-b282-40575a9e47df" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:24:58 user nova-compute[73188]: DEBUG nova.network.neutron [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:24:58 user nova-compute[73188]: DEBUG nova.objects.instance [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'info_cache' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:24:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:24:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:24:58 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:24:58 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:24:59 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Deleted allocations for instance ff4ca43e-3c17-458a-bd3e-4204a6d96fd6
Aug 15 19:24:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0a83f577-eb29-4f6a-9cd7-28f04a76cd8b tempest-ServerBootFromVolumeStableRescueTest-1886926549 tempest-ServerBootFromVolumeStableRescueTest-1886926549-project-member] Lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.495s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.compute.manager [req-e0cebcb0-565c-47bb-aba0-e839a73764a3 req-5918dd4a-61c8-4d7d-bf8f-3a745eecfe8c service nova] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Received event network-vif-plugged-85966f51-bc7f-46ed-8065-ecec627cfeb7 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e0cebcb0-565c-47bb-aba0-e839a73764a3 req-5918dd4a-61c8-4d7d-bf8f-3a745eecfe8c service nova] Acquiring lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e0cebcb0-565c-47bb-aba0-e839a73764a3 req-5918dd4a-61c8-4d7d-bf8f-3a745eecfe8c service nova] Lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e0cebcb0-565c-47bb-aba0-e839a73764a3 req-5918dd4a-61c8-4d7d-bf8f-3a745eecfe8c service nova] Lock "ff4ca43e-3c17-458a-bd3e-4204a6d96fd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.compute.manager [req-e0cebcb0-565c-47bb-aba0-e839a73764a3 req-5918dd4a-61c8-4d7d-bf8f-3a745eecfe8c service nova] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] No waiting events found dispatching network-vif-plugged-85966f51-bc7f-46ed-8065-ecec627cfeb7 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:24:59 user nova-compute[73188]: WARNING nova.compute.manager [req-e0cebcb0-565c-47bb-aba0-e839a73764a3 req-5918dd4a-61c8-4d7d-bf8f-3a745eecfe8c service nova] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Received unexpected event network-vif-plugged-85966f51-bc7f-46ed-8065-ecec627cfeb7 for instance with vm_state deleted and task_state None.
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.network.neutron [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Updating instance_info_cache with network_info: [{"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Releasing lock "refresh_cache-b3dd183e-7ab1-40ae-b282-40575a9e47df" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:24:59 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Instance destroyed successfully.
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.objects.instance [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'resources' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-10055614',display_name='tempest-AttachVolumeTestJSON-server-10055614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-10055614',id=28,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMQScQjuREEUf8BduiZ5KX0osvQ5QWZEC23alXhUk4mA8l8fA2zn02jcheLrGtQU0hVs1wuTRm/gfQIlRP/+vodTg9/qG3oTDrK2DQcQ9kCcFR8/YFg4QfP/P5iwNCjNg==',key_name='tempest-keypair-229082612',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:17:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='399c3c31298f41dbb11ae1c0bc593e1f',ramdisk_id='',reservation_id='r-jd0udn2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-953696987',owner_user_name='tempest-AttachVolumeTestJSON-953696987-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:23:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae5b2b05980944af80c4ffe09cd20de1',uuid=b3dd183e-7ab1-40ae-b282-40575a9e47df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converting VIF {"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:98,bridge_name='br-int',has_traffic_filtering=True,id=0546e618-e785-46c7-aa82-d527ec295deb,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0546e618-e7') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG os_vif [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:98,bridge_name='br-int',has_traffic_filtering=True,id=0546e618-e785-46c7-aa82-d527ec295deb,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0546e618-e7') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0546e618-e7, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:24:59 user nova-compute[73188]: INFO os_vif [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:98,bridge_name='br-int',has_traffic_filtering=True,id=0546e618-e785-46c7-aa82-d527ec295deb,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0546e618-e7')
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Start _get_guest_xml network_info=[{"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.objects.instance [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'numa_topology' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:24:59 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:24:59 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.objects.instance [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'vcpu_model' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-10055614',display_name='tempest-AttachVolumeTestJSON-server-10055614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-10055614',id=28,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMQScQjuREEUf8BduiZ5KX0osvQ5QWZEC23alXhUk4mA8l8fA2zn02jcheLrGtQU0hVs1wuTRm/gfQIlRP/+vodTg9/qG3oTDrK2DQcQ9kCcFR8/YFg4QfP/P5iwNCjNg==',key_name='tempest-keypair-229082612',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:17:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='399c3c31298f41dbb11ae1c0bc593e1f',ramdisk_id='',reservation_id='r-jd0udn2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-953696987',owner_user_name='tempest-AttachVolumeTestJSON-953696987-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:23:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae5b2b05980944af80c4ffe09cd20de1',uuid=b3dd183e-7ab1-40ae-b282-40575a9e47df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converting VIF {"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:98,bridge_name='br-int',has_traffic_filtering=True,id=0546e618-e785-46c7-aa82-d527ec295deb,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0546e618-e7') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.objects.instance [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'pci_devices' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:24:59 user nova-compute[73188]:   <uuid>b3dd183e-7ab1-40ae-b282-40575a9e47df</uuid>
Aug 15 19:24:59 user nova-compute[73188]:   <name>instance-0000001c</name>
Aug 15 19:24:59 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:24:59 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:24:59 user nova-compute[73188]:   <metadata>
Aug 15 19:24:59 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:24:59 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:24:59 user nova-compute[73188]:       <nova:name>tempest-AttachVolumeTestJSON-server-10055614</nova:name>
Aug 15 19:24:59 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:24:59</nova:creationTime>
Aug 15 19:24:59 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:24:59 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:24:59 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:24:59 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:24:59 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:24:59 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:24:59 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:24:59 user nova-compute[73188]:       <nova:owner>
Aug 15 19:24:59 user nova-compute[73188]:         <nova:user uuid="ae5b2b05980944af80c4ffe09cd20de1">tempest-AttachVolumeTestJSON-953696987-project-member</nova:user>
Aug 15 19:24:59 user nova-compute[73188]:         <nova:project uuid="399c3c31298f41dbb11ae1c0bc593e1f">tempest-AttachVolumeTestJSON-953696987</nova:project>
Aug 15 19:24:59 user nova-compute[73188]:       </nova:owner>
Aug 15 19:24:59 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:24:59 user nova-compute[73188]:       <nova:ports>
Aug 15 19:24:59 user nova-compute[73188]:         <nova:port uuid="0546e618-e785-46c7-aa82-d527ec295deb">
Aug 15 19:24:59 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 19:24:59 user nova-compute[73188]:         </nova:port>
Aug 15 19:24:59 user nova-compute[73188]:       </nova:ports>
Aug 15 19:24:59 user nova-compute[73188]:     </nova:instance>
Aug 15 19:24:59 user nova-compute[73188]:   </metadata>
Aug 15 19:24:59 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:24:59 user nova-compute[73188]:     <system>
Aug 15 19:24:59 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:24:59 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:24:59 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:24:59 user nova-compute[73188]:       <entry name="serial">b3dd183e-7ab1-40ae-b282-40575a9e47df</entry>
Aug 15 19:24:59 user nova-compute[73188]:       <entry name="uuid">b3dd183e-7ab1-40ae-b282-40575a9e47df</entry>
Aug 15 19:24:59 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:24:59 user nova-compute[73188]:     </system>
Aug 15 19:24:59 user nova-compute[73188]:   </sysinfo>
Aug 15 19:24:59 user nova-compute[73188]:   <os>
Aug 15 19:24:59 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:24:59 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:24:59 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:24:59 user nova-compute[73188]:   </os>
Aug 15 19:24:59 user nova-compute[73188]:   <features>
Aug 15 19:24:59 user nova-compute[73188]:     <acpi/>
Aug 15 19:24:59 user nova-compute[73188]:     <apic/>
Aug 15 19:24:59 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:24:59 user nova-compute[73188]:   </features>
Aug 15 19:24:59 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:24:59 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:24:59 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:24:59 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:24:59 user nova-compute[73188]:   </clock>
Aug 15 19:24:59 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:24:59 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:24:59 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:24:59 user nova-compute[73188]:   </cpu>
Aug 15 19:24:59 user nova-compute[73188]:   <devices>
Aug 15 19:24:59 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:24:59 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:24:59 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk"/>
Aug 15 19:24:59 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:24:59 user nova-compute[73188]:     </disk>
Aug 15 19:24:59 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:24:59 user nova-compute[73188]:       <mac address="fa:16:3e:d9:51:98"/>
Aug 15 19:24:59 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:24:59 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:24:59 user nova-compute[73188]:       <target dev="tap0546e618-e7"/>
Aug 15 19:24:59 user nova-compute[73188]:     </interface>
Aug 15 19:24:59 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:24:59 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/console.log" append="off"/>
Aug 15 19:24:59 user nova-compute[73188]:     </serial>
Aug 15 19:24:59 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:24:59 user nova-compute[73188]:     <video>
Aug 15 19:24:59 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:24:59 user nova-compute[73188]:     </video>
Aug 15 19:24:59 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:24:59 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:24:59 user nova-compute[73188]:     </rng>
Aug 15 19:24:59 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:24:59 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:24:59 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:24:59 user nova-compute[73188]:     </memballoon>
Aug 15 19:24:59 user nova-compute[73188]:   </devices>
Aug 15 19:24:59 user nova-compute[73188]: </domain>
Aug 15 19:24:59 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:24:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:00 user nova-compute[73188]: DEBUG nova.objects.instance [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'trusted_certs' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:25:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.215s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:00 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:25:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:00 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Cannot resize image /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:25:00 user nova-compute[73188]: DEBUG nova.objects.instance [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'migration_context' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:25:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-10055614',display_name='tempest-AttachVolumeTestJSON-server-10055614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-10055614',id=28,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMQScQjuREEUf8BduiZ5KX0osvQ5QWZEC23alXhUk4mA8l8fA2zn02jcheLrGtQU0hVs1wuTRm/gfQIlRP/+vodTg9/qG3oTDrK2DQcQ9kCcFR8/YFg4QfP/P5iwNCjNg==',key_name='tempest-keypair-229082612',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:17:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='399c3c31298f41dbb11ae1c0bc593e1f',ramdisk_id='',reservation_id='r-jd0udn2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-953696987',owner_user_name='tempest-AttachVolumeTestJSON-953696987-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:23:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae5b2b05980944af80c4ffe09cd20de1',uuid=b3dd183e-7ab1-40ae-b282-40575a9e47df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:25:00 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converting VIF {"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:25:00 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:98,bridge_name='br-int',has_traffic_filtering=True,id=0546e618-e785-46c7-aa82-d527ec295deb,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0546e618-e7') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:25:00 user nova-compute[73188]: DEBUG os_vif [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:98,bridge_name='br-int',has_traffic_filtering=True,id=0546e618-e785-46c7-aa82-d527ec295deb,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0546e618-e7') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:25:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:25:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:25:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0546e618-e7, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:25:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0546e618-e7, col_values=(('external_ids', {'iface-id': '0546e618-e785-46c7-aa82-d527ec295deb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:51:98', 'vm-uuid': 'b3dd183e-7ab1-40ae-b282-40575a9e47df'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:25:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:25:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:00 user nova-compute[73188]: INFO os_vif [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:51:98,bridge_name='br-int',has_traffic_filtering=True,id=0546e618-e785-46c7-aa82-d527ec295deb,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0546e618-e7')
Aug 15 19:25:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:01 user nova-compute[73188]: INFO nova.compute.manager [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Detaching volume dfbcd191-af36-4608-8861-dfd9587ed764
Aug 15 19:25:01 user nova-compute[73188]: INFO nova.virt.block_device [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Attempting to driver detach volume dfbcd191-af36-4608-8861-dfd9587ed764 from mountpoint /dev/vdb
Aug 15 19:25:01 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Attempting to detach device vdb from instance 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:25:01 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:25:01 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:25:01 user nova-compute[73188]:   <source dev="/dev/sdh"/>
Aug 15 19:25:01 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:25:01 user nova-compute[73188]:   <serial>dfbcd191-af36-4608-8861-dfd9587ed764</serial>
Aug 15 19:25:01 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:25:01 user nova-compute[73188]: </disk>
Aug 15 19:25:01 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:25:01 user nova-compute[73188]: DEBUG nova.compute.manager [req-29756306-c2be-495b-b337-57be01591357 req-291d2a5e-92fe-4bf1-94fb-a1fb25bb48f8 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received event network-changed-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:25:01 user nova-compute[73188]: DEBUG nova.compute.manager [req-29756306-c2be-495b-b337-57be01591357 req-291d2a5e-92fe-4bf1-94fb-a1fb25bb48f8 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Refreshing instance network info cache due to event network-changed-6225a308-7ed4-4b5e-baf9-217609c291e5. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:25:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-29756306-c2be-495b-b337-57be01591357 req-291d2a5e-92fe-4bf1-94fb-a1fb25bb48f8 service nova] Acquiring lock "refresh_cache-5c2929f0-0a13-4279-ba1a-085ffdb2cd83" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:25:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-29756306-c2be-495b-b337-57be01591357 req-291d2a5e-92fe-4bf1-94fb-a1fb25bb48f8 service nova] Acquired lock "refresh_cache-5c2929f0-0a13-4279-ba1a-085ffdb2cd83" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:25:01 user nova-compute[73188]: DEBUG nova.network.neutron [req-29756306-c2be-495b-b337-57be01591357 req-291d2a5e-92fe-4bf1-94fb-a1fb25bb48f8 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Refreshing network info cache for port 6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:25:01 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Successfully detached device vdb from instance 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 from the persistent domain config.
Aug 15 19:25:01 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:25:01 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:25:01 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:25:01 user nova-compute[73188]:   <source dev="/dev/sdh"/>
Aug 15 19:25:01 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:25:01 user nova-compute[73188]:   <serial>dfbcd191-af36-4608-8861-dfd9587ed764</serial>
Aug 15 19:25:01 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:25:01 user nova-compute[73188]: </disk>
Aug 15 19:25:01 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:25:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692127502.07466, 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:25:02 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Successfully detached device vdb from instance 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 from the live domain config.
Aug 15 19:25:02 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQFLDpxf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:25:02 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:25:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG nova.network.neutron [req-29756306-c2be-495b-b337-57be01591357 req-291d2a5e-92fe-4bf1-94fb-a1fb25bb48f8 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Updated VIF entry in instance network info cache for port 6225a308-7ed4-4b5e-baf9-217609c291e5. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG nova.network.neutron [req-29756306-c2be-495b-b337-57be01591357 req-291d2a5e-92fe-4bf1-94fb-a1fb25bb48f8 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Updating instance_info_cache with network_info: [{"id": "6225a308-7ed4-4b5e-baf9-217609c291e5", "address": "fa:16:3e:a1:7a:2a", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6225a308-7e", "ovs_interfaceid": "6225a308-7ed4-4b5e-baf9-217609c291e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17228dc-8c7a-4e3f-87ce-6c5eaa4f972e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61b078fc-7751-4117-a3b1-23b940bf93da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-29756306-c2be-495b-b337-57be01591357 req-291d2a5e-92fe-4bf1-94fb-a1fb25bb48f8 service nova] Releasing lock "refresh_cache-5c2929f0-0a13-4279-ba1a-085ffdb2cd83" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG nova.compute.manager [req-29756306-c2be-495b-b337-57be01591357 req-291d2a5e-92fe-4bf1-94fb-a1fb25bb48f8 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received event network-changed-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG nova.compute.manager [req-29756306-c2be-495b-b337-57be01591357 req-291d2a5e-92fe-4bf1-94fb-a1fb25bb48f8 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Refreshing instance network info cache due to event network-changed-6225a308-7ed4-4b5e-baf9-217609c291e5. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-29756306-c2be-495b-b337-57be01591357 req-291d2a5e-92fe-4bf1-94fb-a1fb25bb48f8 service nova] Acquiring lock "refresh_cache-5c2929f0-0a13-4279-ba1a-085ffdb2cd83" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-29756306-c2be-495b-b337-57be01591357 req-291d2a5e-92fe-4bf1-94fb-a1fb25bb48f8 service nova] Acquired lock "refresh_cache-5c2929f0-0a13-4279-ba1a-085ffdb2cd83" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG nova.network.neutron [req-29756306-c2be-495b-b337-57be01591357 req-291d2a5e-92fe-4bf1-94fb-a1fb25bb48f8 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Refreshing network info cache for port 6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda3f68f-0f45-468f-91d5-82dd74b6df58]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b078fc-7751-4117-a3b1-23b940bf93da (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:25:02 user nova-compute[73188]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:25:02 user nova-compute[73188]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:25:02 user nova-compute[73188]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b078fc-7751-4117-a3b1-23b940bf93da (non-flash)
Aug 15 19:25:02 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 (non-flash)
Aug 15 19:25:02 user nova-compute[73188]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:25:02 user nova-compute[73188]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:25:02 user nova-compute[73188]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b078fc-7751-4117-a3b1-23b940bf93da (non-flash)
Aug 15 19:25:02 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2808178d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764'): ({'sdh'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Removing single pathed devices sdh {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b485c5c4-7895-44c4-abe8-0fb8a6cd09f8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba5140c-bb9b-4388-b1f0-99ca90220bd7]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Flushing IO for device /dev/sdh {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30f0ac9-18b1-412f-b745-8e891a9c599a]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.038s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[65388c63-fa0d-499e-82d8-76f916b6238d]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] SCSI volumes sdh have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bccb6e-aefb-4951-a16b-c1d6574a6e72]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 -p 172.16.0.220:3260 --logout" returned: 0 in 0.140s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ef44a4-dfbd-43de-9a75-f309d9ceda81]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764, portal: 172.16.0.220,3260]
Aug 15 19:25:02 user nova-compute[73188]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764, portal: 172.16.0.220,3260] successful.
Aug 15 19:25:02 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfbcd191-af36-4608-8861-dfd9587ed764 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3949421e-3e97-4e04-95e7-9e9c8b815d74]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] <== disconnect_volume: return (405ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG nova.network.neutron [req-29756306-c2be-495b-b337-57be01591357 req-291d2a5e-92fe-4bf1-94fb-a1fb25bb48f8 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Updated VIF entry in instance network info cache for port 6225a308-7ed4-4b5e-baf9-217609c291e5. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG nova.network.neutron [req-29756306-c2be-495b-b337-57be01591357 req-291d2a5e-92fe-4bf1-94fb-a1fb25bb48f8 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Updating instance_info_cache with network_info: [{"id": "6225a308-7ed4-4b5e-baf9-217609c291e5", "address": "fa:16:3e:a1:7a:2a", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6225a308-7e", "ovs_interfaceid": "6225a308-7ed4-4b5e-baf9-217609c291e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:25:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-29756306-c2be-495b-b337-57be01591357 req-291d2a5e-92fe-4bf1-94fb-a1fb25bb48f8 service nova] Releasing lock "refresh_cache-5c2929f0-0a13-4279-ba1a-085ffdb2cd83" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:25:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:03 user nova-compute[73188]: DEBUG nova.compute.manager [req-fe437514-3435-42de-825f-c81727765974 req-5b399c12-a824-4985-9c3e-5211580b84de service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received event network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:25:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fe437514-3435-42de-825f-c81727765974 req-5b399c12-a824-4985-9c3e-5211580b84de service nova] Acquiring lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fe437514-3435-42de-825f-c81727765974 req-5b399c12-a824-4985-9c3e-5211580b84de service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fe437514-3435-42de-825f-c81727765974 req-5b399c12-a824-4985-9c3e-5211580b84de service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:03 user nova-compute[73188]: DEBUG nova.compute.manager [req-fe437514-3435-42de-825f-c81727765974 req-5b399c12-a824-4985-9c3e-5211580b84de service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] No waiting events found dispatching network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:25:03 user nova-compute[73188]: WARNING nova.compute.manager [req-fe437514-3435-42de-825f-c81727765974 req-5b399c12-a824-4985-9c3e-5211580b84de service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received unexpected event network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb for instance with vm_state stopped and task_state powering-on.
Aug 15 19:25:03 user nova-compute[73188]: DEBUG nova.compute.manager [req-fe437514-3435-42de-825f-c81727765974 req-5b399c12-a824-4985-9c3e-5211580b84de service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received event network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:25:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fe437514-3435-42de-825f-c81727765974 req-5b399c12-a824-4985-9c3e-5211580b84de service nova] Acquiring lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fe437514-3435-42de-825f-c81727765974 req-5b399c12-a824-4985-9c3e-5211580b84de service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fe437514-3435-42de-825f-c81727765974 req-5b399c12-a824-4985-9c3e-5211580b84de service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:03 user nova-compute[73188]: DEBUG nova.compute.manager [req-fe437514-3435-42de-825f-c81727765974 req-5b399c12-a824-4985-9c3e-5211580b84de service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] No waiting events found dispatching network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:25:03 user nova-compute[73188]: WARNING nova.compute.manager [req-fe437514-3435-42de-825f-c81727765974 req-5b399c12-a824-4985-9c3e-5211580b84de service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received unexpected event network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb for instance with vm_state stopped and task_state powering-on.
Aug 15 19:25:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CgbjDMFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:25:05 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:25:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:25:05 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:25:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:25:05 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG nova.objects.instance [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'flavor' on Instance uuid 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 -p 172.16.0.220:3260" returned: 21 in 0.097s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c95a033-c2f8-4193-9984-f33786c0eb47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:25:05 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.157s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceed0ec8-49a5-4799-96d5-36404c7baea4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40] added
Aug 15 19:25:05 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.097s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8fbce9-596f-4c58-ae47-29180a94389e]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.063s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0a3386-5786-49a7-910f-ade089add550]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CgbjDMFo {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CgbjDMFo" returned: 0 in 0.061s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6323c409-a36d-4c6b-a2c1-c9e333fb8324]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CgbjDMFo'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b3ab8f41-4f9c-4a15-a2f9-e5d07f4d6514 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.528s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.072s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d93e31-7f56-490a-b3d4-f8702b14a415]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a7f8c3-4b3e-400f-9fb9-72457ccfeafb]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b078fc-7751-4117-a3b1-23b940bf93da (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:25:05 user nova-compute[73188]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:25:05 user nova-compute[73188]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b078fc-7751-4117-a3b1-23b940bf93da (non-flash)
Aug 15 19:25:05 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:25:05 user nova-compute[73188]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:25:05 user nova-compute[73188]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b078fc-7751-4117-a3b1-23b940bf93da (non-flash)
Aug 15 19:25:05 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:25:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 -p 172.16.0.220:3260 --login" returned: 0 in 0.158s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[817548e2-cc7e-43a3-8e29-e9e5816e0df3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40, portal: 172.16.0.220,3260]
Aug 15 19:25:06 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40, portal: 172.16.0.220,3260] successful.
Aug 15 19:25:06 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.124s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b463bc-ea0f-445b-afbd-58aa87d5d151]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc20c4da-c2e6-4b18-971d-ea9ab16fa8af]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b078fc-7751-4117-a3b1-23b940bf93da (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:25:06 user nova-compute[73188]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:25:06 user nova-compute[73188]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b078fc-7751-4117-a3b1-23b940bf93da (non-flash)
Aug 15 19:25:06 user nova-compute[73188]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 (non-flash)
Aug 15 19:25:06 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:25:06 user nova-compute[73188]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:25:06 user nova-compute[73188]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b078fc-7751-4117-a3b1-23b940bf93da (non-flash)
Aug 15 19:25:06 user nova-compute[73188]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 (non-flash)
Aug 15 19:25:06 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.975s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66ba29d-db3f-442b-9fb3-43cc3ac928c1]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CgbjDMFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "d8f302f1-7c20-483a-9eef-24566d51143d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "d8f302f1-7c20-483a-9eef-24566d51143d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:06 user nova-compute[73188]: INFO nova.compute.manager [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Terminating instance
Aug 15 19:25:06 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.113s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] <== connect_volume: return (2115ms) {'type': 'block', 'scsi_wwn': '23139653563343732', 'path': '/dev/sde'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139653563343732', 'path': '/dev/sde'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG nova.objects.instance [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lazy-loading 'flavor' on Instance uuid 3e0ab835-00ac-4db2-a93f-257559fa29b6 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:25:07 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:25:07 user nova-compute[73188]:   <source dev="/dev/sde"/>
Aug 15 19:25:07 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:25:07 user nova-compute[73188]:   <serial>e78510ba-ac5b-4386-ba99-361ec5f65e40</serial>
Aug 15 19:25:07 user nova-compute[73188]: </disk>
Aug 15 19:25:07 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG nova.compute.manager [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127507.3761907, b3dd183e-7ab1-40ae-b282-40575a9e47df => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:25:07 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] VM Resumed (Lifecycle Event)
Aug 15 19:25:07 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:25:07 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Instance rebooted successfully.
Aug 15 19:25:07 user nova-compute[73188]: DEBUG nova.compute.manager [None req-71b1e5a9-5627-4e6d-993a-5d48fcb960d6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:25:07 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 19:25:07 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127507.3763022, b3dd183e-7ab1-40ae-b282-40575a9e47df => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:25:07 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] VM Started (Lifecycle Event)
Aug 15 19:25:07 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-bc5b4eeb-c684-4e36-9a0a-3a7964b3f195 req-1973ab4c-222f-417f-883f-22e3b58b630f service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Received event network-vif-unplugged-11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-bc5b4eeb-c684-4e36-9a0a-3a7964b3f195 req-1973ab4c-222f-417f-883f-22e3b58b630f service nova] Acquiring lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-bc5b4eeb-c684-4e36-9a0a-3a7964b3f195 req-1973ab4c-222f-417f-883f-22e3b58b630f service nova] Lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-bc5b4eeb-c684-4e36-9a0a-3a7964b3f195 req-1973ab4c-222f-417f-883f-22e3b58b630f service nova] Lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-bc5b4eeb-c684-4e36-9a0a-3a7964b3f195 req-1973ab4c-222f-417f-883f-22e3b58b630f service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] No waiting events found dispatching network-vif-unplugged-11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-bc5b4eeb-c684-4e36-9a0a-3a7964b3f195 req-1973ab4c-222f-417f-883f-22e3b58b630f service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Received event network-vif-unplugged-11b7dd56-8608-446d-9229-ccac461f89b2 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] No VIF found with MAC fa:16:3e:3b:96:24, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:25:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-89d724bf-a5a7-4bd6-b13d-ff96a59cc8c1 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "3e0ab835-00ac-4db2-a93f-257559fa29b6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.417s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:08 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Instance destroyed successfully.
Aug 15 19:25:08 user nova-compute[73188]: DEBUG nova.objects.instance [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lazy-loading 'resources' on Instance uuid d8f302f1-7c20-483a-9eef-24566d51143d {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:25:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-301520799',display_name='tempest-TestMinimumBasicScenario-server-301520799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-301520799',id=34,image_ref='631e0fe8-5eee-40af-9bb8-e5257f118c66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdv0IsHB3MXQN4dTrfwe7oeY+S+nveVoed4be855tcM05giYptdJQ6TYYtWmT0/Fe+DKOFA/PwEqda4fyRZdR34JH9hdE5a8e3CvPSR5qDW4Mzi86zCElNUxumBIWNwxg==',key_name='tempest-TestMinimumBasicScenario-1240204301',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:20:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='575959aac5a1464dac98034bdb3bb948',ramdisk_id='',reservation_id='r-ozfpmbwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='631e0fe8-5eee-40af-9bb8-e5257f118c66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1939446316',owner_user_name='tempest-TestMinimumBasicScenario-1939446316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:22:22Z,user_data=None,user_id='9f7c7805c0754c61a5b9f8d16e28b228',uuid=d8f302f1-7c20-483a-9eef-24566d51143d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11b7dd56-8608-446d-9229-ccac461f89b2", "address": "fa:16:3e:e6:c1:cc", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b7dd56-86", "ovs_interfaceid": "11b7dd56-8608-446d-9229-ccac461f89b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:25:08 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Converting VIF {"id": "11b7dd56-8608-446d-9229-ccac461f89b2", "address": "fa:16:3e:e6:c1:cc", "network": {"id": "a4981d47-8986-4ebf-a0cd-54692da9ff40", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1874568583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "575959aac5a1464dac98034bdb3bb948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b7dd56-86", "ovs_interfaceid": "11b7dd56-8608-446d-9229-ccac461f89b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:25:08 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:c1:cc,bridge_name='br-int',has_traffic_filtering=True,id=11b7dd56-8608-446d-9229-ccac461f89b2,network=Network(a4981d47-8986-4ebf-a0cd-54692da9ff40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b7dd56-86') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:25:08 user nova-compute[73188]: DEBUG os_vif [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:c1:cc,bridge_name='br-int',has_traffic_filtering=True,id=11b7dd56-8608-446d-9229-ccac461f89b2,network=Network(a4981d47-8986-4ebf-a0cd-54692da9ff40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b7dd56-86') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:25:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11b7dd56-86, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:25:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:25:08 user nova-compute[73188]: INFO os_vif [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:c1:cc,bridge_name='br-int',has_traffic_filtering=True,id=11b7dd56-8608-446d-9229-ccac461f89b2,network=Network(a4981d47-8986-4ebf-a0cd-54692da9ff40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b7dd56-86')
Aug 15 19:25:08 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Deleting instance files /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d_del
Aug 15 19:25:08 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Deletion of /opt/stack/data/nova/instances/d8f302f1-7c20-483a-9eef-24566d51143d_del complete
Aug 15 19:25:08 user nova-compute[73188]: INFO nova.compute.manager [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Took 1.42 seconds to destroy the instance on the hypervisor.
Aug 15 19:25:08 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:25:08 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:25:08 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:25:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:09 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:25:09 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Took 0.92 seconds to deallocate network for instance.
Aug 15 19:25:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-06721928-c022-4529-8978-40b8b79f2a2c req-ef1aaf19-df8c-4820-b510-3d0a2ef8b11b service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Received event network-vif-deleted-11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:25:09 user nova-compute[73188]: INFO nova.compute.manager [req-06721928-c022-4529-8978-40b8b79f2a2c req-ef1aaf19-df8c-4820-b510-3d0a2ef8b11b service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Neutron deleted interface 11b7dd56-8608-446d-9229-ccac461f89b2; detaching it from the instance and deleting it from the info cache
Aug 15 19:25:09 user nova-compute[73188]: DEBUG nova.network.neutron [req-06721928-c022-4529-8978-40b8b79f2a2c req-ef1aaf19-df8c-4820-b510-3d0a2ef8b11b service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:25:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-06721928-c022-4529-8978-40b8b79f2a2c req-ef1aaf19-df8c-4820-b510-3d0a2ef8b11b service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Detach interface failed, port_id=11b7dd56-8608-446d-9229-ccac461f89b2, reason: Instance d8f302f1-7c20-483a-9eef-24566d51143d could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:25:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-52105452-d963-4e9c-9571-4195d25c7cb9 req-806642d6-3a14-40b5-b784-0aae8ba3f1ef service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Received event network-vif-plugged-11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:25:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-52105452-d963-4e9c-9571-4195d25c7cb9 req-806642d6-3a14-40b5-b784-0aae8ba3f1ef service nova] Acquiring lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-52105452-d963-4e9c-9571-4195d25c7cb9 req-806642d6-3a14-40b5-b784-0aae8ba3f1ef service nova] Lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-52105452-d963-4e9c-9571-4195d25c7cb9 req-806642d6-3a14-40b5-b784-0aae8ba3f1ef service nova] Lock "d8f302f1-7c20-483a-9eef-24566d51143d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-52105452-d963-4e9c-9571-4195d25c7cb9 req-806642d6-3a14-40b5-b784-0aae8ba3f1ef service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] No waiting events found dispatching network-vif-plugged-11b7dd56-8608-446d-9229-ccac461f89b2 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:25:09 user nova-compute[73188]: WARNING nova.compute.manager [req-52105452-d963-4e9c-9571-4195d25c7cb9 req-806642d6-3a14-40b5-b784-0aae8ba3f1ef service nova] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Received unexpected event network-vif-plugged-11b7dd56-8608-446d-9229-ccac461f89b2 for instance with vm_state deleted and task_state None.
Aug 15 19:25:09 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:25:09 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:25:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.595s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:10 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Deleted allocations for instance d8f302f1-7c20-483a-9eef-24566d51143d
Aug 15 19:25:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3b14fc36-9f0a-41cb-93d9-2b94e05e5b66 tempest-TestMinimumBasicScenario-1939446316 tempest-TestMinimumBasicScenario-1939446316-project-member] Lock "d8f302f1-7c20-483a-9eef-24566d51143d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.299s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:12 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127497.395198, ff4ca43e-3c17-458a-bd3e-4204a6d96fd6 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:25:12 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] VM Stopped (Lifecycle Event)
Aug 15 19:25:12 user nova-compute[73188]: DEBUG nova.compute.manager [None req-0caea5d8-8c39-4a31-b8ec-db53eb148d9d None None] [instance: ff4ca43e-3c17-458a-bd3e-4204a6d96fd6] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:25:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:22 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:25:23 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127508.1224945, d8f302f1-7c20-483a-9eef-24566d51143d => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:25:23 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] VM Stopped (Lifecycle Event)
Aug 15 19:25:23 user nova-compute[73188]: DEBUG nova.compute.manager [None req-6cdfb250-513b-4d61-aec5-93a208810076 None None] [instance: d8f302f1-7c20-483a-9eef-24566d51143d] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:25:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:25:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:25:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:25:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:25:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:25:25 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:25:26 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:25:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:27 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:25:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:27 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:25:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:25:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:25:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:25:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:30 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:25:30 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:25:30 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=7520MB free_disk=25.251728057861328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:25:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:30 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e00adf53-085f-436d-a09f-e97e92ca79cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:25:30 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 139ccf1c-4792-4653-9475-c61b1f9c4846 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:25:30 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 215077af-60a1-4a82-b24e-1545349363d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:25:30 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance b3dd183e-7ab1-40ae-b282-40575a9e47df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:25:30 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:25:30 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:25:30 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3e0ab835-00ac-4db2-a93f-257559fa29b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:25:30 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 4c2064b9-f23d-4c26-bf0a-8fa748829b43 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:25:30 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:25:30 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:25:31 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:25:31 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:25:31 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:25:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:32 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:25:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:25:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-b3dd183e-7ab1-40ae-b282-40575a9e47df" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:25:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-b3dd183e-7ab1-40ae-b282-40575a9e47df" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:25:32 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:25:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:33 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Updating instance_info_cache with network_info: [{"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:25:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-b3dd183e-7ab1-40ae-b282-40575a9e47df" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:25:33 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:25:33 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:25:33 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:25:33 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:25:33 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:25:33 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:25:34 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:25:34 user nova-compute[73188]: DEBUG nova.compute.manager [req-c5b969bc-fccd-4a5c-8b63-bcaf1e511556 req-3baea391-5751-4188-8458-aaed87a6f88b service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Received event network-changed-df969754-62c7-4735-8936-c3736b57aef4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:25:34 user nova-compute[73188]: DEBUG nova.compute.manager [req-c5b969bc-fccd-4a5c-8b63-bcaf1e511556 req-3baea391-5751-4188-8458-aaed87a6f88b service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Refreshing instance network info cache due to event network-changed-df969754-62c7-4735-8936-c3736b57aef4. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:25:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c5b969bc-fccd-4a5c-8b63-bcaf1e511556 req-3baea391-5751-4188-8458-aaed87a6f88b service nova] Acquiring lock "refresh_cache-4c2064b9-f23d-4c26-bf0a-8fa748829b43" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:25:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c5b969bc-fccd-4a5c-8b63-bcaf1e511556 req-3baea391-5751-4188-8458-aaed87a6f88b service nova] Acquired lock "refresh_cache-4c2064b9-f23d-4c26-bf0a-8fa748829b43" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:25:34 user nova-compute[73188]: DEBUG nova.network.neutron [req-c5b969bc-fccd-4a5c-8b63-bcaf1e511556 req-3baea391-5751-4188-8458-aaed87a6f88b service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Refreshing network info cache for port df969754-62c7-4735-8936-c3736b57aef4 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:25:35 user nova-compute[73188]: DEBUG nova.network.neutron [req-c5b969bc-fccd-4a5c-8b63-bcaf1e511556 req-3baea391-5751-4188-8458-aaed87a6f88b service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Updated VIF entry in instance network info cache for port df969754-62c7-4735-8936-c3736b57aef4. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:25:35 user nova-compute[73188]: DEBUG nova.network.neutron [req-c5b969bc-fccd-4a5c-8b63-bcaf1e511556 req-3baea391-5751-4188-8458-aaed87a6f88b service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Updating instance_info_cache with network_info: [{"id": "df969754-62c7-4735-8936-c3736b57aef4", "address": "fa:16:3e:4a:d2:00", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf969754-62", "ovs_interfaceid": "df969754-62c7-4735-8936-c3736b57aef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:25:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c5b969bc-fccd-4a5c-8b63-bcaf1e511556 req-3baea391-5751-4188-8458-aaed87a6f88b service nova] Releasing lock "refresh_cache-4c2064b9-f23d-4c26-bf0a-8fa748829b43" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:25:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "4c2064b9-f23d-4c26-bf0a-8fa748829b43" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "4c2064b9-f23d-4c26-bf0a-8fa748829b43" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "4c2064b9-f23d-4c26-bf0a-8fa748829b43-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "4c2064b9-f23d-4c26-bf0a-8fa748829b43-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "4c2064b9-f23d-4c26-bf0a-8fa748829b43-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:35 user nova-compute[73188]: INFO nova.compute.manager [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Terminating instance
Aug 15 19:25:35 user nova-compute[73188]: DEBUG nova.compute.manager [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:25:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:36 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Instance destroyed successfully.
Aug 15 19:25:36 user nova-compute[73188]: DEBUG nova.objects.instance [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lazy-loading 'resources' on Instance uuid 4c2064b9-f23d-4c26-bf0a-8fa748829b43 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1894120181',display_name='tempest-TestVolumeBootPattern-server-1894120181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1894120181',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdjONelCosej3I/pGPD4UfCZO2hIpepMykeX7dOlXZGpPLQP0eHCaELWxQF5jeHsky1dPgp1Jk+Jsu/dHFRA3/Yz5MW9r+VfrqEngMakotyTy6CftX4lIdZFQ2vRevOkg==',key_name='tempest-TestVolumeBootPattern-1653977396',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:23:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18eadba32f4547ad9436aca9285b7aad',ramdisk_id='',reservation_id='r-175c3klf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2114363476',owner_user_name='tempest-TestVolumeBootPattern-2114363476-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:23:58Z,user_data=None,user_id='9503705066e5402cb569fae3b2bd8976',uuid=4c2064b9-f23d-4c26-bf0a-8fa748829b43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df969754-62c7-4735-8936-c3736b57aef4", "address": "fa:16:3e:4a:d2:00", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf969754-62", "ovs_interfaceid": "df969754-62c7-4735-8936-c3736b57aef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converting VIF {"id": "df969754-62c7-4735-8936-c3736b57aef4", "address": "fa:16:3e:4a:d2:00", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf969754-62", "ovs_interfaceid": "df969754-62c7-4735-8936-c3736b57aef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:d2:00,bridge_name='br-int',has_traffic_filtering=True,id=df969754-62c7-4735-8936-c3736b57aef4,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf969754-62') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG os_vif [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:d2:00,bridge_name='br-int',has_traffic_filtering=True,id=df969754-62c7-4735-8936-c3736b57aef4,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf969754-62') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf969754-62, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:25:36 user nova-compute[73188]: INFO os_vif [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:d2:00,bridge_name='br-int',has_traffic_filtering=True,id=df969754-62c7-4735-8936-c3736b57aef4,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf969754-62')
Aug 15 19:25:36 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLhRyXDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:25:36 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:25:36 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[35838505-15d0-48d7-99fc-4f08336eadfc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dd5a28-9c03-400f-ab5c-f575f15e9c3c]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:25:36 user nova-compute[73188]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:25:36 user nova-compute[73188]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 (non-flash)
Aug 15 19:25:36 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:25:36 user nova-compute[73188]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:25:36 user nova-compute[73188]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 (non-flash)
Aug 15 19:25:36 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2808179510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2'): ({'sdd'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Removing single pathed devices sdd {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b76516-cf45-47b2-8f82-7c6123156505]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fc2fc8-85f2-4b4f-b2cc-caa10a469514]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Flushing IO for device /dev/sdd {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6371d29-a10a-4860-97d2-d9985b5c8974]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4d2f47-2ea8-47b0-a966-b69ced9e6342]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] SCSI volumes sdd have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_20fd2a70', '/dev/disk/by-id/scsi-23263363033363438', '/dev/disk/by-id/scsi-1SCST_BIO20fd2a70-2c6036487af49f66') {{(pid=83967) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc5c247-f3e5-45a3-a60c-e36eeb56d229]: (4, None) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf2d7b0-fe37-4ab8-960f-ae0e8a96c69c]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d277db3-fa72-4952-b432-138e8a0bdd02]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2, portal: 172.16.0.220,3260]
Aug 15 19:25:36 user nova-compute[73188]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2, portal: 172.16.0.220,3260] successful.
Aug 15 19:25:36 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a387b0-04ad-46d7-a91a-03b7221ef674]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] <== disconnect_volume: return (282ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:25:36 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Deleting instance files /opt/stack/data/nova/instances/4c2064b9-f23d-4c26-bf0a-8fa748829b43_del
Aug 15 19:25:36 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Deletion of /opt/stack/data/nova/instances/4c2064b9-f23d-4c26-bf0a-8fa748829b43_del complete
Aug 15 19:25:36 user nova-compute[73188]: INFO nova.compute.manager [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG nova.compute.manager [req-81a7f84f-8060-4a02-9053-93697bdb7ad1 req-e17064d4-54aa-44f4-9c0c-574c58c4d00a service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Received event network-vif-unplugged-df969754-62c7-4735-8936-c3736b57aef4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-81a7f84f-8060-4a02-9053-93697bdb7ad1 req-e17064d4-54aa-44f4-9c0c-574c58c4d00a service nova] Acquiring lock "4c2064b9-f23d-4c26-bf0a-8fa748829b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-81a7f84f-8060-4a02-9053-93697bdb7ad1 req-e17064d4-54aa-44f4-9c0c-574c58c4d00a service nova] Lock "4c2064b9-f23d-4c26-bf0a-8fa748829b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-81a7f84f-8060-4a02-9053-93697bdb7ad1 req-e17064d4-54aa-44f4-9c0c-574c58c4d00a service nova] Lock "4c2064b9-f23d-4c26-bf0a-8fa748829b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG nova.compute.manager [req-81a7f84f-8060-4a02-9053-93697bdb7ad1 req-e17064d4-54aa-44f4-9c0c-574c58c4d00a service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] No waiting events found dispatching network-vif-unplugged-df969754-62c7-4735-8936-c3736b57aef4 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG nova.compute.manager [req-81a7f84f-8060-4a02-9053-93697bdb7ad1 req-e17064d4-54aa-44f4-9c0c-574c58c4d00a service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Received event network-vif-unplugged-df969754-62c7-4735-8936-c3736b57aef4 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG nova.compute.manager [req-81a7f84f-8060-4a02-9053-93697bdb7ad1 req-e17064d4-54aa-44f4-9c0c-574c58c4d00a service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Received event network-vif-plugged-df969754-62c7-4735-8936-c3736b57aef4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-81a7f84f-8060-4a02-9053-93697bdb7ad1 req-e17064d4-54aa-44f4-9c0c-574c58c4d00a service nova] Acquiring lock "4c2064b9-f23d-4c26-bf0a-8fa748829b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-81a7f84f-8060-4a02-9053-93697bdb7ad1 req-e17064d4-54aa-44f4-9c0c-574c58c4d00a service nova] Lock "4c2064b9-f23d-4c26-bf0a-8fa748829b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-81a7f84f-8060-4a02-9053-93697bdb7ad1 req-e17064d4-54aa-44f4-9c0c-574c58c4d00a service nova] Lock "4c2064b9-f23d-4c26-bf0a-8fa748829b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:36 user nova-compute[73188]: DEBUG nova.compute.manager [req-81a7f84f-8060-4a02-9053-93697bdb7ad1 req-e17064d4-54aa-44f4-9c0c-574c58c4d00a service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] No waiting events found dispatching network-vif-plugged-df969754-62c7-4735-8936-c3736b57aef4 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:25:36 user nova-compute[73188]: WARNING nova.compute.manager [req-81a7f84f-8060-4a02-9053-93697bdb7ad1 req-e17064d4-54aa-44f4-9c0c-574c58c4d00a service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Received unexpected event network-vif-plugged-df969754-62c7-4735-8936-c3736b57aef4 for instance with vm_state active and task_state deleting.
Aug 15 19:25:37 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:25:37 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Took 0.79 seconds to deallocate network for instance.
Aug 15 19:25:37 user nova-compute[73188]: DEBUG nova.compute.manager [req-ef57334c-7632-470e-9186-f0c71d8fff0d req-30b4b43c-bcc0-412e-9d80-d071eb16e91c service nova] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Received event network-vif-deleted-df969754-62c7-4735-8936-c3736b57aef4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:25:38 user nova-compute[73188]: INFO nova.compute.manager [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Took 0.72 seconds to detach 1 volumes for instance.
Aug 15 19:25:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:38 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:25:38 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:25:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:38 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Deleted allocations for instance 4c2064b9-f23d-4c26-bf0a-8fa748829b43
Aug 15 19:25:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-96785b93-bfcb-43fd-b8f4-f91f1c01bace tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "4c2064b9-f23d-4c26-bf0a-8fa748829b43" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.120s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "3e0ab835-00ac-4db2-a93f-257559fa29b6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "3e0ab835-00ac-4db2-a93f-257559fa29b6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:41 user nova-compute[73188]: INFO nova.compute.manager [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Detaching volume e78510ba-ac5b-4386-ba99-361ec5f65e40
Aug 15 19:25:41 user nova-compute[73188]: INFO nova.virt.block_device [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Attempting to driver detach volume e78510ba-ac5b-4386-ba99-361ec5f65e40 from mountpoint /dev/vdb
Aug 15 19:25:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Attempting to detach device vdb from instance 3e0ab835-00ac-4db2-a93f-257559fa29b6 from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:25:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:25:41 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:25:41 user nova-compute[73188]:   <source dev="/dev/sde"/>
Aug 15 19:25:41 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:25:41 user nova-compute[73188]:   <serial>e78510ba-ac5b-4386-ba99-361ec5f65e40</serial>
Aug 15 19:25:41 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:25:41 user nova-compute[73188]: </disk>
Aug 15 19:25:41 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:25:41 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Successfully detached device vdb from instance 3e0ab835-00ac-4db2-a93f-257559fa29b6 from the persistent domain config.
Aug 15 19:25:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3e0ab835-00ac-4db2-a93f-257559fa29b6 from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:25:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:25:41 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:25:41 user nova-compute[73188]:   <source dev="/dev/sde"/>
Aug 15 19:25:41 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:25:41 user nova-compute[73188]:   <serial>e78510ba-ac5b-4386-ba99-361ec5f65e40</serial>
Aug 15 19:25:41 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:25:41 user nova-compute[73188]: </disk>
Aug 15 19:25:41 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:25:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "3e0ab835-00ac-4db2-a93f-257559fa29b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692127542.2946754, 3e0ab835-00ac-4db2-a93f-257559fa29b6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3e0ab835-00ac-4db2-a93f-257559fa29b6 {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:25:42 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Successfully detached device vdb from instance 3e0ab835-00ac-4db2-a93f-257559fa29b6 from the live domain config.
Aug 15 19:25:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CgbjDMFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:25:42 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:25:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1d9e26-ad8f-491c-98ff-31aa9c27d1d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb19621-0dc3-4dc5-88c0-e2ef4771b588]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:25:42 user nova-compute[73188]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 (non-flash)
Aug 15 19:25:42 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:25:42 user nova-compute[73188]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 (non-flash)
Aug 15 19:25:42 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28081a16c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40'): ({'sde'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Removing single pathed devices sde {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[558107cd-f3de-48f0-855b-286652765983]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[63eaa0b7-7ef9-4303-97a5-05d61cea0360]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Flushing IO for device /dev/sde {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd80e126-a1c0-4245-b93e-265aafefd04a]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a0d3f5-edfd-4acc-a15e-fd444ca7e1ff]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] SCSI volumes sde have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4d28ff-5786-4879-a9ca-be8e771c93df]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f009d5c-ac93-46c1-ab1a-163f41f89bc9]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40, portal: 172.16.0.220,3260]
Aug 15 19:25:42 user nova-compute[73188]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40, portal: 172.16.0.220,3260] successful.
Aug 15 19:25:42 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[86abb8a2-6f58-4f17-a0f7-27c74d78c4b5]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] <== disconnect_volume: return (261ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:25:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:25:43 user nova-compute[73188]: DEBUG nova.objects.instance [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lazy-loading 'flavor' on Instance uuid 3e0ab835-00ac-4db2-a93f-257559fa29b6 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:25:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-63e88959-f514-4b08-9793-494f8a550d53 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "3e0ab835-00ac-4db2-a93f-257559fa29b6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.562s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "3e0ab835-00ac-4db2-a93f-257559fa29b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.444s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "3e0ab835-00ac-4db2-a93f-257559fa29b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "3e0ab835-00ac-4db2-a93f-257559fa29b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "3e0ab835-00ac-4db2-a93f-257559fa29b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:43 user nova-compute[73188]: INFO nova.compute.manager [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Terminating instance
Aug 15 19:25:43 user nova-compute[73188]: DEBUG nova.compute.manager [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:25:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:43 user nova-compute[73188]: DEBUG nova.compute.manager [req-e837c8db-620e-4bd9-9377-b483b5119d9e req-e5ecf027-fe28-4a4b-9d62-7b2b34159518 service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Received event network-vif-unplugged-793141da-bf20-4bd2-9fec-c6ecde2601ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:25:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e837c8db-620e-4bd9-9377-b483b5119d9e req-e5ecf027-fe28-4a4b-9d62-7b2b34159518 service nova] Acquiring lock "3e0ab835-00ac-4db2-a93f-257559fa29b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e837c8db-620e-4bd9-9377-b483b5119d9e req-e5ecf027-fe28-4a4b-9d62-7b2b34159518 service nova] Lock "3e0ab835-00ac-4db2-a93f-257559fa29b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e837c8db-620e-4bd9-9377-b483b5119d9e req-e5ecf027-fe28-4a4b-9d62-7b2b34159518 service nova] Lock "3e0ab835-00ac-4db2-a93f-257559fa29b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:43 user nova-compute[73188]: DEBUG nova.compute.manager [req-e837c8db-620e-4bd9-9377-b483b5119d9e req-e5ecf027-fe28-4a4b-9d62-7b2b34159518 service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] No waiting events found dispatching network-vif-unplugged-793141da-bf20-4bd2-9fec-c6ecde2601ff {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:25:43 user nova-compute[73188]: DEBUG nova.compute.manager [req-e837c8db-620e-4bd9-9377-b483b5119d9e req-e5ecf027-fe28-4a4b-9d62-7b2b34159518 service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Received event network-vif-unplugged-793141da-bf20-4bd2-9fec-c6ecde2601ff for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:25:44 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Instance destroyed successfully.
Aug 15 19:25:44 user nova-compute[73188]: DEBUG nova.objects.instance [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lazy-loading 'resources' on Instance uuid 3e0ab835-00ac-4db2-a93f-257559fa29b6 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:23:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1725827429',display_name='tempest-VolumesSnapshotTestJSON-instance-1725827429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1725827429',id=37,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8dd34O2k+aiK3dRfEhHchtPUkWEYMWBCi4bGQxayK4YhAgavRbDKE8DArC5ouNgilgGSKOb/hzkRIDwU3NL5GKb6T9KMYVn6IkVI+IpF5C/wdbOpvcbTY8mScX4sOLug==',key_name='tempest-keypair-1398743821',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:23:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f72b50bc97b84e3dac8161b6a36f50ab',ramdisk_id='',reservation_id='r-sv9anlld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-564329204',owner_user_name='tempest-VolumesSnapshotTestJSON-564329204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:23:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b8737b83c944ab2bed468f6ea5cd8ee',uuid=3e0ab835-00ac-4db2-a93f-257559fa29b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "793141da-bf20-4bd2-9fec-c6ecde2601ff", "address": "fa:16:3e:3b:96:24", "network": {"id": "852c135b-1d66-4329-8090-3770310ffce0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1628017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72b50bc97b84e3dac8161b6a36f50ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793141da-bf", "ovs_interfaceid": "793141da-bf20-4bd2-9fec-c6ecde2601ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Converting VIF {"id": "793141da-bf20-4bd2-9fec-c6ecde2601ff", "address": "fa:16:3e:3b:96:24", "network": {"id": "852c135b-1d66-4329-8090-3770310ffce0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1628017187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72b50bc97b84e3dac8161b6a36f50ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap793141da-bf", "ovs_interfaceid": "793141da-bf20-4bd2-9fec-c6ecde2601ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:96:24,bridge_name='br-int',has_traffic_filtering=True,id=793141da-bf20-4bd2-9fec-c6ecde2601ff,network=Network(852c135b-1d66-4329-8090-3770310ffce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793141da-bf') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG os_vif [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:96:24,bridge_name='br-int',has_traffic_filtering=True,id=793141da-bf20-4bd2-9fec-c6ecde2601ff,network=Network(852c135b-1d66-4329-8090-3770310ffce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793141da-bf') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap793141da-bf, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:25:44 user nova-compute[73188]: INFO os_vif [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:96:24,bridge_name='br-int',has_traffic_filtering=True,id=793141da-bf20-4bd2-9fec-c6ecde2601ff,network=Network(852c135b-1d66-4329-8090-3770310ffce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap793141da-bf')
Aug 15 19:25:44 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CgbjDMFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:25:44 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:25:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e78510ba-ac5b-4386-ba99-361ec5f65e40', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[478dd0ae-5c1a-438d-b95b-5e6e098cd87f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f9aec9-b65e-4713-966f-56c23eb0036b]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:25:44 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:25:44 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28101e8820>, {}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Disconnecting from: [] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.050s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] <== disconnect_volume: return (52ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:25:44 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Deleting instance files /opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6_del
Aug 15 19:25:44 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Deletion of /opt/stack/data/nova/instances/3e0ab835-00ac-4db2-a93f-257559fa29b6_del complete
Aug 15 19:25:44 user nova-compute[73188]: INFO nova.compute.manager [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 15 19:25:44 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:25:44 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:25:45 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:25:45 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Took 0.78 seconds to deallocate network for instance.
Aug 15 19:25:45 user nova-compute[73188]: DEBUG nova.compute.manager [req-0abe4e72-3628-4126-bb1e-047b8ae5a30f req-d5e7365e-76dd-4b8e-a6f2-928b14a740cd service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Received event network-vif-deleted-793141da-bf20-4bd2-9fec-c6ecde2601ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:25:45 user nova-compute[73188]: INFO nova.compute.manager [req-0abe4e72-3628-4126-bb1e-047b8ae5a30f req-d5e7365e-76dd-4b8e-a6f2-928b14a740cd service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Neutron deleted interface 793141da-bf20-4bd2-9fec-c6ecde2601ff; detaching it from the instance and deleting it from the info cache
Aug 15 19:25:45 user nova-compute[73188]: DEBUG nova.network.neutron [req-0abe4e72-3628-4126-bb1e-047b8ae5a30f req-d5e7365e-76dd-4b8e-a6f2-928b14a740cd service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:25:45 user nova-compute[73188]: DEBUG nova.compute.manager [req-0abe4e72-3628-4126-bb1e-047b8ae5a30f req-d5e7365e-76dd-4b8e-a6f2-928b14a740cd service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Detach interface failed, port_id=793141da-bf20-4bd2-9fec-c6ecde2601ff, reason: Instance 3e0ab835-00ac-4db2-a93f-257559fa29b6 could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:25:45 user nova-compute[73188]: WARNING nova.volume.cinder [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Attachment a4700a26-5be1-40c4-92d4-e9dea77a858b does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = a4700a26-5be1-40c4-92d4-e9dea77a858b. (HTTP 404) (Request-ID: req-5e968ee1-4fbc-49d0-adcd-6559451d912e)
Aug 15 19:25:45 user nova-compute[73188]: INFO nova.compute.manager [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Took 0.03 seconds to detach 1 volumes for instance.
Aug 15 19:25:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:45 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:25:45 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:25:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:45 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Deleted allocations for instance 3e0ab835-00ac-4db2-a93f-257559fa29b6
Aug 15 19:25:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-910aab99-ee68-42a1-b910-eec5e9310480 tempest-VolumesSnapshotTestJSON-564329204 tempest-VolumesSnapshotTestJSON-564329204-project-member] Lock "3e0ab835-00ac-4db2-a93f-257559fa29b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.161s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:45 user nova-compute[73188]: DEBUG nova.compute.manager [req-0fd14ffa-fc98-425b-877a-c453fba48f64 req-6d9ef3fc-423c-4ca3-9522-a95baf117bfc service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Received event network-vif-plugged-793141da-bf20-4bd2-9fec-c6ecde2601ff {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:25:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0fd14ffa-fc98-425b-877a-c453fba48f64 req-6d9ef3fc-423c-4ca3-9522-a95baf117bfc service nova] Acquiring lock "3e0ab835-00ac-4db2-a93f-257559fa29b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0fd14ffa-fc98-425b-877a-c453fba48f64 req-6d9ef3fc-423c-4ca3-9522-a95baf117bfc service nova] Lock "3e0ab835-00ac-4db2-a93f-257559fa29b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0fd14ffa-fc98-425b-877a-c453fba48f64 req-6d9ef3fc-423c-4ca3-9522-a95baf117bfc service nova] Lock "3e0ab835-00ac-4db2-a93f-257559fa29b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:45 user nova-compute[73188]: DEBUG nova.compute.manager [req-0fd14ffa-fc98-425b-877a-c453fba48f64 req-6d9ef3fc-423c-4ca3-9522-a95baf117bfc service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] No waiting events found dispatching network-vif-plugged-793141da-bf20-4bd2-9fec-c6ecde2601ff {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:25:45 user nova-compute[73188]: WARNING nova.compute.manager [req-0fd14ffa-fc98-425b-877a-c453fba48f64 req-6d9ef3fc-423c-4ca3-9522-a95baf117bfc service nova] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Received unexpected event network-vif-plugged-793141da-bf20-4bd2-9fec-c6ecde2601ff for instance with vm_state deleted and task_state None.
Aug 15 19:25:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:51 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127536.2401674, 4c2064b9-f23d-4c26-bf0a-8fa748829b43 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:25:51 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] VM Stopped (Lifecycle Event)
Aug 15 19:25:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e79f25a8-4a5d-4f83-af5f-51fe9198c412 None None] [instance: 4c2064b9-f23d-4c26-bf0a-8fa748829b43] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:25:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:51 user nova-compute[73188]: INFO nova.compute.manager [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Terminating instance
Aug 15 19:25:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:25:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-d5a6ac55-7207-4e06-ae29-56ebb933609f req-ed317437-955b-4536-9eec-11c6692b3940 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received event network-vif-unplugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:25:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d5a6ac55-7207-4e06-ae29-56ebb933609f req-ed317437-955b-4536-9eec-11c6692b3940 service nova] Acquiring lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d5a6ac55-7207-4e06-ae29-56ebb933609f req-ed317437-955b-4536-9eec-11c6692b3940 service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d5a6ac55-7207-4e06-ae29-56ebb933609f req-ed317437-955b-4536-9eec-11c6692b3940 service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-d5a6ac55-7207-4e06-ae29-56ebb933609f req-ed317437-955b-4536-9eec-11c6692b3940 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] No waiting events found dispatching network-vif-unplugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:25:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-d5a6ac55-7207-4e06-ae29-56ebb933609f req-ed317437-955b-4536-9eec-11c6692b3940 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received event network-vif-unplugged-6225a308-7ed4-4b5e-baf9-217609c291e5 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:25:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:52 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Instance destroyed successfully.
Aug 15 19:25:52 user nova-compute[73188]: DEBUG nova.objects.instance [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'resources' on Instance uuid 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:25:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1041831059',display_name='tempest-ServerRescueNegativeTestJSON-server-1041831059',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1041831059',id=31,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEq2iQ1h4jzBjE0atv0a4mo1L4j66QLfP7MxRxkxH1Yw8sM5jKyasNf48oOhELPjdXUEvOx3hNYXDkucV1CUoRmiVobninOEOJkdc8lPhCPKnn/KUBn7RaKi3Y4oHf1Lrw==',key_name='tempest-keypair-1377831358',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:21:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eeb950591a3349908b17b33c0ebca302',ramdisk_id='',reservation_id='r-wmo5f3m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-990996828',owner_user_name='tempest-ServerRescueNegativeTestJSON-990996828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:23:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88c0edd2a58744da9497d7c5164f22a2',uuid=5c2929f0-0a13-4279-ba1a-085ffdb2cd83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6225a308-7ed4-4b5e-baf9-217609c291e5", "address": "fa:16:3e:a1:7a:2a", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6225a308-7e", "ovs_interfaceid": "6225a308-7ed4-4b5e-baf9-217609c291e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:25:52 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converting VIF {"id": "6225a308-7ed4-4b5e-baf9-217609c291e5", "address": "fa:16:3e:a1:7a:2a", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6225a308-7e", "ovs_interfaceid": "6225a308-7ed4-4b5e-baf9-217609c291e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:25:52 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:7a:2a,bridge_name='br-int',has_traffic_filtering=True,id=6225a308-7ed4-4b5e-baf9-217609c291e5,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6225a308-7e') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:25:52 user nova-compute[73188]: DEBUG os_vif [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:7a:2a,bridge_name='br-int',has_traffic_filtering=True,id=6225a308-7ed4-4b5e-baf9-217609c291e5,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6225a308-7e') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:25:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6225a308-7e, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:25:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:52 user nova-compute[73188]: INFO os_vif [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:7a:2a,bridge_name='br-int',has_traffic_filtering=True,id=6225a308-7ed4-4b5e-baf9-217609c291e5,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6225a308-7e')
Aug 15 19:25:52 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Deleting instance files /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83_del
Aug 15 19:25:52 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Deletion of /opt/stack/data/nova/instances/5c2929f0-0a13-4279-ba1a-085ffdb2cd83_del complete
Aug 15 19:25:52 user nova-compute[73188]: INFO nova.compute.manager [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 15 19:25:52 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:25:52 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:25:52 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:25:53 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:25:53 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Took 1.29 seconds to deallocate network for instance.
Aug 15 19:25:53 user nova-compute[73188]: DEBUG nova.compute.manager [req-af4687d1-e0ef-40ec-9649-b9e20562b6e1 req-e3c9ff63-4959-481a-9961-da5d47ea7436 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received event network-vif-deleted-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:25:53 user nova-compute[73188]: INFO nova.compute.manager [req-af4687d1-e0ef-40ec-9649-b9e20562b6e1 req-e3c9ff63-4959-481a-9961-da5d47ea7436 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Neutron deleted interface 6225a308-7ed4-4b5e-baf9-217609c291e5; detaching it from the instance and deleting it from the info cache
Aug 15 19:25:53 user nova-compute[73188]: DEBUG nova.network.neutron [req-af4687d1-e0ef-40ec-9649-b9e20562b6e1 req-e3c9ff63-4959-481a-9961-da5d47ea7436 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:25:53 user nova-compute[73188]: DEBUG nova.compute.manager [req-af4687d1-e0ef-40ec-9649-b9e20562b6e1 req-e3c9ff63-4959-481a-9961-da5d47ea7436 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Detach interface failed, port_id=6225a308-7ed4-4b5e-baf9-217609c291e5, reason: Instance 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:25:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:53 user nova-compute[73188]: DEBUG nova.compute.manager [req-d5f644a9-0da1-4bbd-a470-d2d9772414e6 req-5d13af75-f619-42d3-8288-706d0d30c671 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received event network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:25:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d5f644a9-0da1-4bbd-a470-d2d9772414e6 req-5d13af75-f619-42d3-8288-706d0d30c671 service nova] Acquiring lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:25:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d5f644a9-0da1-4bbd-a470-d2d9772414e6 req-5d13af75-f619-42d3-8288-706d0d30c671 service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:25:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d5f644a9-0da1-4bbd-a470-d2d9772414e6 req-5d13af75-f619-42d3-8288-706d0d30c671 service nova] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:53 user nova-compute[73188]: DEBUG nova.compute.manager [req-d5f644a9-0da1-4bbd-a470-d2d9772414e6 req-5d13af75-f619-42d3-8288-706d0d30c671 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] No waiting events found dispatching network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:25:53 user nova-compute[73188]: WARNING nova.compute.manager [req-d5f644a9-0da1-4bbd-a470-d2d9772414e6 req-5d13af75-f619-42d3-8288-706d0d30c671 service nova] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Received unexpected event network-vif-plugged-6225a308-7ed4-4b5e-baf9-217609c291e5 for instance with vm_state deleted and task_state None.
Aug 15 19:25:54 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:25:54 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:25:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:54 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Deleted allocations for instance 5c2929f0-0a13-4279-ba1a-085ffdb2cd83
Aug 15 19:25:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3f84e11b-0475-4d6a-baa9-82ad83b39425 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "5c2929f0-0a13-4279-ba1a-085ffdb2cd83" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.566s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:25:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:25:59 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127544.0903063, 3e0ab835-00ac-4db2-a93f-257559fa29b6 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:25:59 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] VM Stopped (Lifecycle Event)
Aug 15 19:25:59 user nova-compute[73188]: DEBUG nova.compute.manager [None req-e7206fbf-231a-43f4-b824-e6c3474aabbf None None] [instance: 3e0ab835-00ac-4db2-a93f-257559fa29b6] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:25:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "18846be1-6828-4182-9285-12a40ecd41b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "18846be1-6828-4182-9285-12a40ecd41b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:26:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:02 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:26:02 user nova-compute[73188]: INFO nova.compute.claims [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Claim successful on node user
Aug 15 19:26:02 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:26:02 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG nova.compute.manager [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG nova.compute.manager [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG nova.network.neutron [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:26:03 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:26:03 user nova-compute[73188]: DEBUG nova.compute.manager [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG nova.compute.manager [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:26:03 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Creating image(s)
Aug 15 19:26:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "/opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "/opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "/opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.171s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.167s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk 1073741824" returned: 0 in 0.053s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.167s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Cannot resize image /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG nova.objects.instance [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'migration_context' on Instance uuid 18846be1-6828-4182-9285-12a40ecd41b1 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Ensure instance console log exists: /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:26:04 user nova-compute[73188]: DEBUG nova.policy [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7df4b06e72a452ca1dd4643694ce570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409362f6976b454ba96b7580b35db949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:26:05 user nova-compute[73188]: DEBUG nova.network.neutron [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Successfully created port: 0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:26:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.network.neutron [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Successfully updated port: 0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquired lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.network.neutron [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.compute.manager [req-e7582d48-683a-4947-98ea-ce0458c0c237 req-197c663e-8d03-4845-820e-f89ca235b2da service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Received event network-changed-0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.compute.manager [req-e7582d48-683a-4947-98ea-ce0458c0c237 req-197c663e-8d03-4845-820e-f89ca235b2da service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Refreshing instance network info cache due to event network-changed-0338047a-ec92-4e13-8b39-95d1feedd2ba. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e7582d48-683a-4947-98ea-ce0458c0c237 req-197c663e-8d03-4845-820e-f89ca235b2da service nova] Acquiring lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.network.neutron [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.network.neutron [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Updating instance_info_cache with network_info: [{"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0338047a-ec", "ovs_interfaceid": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Releasing lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.compute.manager [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Instance network_info: |[{"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0338047a-ec", "ovs_interfaceid": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e7582d48-683a-4947-98ea-ce0458c0c237 req-197c663e-8d03-4845-820e-f89ca235b2da service nova] Acquired lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.network.neutron [req-e7582d48-683a-4947-98ea-ce0458c0c237 req-197c663e-8d03-4845-820e-f89ca235b2da service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Refreshing network info cache for port 0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Start _get_guest_xml network_info=[{"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0338047a-ec", "ovs_interfaceid": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:26:06 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:26:06 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-134988234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-134988234',id=39,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzhzrPYTstDFJPRT2CNxzjEcWo8QkZkkQu0rijNzdeU9mLcgs9nv11HKnQZj+hbSx336GiMjlVjxornF/lx6nVpFTcoPy+i149zVtWOmKxbXBVb/jnZeNzmGFLeJ6tPJA==',key_name='tempest-keypair-353430524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='409362f6976b454ba96b7580b35db949',ramdisk_id='',reservation_id='r-3p2mm8lv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1675372664',owner_user_name='tempest-AttachVolumeShelveTestJSON-1675372664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:26:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7df4b06e72a452ca1dd4643694ce570',uuid=18846be1-6828-4182-9285-12a40ecd41b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0338047a-ec", "ovs_interfaceid": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converting VIF {"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0338047a-ec", "ovs_interfaceid": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:0a:75,bridge_name='br-int',has_traffic_filtering=True,id=0338047a-ec92-4e13-8b39-95d1feedd2ba,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0338047a-ec') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.objects.instance [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'pci_devices' on Instance uuid 18846be1-6828-4182-9285-12a40ecd41b1 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:26:06 user nova-compute[73188]:   <uuid>18846be1-6828-4182-9285-12a40ecd41b1</uuid>
Aug 15 19:26:06 user nova-compute[73188]:   <name>instance-00000027</name>
Aug 15 19:26:06 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:26:06 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:26:06 user nova-compute[73188]:   <metadata>
Aug 15 19:26:06 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:26:06 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:26:06 user nova-compute[73188]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-134988234</nova:name>
Aug 15 19:26:06 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:26:06</nova:creationTime>
Aug 15 19:26:06 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:26:06 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:26:06 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:26:06 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:26:06 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:26:06 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:26:06 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:26:06 user nova-compute[73188]:       <nova:owner>
Aug 15 19:26:06 user nova-compute[73188]:         <nova:user uuid="e7df4b06e72a452ca1dd4643694ce570">tempest-AttachVolumeShelveTestJSON-1675372664-project-member</nova:user>
Aug 15 19:26:06 user nova-compute[73188]:         <nova:project uuid="409362f6976b454ba96b7580b35db949">tempest-AttachVolumeShelveTestJSON-1675372664</nova:project>
Aug 15 19:26:06 user nova-compute[73188]:       </nova:owner>
Aug 15 19:26:06 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:26:06 user nova-compute[73188]:       <nova:ports>
Aug 15 19:26:06 user nova-compute[73188]:         <nova:port uuid="0338047a-ec92-4e13-8b39-95d1feedd2ba">
Aug 15 19:26:06 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 19:26:06 user nova-compute[73188]:         </nova:port>
Aug 15 19:26:06 user nova-compute[73188]:       </nova:ports>
Aug 15 19:26:06 user nova-compute[73188]:     </nova:instance>
Aug 15 19:26:06 user nova-compute[73188]:   </metadata>
Aug 15 19:26:06 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:26:06 user nova-compute[73188]:     <system>
Aug 15 19:26:06 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:26:06 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:26:06 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:26:06 user nova-compute[73188]:       <entry name="serial">18846be1-6828-4182-9285-12a40ecd41b1</entry>
Aug 15 19:26:06 user nova-compute[73188]:       <entry name="uuid">18846be1-6828-4182-9285-12a40ecd41b1</entry>
Aug 15 19:26:06 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:26:06 user nova-compute[73188]:     </system>
Aug 15 19:26:06 user nova-compute[73188]:   </sysinfo>
Aug 15 19:26:06 user nova-compute[73188]:   <os>
Aug 15 19:26:06 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:26:06 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:26:06 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:26:06 user nova-compute[73188]:   </os>
Aug 15 19:26:06 user nova-compute[73188]:   <features>
Aug 15 19:26:06 user nova-compute[73188]:     <acpi/>
Aug 15 19:26:06 user nova-compute[73188]:     <apic/>
Aug 15 19:26:06 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:26:06 user nova-compute[73188]:   </features>
Aug 15 19:26:06 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:26:06 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:26:06 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:26:06 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:26:06 user nova-compute[73188]:   </clock>
Aug 15 19:26:06 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:26:06 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:26:06 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:26:06 user nova-compute[73188]:   </cpu>
Aug 15 19:26:06 user nova-compute[73188]:   <devices>
Aug 15 19:26:06 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:26:06 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:26:06 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk"/>
Aug 15 19:26:06 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:26:06 user nova-compute[73188]:     </disk>
Aug 15 19:26:06 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:26:06 user nova-compute[73188]:       <mac address="fa:16:3e:0f:0a:75"/>
Aug 15 19:26:06 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:26:06 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:26:06 user nova-compute[73188]:       <target dev="tap0338047a-ec"/>
Aug 15 19:26:06 user nova-compute[73188]:     </interface>
Aug 15 19:26:06 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:26:06 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/console.log" append="off"/>
Aug 15 19:26:06 user nova-compute[73188]:     </serial>
Aug 15 19:26:06 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:26:06 user nova-compute[73188]:     <video>
Aug 15 19:26:06 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:26:06 user nova-compute[73188]:     </video>
Aug 15 19:26:06 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:26:06 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:26:06 user nova-compute[73188]:     </rng>
Aug 15 19:26:06 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:26:06 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:26:06 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:26:06 user nova-compute[73188]:     </memballoon>
Aug 15 19:26:06 user nova-compute[73188]:   </devices>
Aug 15 19:26:06 user nova-compute[73188]: </domain>
Aug 15 19:26:06 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-134988234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-134988234',id=39,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzhzrPYTstDFJPRT2CNxzjEcWo8QkZkkQu0rijNzdeU9mLcgs9nv11HKnQZj+hbSx336GiMjlVjxornF/lx6nVpFTcoPy+i149zVtWOmKxbXBVb/jnZeNzmGFLeJ6tPJA==',key_name='tempest-keypair-353430524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='409362f6976b454ba96b7580b35db949',ramdisk_id='',reservation_id='r-3p2mm8lv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1675372664',owner_user_name='tempest-AttachVolumeShelveTestJSON-1675372664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:26:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7df4b06e72a452ca1dd4643694ce570',uuid=18846be1-6828-4182-9285-12a40ecd41b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0338047a-ec", "ovs_interfaceid": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converting VIF {"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0338047a-ec", "ovs_interfaceid": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:0a:75,bridge_name='br-int',has_traffic_filtering=True,id=0338047a-ec92-4e13-8b39-95d1feedd2ba,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0338047a-ec') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG os_vif [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:0a:75,bridge_name='br-int',has_traffic_filtering=True,id=0338047a-ec92-4e13-8b39-95d1feedd2ba,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0338047a-ec') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0338047a-ec, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0338047a-ec, col_values=(('external_ids', {'iface-id': '0338047a-ec92-4e13-8b39-95d1feedd2ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:0a:75', 'vm-uuid': '18846be1-6828-4182-9285-12a40ecd41b1'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:06 user nova-compute[73188]: INFO os_vif [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:0a:75,bridge_name='br-int',has_traffic_filtering=True,id=0338047a-ec92-4e13-8b39-95d1feedd2ba,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0338047a-ec')
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] No VIF found with MAC fa:16:3e:0f:0a:75, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:26:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:07 user nova-compute[73188]: DEBUG nova.network.neutron [req-e7582d48-683a-4947-98ea-ce0458c0c237 req-197c663e-8d03-4845-820e-f89ca235b2da service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Updated VIF entry in instance network info cache for port 0338047a-ec92-4e13-8b39-95d1feedd2ba. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:26:07 user nova-compute[73188]: DEBUG nova.network.neutron [req-e7582d48-683a-4947-98ea-ce0458c0c237 req-197c663e-8d03-4845-820e-f89ca235b2da service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Updating instance_info_cache with network_info: [{"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0338047a-ec", "ovs_interfaceid": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:26:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e7582d48-683a-4947-98ea-ce0458c0c237 req-197c663e-8d03-4845-820e-f89ca235b2da service nova] Releasing lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:26:07 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127552.3799036, 5c2929f0-0a13-4279-ba1a-085ffdb2cd83 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:26:07 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] VM Stopped (Lifecycle Event)
Aug 15 19:26:07 user nova-compute[73188]: DEBUG nova.compute.manager [None req-5e0d3f6f-81df-4bc4-9872-3a9967b7b4bd None None] [instance: 5c2929f0-0a13-4279-ba1a-085ffdb2cd83] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:26:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-706fb0bd-3d7f-439d-888e-76df459355d0 req-0c082f88-fb53-4edd-afd2-b9a21ca253bc service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Received event network-vif-plugged-0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:26:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-706fb0bd-3d7f-439d-888e-76df459355d0 req-0c082f88-fb53-4edd-afd2-b9a21ca253bc service nova] Acquiring lock "18846be1-6828-4182-9285-12a40ecd41b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-706fb0bd-3d7f-439d-888e-76df459355d0 req-0c082f88-fb53-4edd-afd2-b9a21ca253bc service nova] Lock "18846be1-6828-4182-9285-12a40ecd41b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-706fb0bd-3d7f-439d-888e-76df459355d0 req-0c082f88-fb53-4edd-afd2-b9a21ca253bc service nova] Lock "18846be1-6828-4182-9285-12a40ecd41b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:26:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-706fb0bd-3d7f-439d-888e-76df459355d0 req-0c082f88-fb53-4edd-afd2-b9a21ca253bc service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] No waiting events found dispatching network-vif-plugged-0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:26:08 user nova-compute[73188]: WARNING nova.compute.manager [req-706fb0bd-3d7f-439d-888e-76df459355d0 req-0c082f88-fb53-4edd-afd2-b9a21ca253bc service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Received unexpected event network-vif-plugged-0338047a-ec92-4e13-8b39-95d1feedd2ba for instance with vm_state building and task_state spawning.
Aug 15 19:26:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:10 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127570.2109506, 18846be1-6828-4182-9285-12a40ecd41b1 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:26:10 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] VM Resumed (Lifecycle Event)
Aug 15 19:26:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:26:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:26:10 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Instance spawned successfully.
Aug 15 19:26:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:26:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:26:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:26:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:26:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:26:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:26:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:26:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:26:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:26:10 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:26:10 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127570.2128916, 18846be1-6828-4182-9285-12a40ecd41b1 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:26:10 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] VM Started (Lifecycle Event)
Aug 15 19:26:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:26:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:26:10 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:26:10 user nova-compute[73188]: INFO nova.compute.manager [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Took 7.17 seconds to spawn the instance on the hypervisor.
Aug 15 19:26:10 user nova-compute[73188]: DEBUG nova.compute.manager [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:26:10 user nova-compute[73188]: INFO nova.compute.manager [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Took 7.85 seconds to build instance.
Aug 15 19:26:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-11a9df41-d331-4d67-b3c2-55ed73839a1e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "18846be1-6828-4182-9285-12a40ecd41b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.946s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:26:10 user nova-compute[73188]: DEBUG nova.compute.manager [req-f65965a4-6ede-4172-82d4-80e481427228 req-bafe9263-3867-458c-a59a-b8dd3730fd58 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Received event network-vif-plugged-0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:26:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f65965a4-6ede-4172-82d4-80e481427228 req-bafe9263-3867-458c-a59a-b8dd3730fd58 service nova] Acquiring lock "18846be1-6828-4182-9285-12a40ecd41b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f65965a4-6ede-4172-82d4-80e481427228 req-bafe9263-3867-458c-a59a-b8dd3730fd58 service nova] Lock "18846be1-6828-4182-9285-12a40ecd41b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f65965a4-6ede-4172-82d4-80e481427228 req-bafe9263-3867-458c-a59a-b8dd3730fd58 service nova] Lock "18846be1-6828-4182-9285-12a40ecd41b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:26:10 user nova-compute[73188]: DEBUG nova.compute.manager [req-f65965a4-6ede-4172-82d4-80e481427228 req-bafe9263-3867-458c-a59a-b8dd3730fd58 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] No waiting events found dispatching network-vif-plugged-0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:26:10 user nova-compute[73188]: WARNING nova.compute.manager [req-f65965a4-6ede-4172-82d4-80e481427228 req-bafe9263-3867-458c-a59a-b8dd3730fd58 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Received unexpected event network-vif-plugged-0338047a-ec92-4e13-8b39-95d1feedd2ba for instance with vm_state active and task_state None.
Aug 15 19:26:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:22 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:26:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:26:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:26:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:26:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:26:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:26:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:27 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:26:27 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:26:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "d780864e-d471-4a9a-94e2-3ebd9cb08fe2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "d780864e-d471-4a9a-94e2-3ebd9cb08fe2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:26:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:27 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:26:27 user nova-compute[73188]: INFO nova.compute.claims [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Claim successful on node user
Aug 15 19:26:27 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG nova.compute.manager [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG nova.compute.manager [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG nova.network.neutron [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:26:28 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:26:28 user nova-compute[73188]: DEBUG nova.compute.manager [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:26:28 user nova-compute[73188]: INFO nova.virt.block_device [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Booting with volume f0d1c0ed-fb02-4031-a56f-4e15a01873b2 at /dev/vda
Aug 15 19:26:28 user nova-compute[73188]: DEBUG nova.policy [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9503705066e5402cb569fae3b2bd8976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18eadba32f4547ad9436aca9285b7aad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG os_brick.utils [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2732a5dd-57a7-4c86-be20-f1803a5048bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a99dd8-f312-4d08-9f38-6f2048bfee29]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.033s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[da740fd7-bca5-4950-8ff3-0d684ded82ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c801ca7-a8de-4324-a062-853b3c2c8f9f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:26:28 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[587a6653-f8c6-416a-a444-e32d0fa64614]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG os_brick.utils [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Updating existing volume attachment record: 27299397-b093-4aec-9c20-420011e7c8f2 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG nova.network.neutron [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Successfully created port: e7f8d41f-86d5-48b7-bba5-eab023fadb26 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:29 user nova-compute[73188]: DEBUG nova.network.neutron [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Successfully updated port: e7f8d41f-86d5-48b7-bba5-eab023fadb26 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:26:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "refresh_cache-d780864e-d471-4a9a-94e2-3ebd9cb08fe2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:26:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquired lock "refresh_cache-d780864e-d471-4a9a-94e2-3ebd9cb08fe2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:26:29 user nova-compute[73188]: DEBUG nova.network.neutron [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:26:29 user nova-compute[73188]: DEBUG nova.compute.manager [req-7dfa7981-1b9d-45f4-980d-367bff75dfee req-cc54a7de-2df7-4a2a-b04a-bec2e0558ef5 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Received event network-changed-e7f8d41f-86d5-48b7-bba5-eab023fadb26 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:26:29 user nova-compute[73188]: DEBUG nova.compute.manager [req-7dfa7981-1b9d-45f4-980d-367bff75dfee req-cc54a7de-2df7-4a2a-b04a-bec2e0558ef5 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Refreshing instance network info cache due to event network-changed-e7f8d41f-86d5-48b7-bba5-eab023fadb26. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:26:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7dfa7981-1b9d-45f4-980d-367bff75dfee req-cc54a7de-2df7-4a2a-b04a-bec2e0558ef5 service nova] Acquiring lock "refresh_cache-d780864e-d471-4a9a-94e2-3ebd9cb08fe2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:26:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:29 user nova-compute[73188]: DEBUG nova.network.neutron [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:26:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:30 user nova-compute[73188]: DEBUG nova.network.neutron [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Updating instance_info_cache with network_info: [{"id": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "address": "fa:16:3e:90:71:53", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f8d41f-86", "ovs_interfaceid": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:26:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Releasing lock "refresh_cache-d780864e-d471-4a9a-94e2-3ebd9cb08fe2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:26:30 user nova-compute[73188]: DEBUG nova.compute.manager [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Instance network_info: |[{"id": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "address": "fa:16:3e:90:71:53", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f8d41f-86", "ovs_interfaceid": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:26:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7dfa7981-1b9d-45f4-980d-367bff75dfee req-cc54a7de-2df7-4a2a-b04a-bec2e0558ef5 service nova] Acquired lock "refresh_cache-d780864e-d471-4a9a-94e2-3ebd9cb08fe2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:26:30 user nova-compute[73188]: DEBUG nova.network.neutron [req-7dfa7981-1b9d-45f4-980d-367bff75dfee req-cc54a7de-2df7-4a2a-b04a-bec2e0558ef5 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Refreshing network info cache for port e7f8d41f-86d5-48b7-bba5-eab023fadb26 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:26:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:30 user nova-compute[73188]: DEBUG nova.network.neutron [req-7dfa7981-1b9d-45f4-980d-367bff75dfee req-cc54a7de-2df7-4a2a-b04a-bec2e0558ef5 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Updated VIF entry in instance network info cache for port e7f8d41f-86d5-48b7-bba5-eab023fadb26. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:26:30 user nova-compute[73188]: DEBUG nova.network.neutron [req-7dfa7981-1b9d-45f4-980d-367bff75dfee req-cc54a7de-2df7-4a2a-b04a-bec2e0558ef5 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Updating instance_info_cache with network_info: [{"id": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "address": "fa:16:3e:90:71:53", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f8d41f-86", "ovs_interfaceid": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:26:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7dfa7981-1b9d-45f4-980d-367bff75dfee req-cc54a7de-2df7-4a2a-b04a-bec2e0558ef5 service nova] Releasing lock "refresh_cache-d780864e-d471-4a9a-94e2-3ebd9cb08fe2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:26:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:31 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:26:31 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:26:31 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=7910MB free_disk=25.31732940673828GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:26:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:31 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e00adf53-085f-436d-a09f-e97e92ca79cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:26:31 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 139ccf1c-4792-4653-9475-c61b1f9c4846 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:26:31 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 215077af-60a1-4a82-b24e-1545349363d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:26:31 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance b3dd183e-7ab1-40ae-b282-40575a9e47df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:26:31 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:26:31 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 18846be1-6828-4182-9285-12a40ecd41b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:26:31 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance d780864e-d471-4a9a-94e2-3ebd9cb08fe2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:26:31 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:26:31 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:26:31 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing inventories for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 19:26:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:31 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Updating ProviderTree inventory for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 19:26:31 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Updating inventory in ProviderTree for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 19:26:31 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing aggregate associations for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5, aggregates: None {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 19:26:32 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing trait associations for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 19:26:32 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:26:32 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:26:32 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:26:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.799s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:26:32 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:26:32 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:26:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:26:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Didn't find any instances for network info cache update. {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 19:26:32 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:26:32 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:26:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:26:32 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:26:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=73188) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 19:26:35 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:26:35 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:26:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG nova.compute.manager [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:26:37 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Creating image(s)
Aug 15 19:26:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Did not create local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Ensure instance console log exists: /opt/stack/data/nova/instances/d780864e-d471-4a9a-94e2-3ebd9cb08fe2/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Start _get_guest_xml network_info=[{"id": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "address": "fa:16:3e:90:71:53", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f8d41f-86", "ovs_interfaceid": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLhRyXDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd780864e-d471-4a9a-94e2-3ebd9cb08fe2', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0d1c0ed-fb02-4031-a56f-4e15a01873b2', 'serial': 'f0d1c0ed-fb02-4031-a56f-4e15a01873b2'}, 'attachment_id': '27299397-b093-4aec-9c20-420011e7c8f2', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:26:37 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:26:37 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:26:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLhRyXDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:26:37 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:26:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:26:37 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:26:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:26:37 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[11367a52-8cf6-4502-a99f-8b372b56bce2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:26:37 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[18014fb8-8af2-4efb-b6ad-ee3bba50d762]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2] added
Aug 15 19:26:37 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[37df9a16-bb1d-49fb-96d4-e8bed9b5ad84]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f524ed2-81bf-4b15-a902-c8ebe638a9de]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pLhRyXDQ {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pLhRyXDQ" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[50760ed9-4d5e-40c1-8cea-dcb1831a8904]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pLhRyXDQ'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a17542-f275-444c-b2dc-35d5b9aac4e7]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d0a6db-0bbe-41fc-b3c7-033e30b5f1fd]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:26:37 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:26:37 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd23555-8dac-48a6-88bb-88cf0ad9246e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2, portal: 172.16.0.220,3260]
Aug 15 19:26:37 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2, portal: 172.16.0.220,3260] successful.
Aug 15 19:26:37 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[47eb9baf-c545-46d7-a063-99b421db8fde]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be627dc-fe1f-45dd-b910-ef58d6eaa70f]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:26:37 user nova-compute[73188]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:26:37 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:26:37 user nova-compute[73188]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:26:37 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac0cf63-fcbc-44c0-8807-b50bfa5e1ec2]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:26:37 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: None {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:26:38 user nova-compute[73188]: INFO nova.compute.manager [None req-ef4d29f5-402d-4931-8c2e-e21ec08174f0 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Get console output
Aug 15 19:26:38 user nova-compute[73188]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 15 19:26:38 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLhRyXDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23263363033363438', 'path': '/dev/sdb'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263363033363438', 'path': '/dev/sdb'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1151923873',display_name='tempest-TestVolumeBootPattern-server-1151923873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1151923873',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdjONelCosej3I/pGPD4UfCZO2hIpepMykeX7dOlXZGpPLQP0eHCaELWxQF5jeHsky1dPgp1Jk+Jsu/dHFRA3/Yz5MW9r+VfrqEngMakotyTy6CftX4lIdZFQ2vRevOkg==',key_name='tempest-TestVolumeBootPattern-1653977396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18eadba32f4547ad9436aca9285b7aad',ramdisk_id='',reservation_id='r-ccycsiqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2114363476',owner_user_name='tempest-TestVolumeBootPattern-2114363476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:26:28Z,user_data=None,user_id='9503705066e5402cb569fae3b2bd8976',uuid=d780864e-d471-4a9a-94e2-3ebd9cb08fe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "address": "fa:16:3e:90:71:53", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f8d41f-86", "ovs_interfaceid": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converting VIF {"id": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "address": "fa:16:3e:90:71:53", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f8d41f-86", "ovs_interfaceid": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:71:53,bridge_name='br-int',has_traffic_filtering=True,id=e7f8d41f-86d5-48b7-bba5-eab023fadb26,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f8d41f-86') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG nova.objects.instance [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lazy-loading 'pci_devices' on Instance uuid d780864e-d471-4a9a-94e2-3ebd9cb08fe2 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:26:38 user nova-compute[73188]:   <uuid>d780864e-d471-4a9a-94e2-3ebd9cb08fe2</uuid>
Aug 15 19:26:38 user nova-compute[73188]:   <name>instance-00000028</name>
Aug 15 19:26:38 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:26:38 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:26:38 user nova-compute[73188]:   <metadata>
Aug 15 19:26:38 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:26:38 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:26:38 user nova-compute[73188]:       <nova:name>tempest-TestVolumeBootPattern-server-1151923873</nova:name>
Aug 15 19:26:38 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:26:37</nova:creationTime>
Aug 15 19:26:38 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:26:38 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:26:38 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:26:38 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:26:38 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:26:38 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:26:38 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:26:38 user nova-compute[73188]:       <nova:owner>
Aug 15 19:26:38 user nova-compute[73188]:         <nova:user uuid="9503705066e5402cb569fae3b2bd8976">tempest-TestVolumeBootPattern-2114363476-project-member</nova:user>
Aug 15 19:26:38 user nova-compute[73188]:         <nova:project uuid="18eadba32f4547ad9436aca9285b7aad">tempest-TestVolumeBootPattern-2114363476</nova:project>
Aug 15 19:26:38 user nova-compute[73188]:       </nova:owner>
Aug 15 19:26:38 user nova-compute[73188]:       <nova:ports>
Aug 15 19:26:38 user nova-compute[73188]:         <nova:port uuid="e7f8d41f-86d5-48b7-bba5-eab023fadb26">
Aug 15 19:26:38 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 19:26:38 user nova-compute[73188]:         </nova:port>
Aug 15 19:26:38 user nova-compute[73188]:       </nova:ports>
Aug 15 19:26:38 user nova-compute[73188]:     </nova:instance>
Aug 15 19:26:38 user nova-compute[73188]:   </metadata>
Aug 15 19:26:38 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:26:38 user nova-compute[73188]:     <system>
Aug 15 19:26:38 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:26:38 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:26:38 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:26:38 user nova-compute[73188]:       <entry name="serial">d780864e-d471-4a9a-94e2-3ebd9cb08fe2</entry>
Aug 15 19:26:38 user nova-compute[73188]:       <entry name="uuid">d780864e-d471-4a9a-94e2-3ebd9cb08fe2</entry>
Aug 15 19:26:38 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:26:38 user nova-compute[73188]:     </system>
Aug 15 19:26:38 user nova-compute[73188]:   </sysinfo>
Aug 15 19:26:38 user nova-compute[73188]:   <os>
Aug 15 19:26:38 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:26:38 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:26:38 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:26:38 user nova-compute[73188]:   </os>
Aug 15 19:26:38 user nova-compute[73188]:   <features>
Aug 15 19:26:38 user nova-compute[73188]:     <acpi/>
Aug 15 19:26:38 user nova-compute[73188]:     <apic/>
Aug 15 19:26:38 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:26:38 user nova-compute[73188]:   </features>
Aug 15 19:26:38 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:26:38 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:26:38 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:26:38 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:26:38 user nova-compute[73188]:   </clock>
Aug 15 19:26:38 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:26:38 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:26:38 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:26:38 user nova-compute[73188]:   </cpu>
Aug 15 19:26:38 user nova-compute[73188]:   <devices>
Aug 15 19:26:38 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:26:38 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:26:38 user nova-compute[73188]:       <source dev="/dev/sdb"/>
Aug 15 19:26:38 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:26:38 user nova-compute[73188]:       <serial>f0d1c0ed-fb02-4031-a56f-4e15a01873b2</serial>
Aug 15 19:26:38 user nova-compute[73188]:     </disk>
Aug 15 19:26:38 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:26:38 user nova-compute[73188]:       <mac address="fa:16:3e:90:71:53"/>
Aug 15 19:26:38 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:26:38 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:26:38 user nova-compute[73188]:       <target dev="tape7f8d41f-86"/>
Aug 15 19:26:38 user nova-compute[73188]:     </interface>
Aug 15 19:26:38 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:26:38 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/d780864e-d471-4a9a-94e2-3ebd9cb08fe2/console.log" append="off"/>
Aug 15 19:26:38 user nova-compute[73188]:     </serial>
Aug 15 19:26:38 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:26:38 user nova-compute[73188]:     <video>
Aug 15 19:26:38 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:26:38 user nova-compute[73188]:     </video>
Aug 15 19:26:38 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:26:38 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:26:38 user nova-compute[73188]:     </rng>
Aug 15 19:26:38 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:26:38 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:26:38 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:26:38 user nova-compute[73188]:     </memballoon>
Aug 15 19:26:38 user nova-compute[73188]:   </devices>
Aug 15 19:26:38 user nova-compute[73188]: </domain>
Aug 15 19:26:38 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1151923873',display_name='tempest-TestVolumeBootPattern-server-1151923873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1151923873',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdjONelCosej3I/pGPD4UfCZO2hIpepMykeX7dOlXZGpPLQP0eHCaELWxQF5jeHsky1dPgp1Jk+Jsu/dHFRA3/Yz5MW9r+VfrqEngMakotyTy6CftX4lIdZFQ2vRevOkg==',key_name='tempest-TestVolumeBootPattern-1653977396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18eadba32f4547ad9436aca9285b7aad',ramdisk_id='',reservation_id='r-ccycsiqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2114363476',owner_user_name='tempest-TestVolumeBootPattern-2114363476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:26:28Z,user_data=None,user_id='9503705066e5402cb569fae3b2bd8976',uuid=d780864e-d471-4a9a-94e2-3ebd9cb08fe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "address": "fa:16:3e:90:71:53", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f8d41f-86", "ovs_interfaceid": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converting VIF {"id": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "address": "fa:16:3e:90:71:53", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f8d41f-86", "ovs_interfaceid": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:71:53,bridge_name='br-int',has_traffic_filtering=True,id=e7f8d41f-86d5-48b7-bba5-eab023fadb26,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f8d41f-86') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG os_vif [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:71:53,bridge_name='br-int',has_traffic_filtering=True,id=e7f8d41f-86d5-48b7-bba5-eab023fadb26,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f8d41f-86') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7f8d41f-86, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape7f8d41f-86, col_values=(('external_ids', {'iface-id': 'e7f8d41f-86d5-48b7-bba5-eab023fadb26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:71:53', 'vm-uuid': 'd780864e-d471-4a9a-94e2-3ebd9cb08fe2'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:38 user nova-compute[73188]: INFO os_vif [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:71:53,bridge_name='br-int',has_traffic_filtering=True,id=e7f8d41f-86d5-48b7-bba5-eab023fadb26,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f8d41f-86')
Aug 15 19:26:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:26:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] No VIF found with MAC fa:16:3e:90:71:53, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:26:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-e62f9cf3-3d32-4b31-8e26-dc5f7ffb962d req-9d549bb9-404c-481a-b6f9-1825476b7f53 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Received event network-vif-plugged-e7f8d41f-86d5-48b7-bba5-eab023fadb26 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:26:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e62f9cf3-3d32-4b31-8e26-dc5f7ffb962d req-9d549bb9-404c-481a-b6f9-1825476b7f53 service nova] Acquiring lock "d780864e-d471-4a9a-94e2-3ebd9cb08fe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e62f9cf3-3d32-4b31-8e26-dc5f7ffb962d req-9d549bb9-404c-481a-b6f9-1825476b7f53 service nova] Lock "d780864e-d471-4a9a-94e2-3ebd9cb08fe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e62f9cf3-3d32-4b31-8e26-dc5f7ffb962d req-9d549bb9-404c-481a-b6f9-1825476b7f53 service nova] Lock "d780864e-d471-4a9a-94e2-3ebd9cb08fe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:26:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-e62f9cf3-3d32-4b31-8e26-dc5f7ffb962d req-9d549bb9-404c-481a-b6f9-1825476b7f53 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] No waiting events found dispatching network-vif-plugged-e7f8d41f-86d5-48b7-bba5-eab023fadb26 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:26:40 user nova-compute[73188]: WARNING nova.compute.manager [req-e62f9cf3-3d32-4b31-8e26-dc5f7ffb962d req-9d549bb9-404c-481a-b6f9-1825476b7f53 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Received unexpected event network-vif-plugged-e7f8d41f-86d5-48b7-bba5-eab023fadb26 for instance with vm_state building and task_state spawning.
Aug 15 19:26:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:41 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:26:41 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Cleaning up deleted instances {{(pid=73188) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 19:26:41 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] There are 0 instances to clean {{(pid=73188) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 19:26:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:42 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127602.1024723, d780864e-d471-4a9a-94e2-3ebd9cb08fe2 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:26:42 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] VM Resumed (Lifecycle Event)
Aug 15 19:26:42 user nova-compute[73188]: DEBUG nova.compute.manager [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:26:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:26:42 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Instance spawned successfully.
Aug 15 19:26:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:26:42 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:26:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:26:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:26:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:26:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:26:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:26:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:26:42 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:26:42 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:26:42 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127602.1035097, d780864e-d471-4a9a-94e2-3ebd9cb08fe2 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:26:42 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] VM Started (Lifecycle Event)
Aug 15 19:26:42 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:26:42 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:26:42 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:26:42 user nova-compute[73188]: INFO nova.compute.manager [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Took 4.92 seconds to spawn the instance on the hypervisor.
Aug 15 19:26:42 user nova-compute[73188]: DEBUG nova.compute.manager [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:26:42 user nova-compute[73188]: INFO nova.compute.manager [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Took 14.68 seconds to build instance.
Aug 15 19:26:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dbcfe5e8-f3e8-4f7c-9e17-2d1262652f3b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "d780864e-d471-4a9a-94e2-3ebd9cb08fe2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.769s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:26:42 user nova-compute[73188]: DEBUG nova.compute.manager [req-ab34a548-3511-4627-8bdf-11f33b790f17 req-1a6aa887-17c0-416c-817f-50a592915893 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Received event network-vif-plugged-e7f8d41f-86d5-48b7-bba5-eab023fadb26 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:26:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ab34a548-3511-4627-8bdf-11f33b790f17 req-1a6aa887-17c0-416c-817f-50a592915893 service nova] Acquiring lock "d780864e-d471-4a9a-94e2-3ebd9cb08fe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ab34a548-3511-4627-8bdf-11f33b790f17 req-1a6aa887-17c0-416c-817f-50a592915893 service nova] Lock "d780864e-d471-4a9a-94e2-3ebd9cb08fe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ab34a548-3511-4627-8bdf-11f33b790f17 req-1a6aa887-17c0-416c-817f-50a592915893 service nova] Lock "d780864e-d471-4a9a-94e2-3ebd9cb08fe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:26:42 user nova-compute[73188]: DEBUG nova.compute.manager [req-ab34a548-3511-4627-8bdf-11f33b790f17 req-1a6aa887-17c0-416c-817f-50a592915893 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] No waiting events found dispatching network-vif-plugged-e7f8d41f-86d5-48b7-bba5-eab023fadb26 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:26:42 user nova-compute[73188]: WARNING nova.compute.manager [req-ab34a548-3511-4627-8bdf-11f33b790f17 req-1a6aa887-17c0-416c-817f-50a592915893 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Received unexpected event network-vif-plugged-e7f8d41f-86d5-48b7-bba5-eab023fadb26 for instance with vm_state active and task_state None.
Aug 15 19:26:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:26:49 user nova-compute[73188]: INFO nova.compute.manager [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Terminating instance
Aug 15 19:26:49 user nova-compute[73188]: DEBUG nova.compute.manager [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:26:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-e7e4d09b-22f4-435f-9548-fd1100fe9f55 req-e0094300-1e33-4b69-8ce0-17c27495a8f7 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received event network-vif-unplugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:26:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e7e4d09b-22f4-435f-9548-fd1100fe9f55 req-e0094300-1e33-4b69-8ce0-17c27495a8f7 service nova] Acquiring lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e7e4d09b-22f4-435f-9548-fd1100fe9f55 req-e0094300-1e33-4b69-8ce0-17c27495a8f7 service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e7e4d09b-22f4-435f-9548-fd1100fe9f55 req-e0094300-1e33-4b69-8ce0-17c27495a8f7 service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:26:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-e7e4d09b-22f4-435f-9548-fd1100fe9f55 req-e0094300-1e33-4b69-8ce0-17c27495a8f7 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] No waiting events found dispatching network-vif-unplugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:26:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-e7e4d09b-22f4-435f-9548-fd1100fe9f55 req-e0094300-1e33-4b69-8ce0-17c27495a8f7 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received event network-vif-unplugged-0546e618-e785-46c7-aa82-d527ec295deb for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:26:50 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Instance destroyed successfully.
Aug 15 19:26:50 user nova-compute[73188]: DEBUG nova.objects.instance [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'resources' on Instance uuid b3dd183e-7ab1-40ae-b282-40575a9e47df {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:26:50 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-10055614',display_name='tempest-AttachVolumeTestJSON-server-10055614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-10055614',id=28,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMQScQjuREEUf8BduiZ5KX0osvQ5QWZEC23alXhUk4mA8l8fA2zn02jcheLrGtQU0hVs1wuTRm/gfQIlRP/+vodTg9/qG3oTDrK2DQcQ9kCcFR8/YFg4QfP/P5iwNCjNg==',key_name='tempest-keypair-229082612',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:17:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='399c3c31298f41dbb11ae1c0bc593e1f',ramdisk_id='',reservation_id='r-jd0udn2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-953696987',owner_user_name='tempest-AttachVolumeTestJSON-953696987-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:25:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae5b2b05980944af80c4ffe09cd20de1',uuid=b3dd183e-7ab1-40ae-b282-40575a9e47df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:26:50 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converting VIF {"id": "0546e618-e785-46c7-aa82-d527ec295deb", "address": "fa:16:3e:d9:51:98", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0546e618-e7", "ovs_interfaceid": "0546e618-e785-46c7-aa82-d527ec295deb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:26:50 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:51:98,bridge_name='br-int',has_traffic_filtering=True,id=0546e618-e785-46c7-aa82-d527ec295deb,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0546e618-e7') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:26:50 user nova-compute[73188]: DEBUG os_vif [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:51:98,bridge_name='br-int',has_traffic_filtering=True,id=0546e618-e785-46c7-aa82-d527ec295deb,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0546e618-e7') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:26:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0546e618-e7, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:26:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:26:50 user nova-compute[73188]: INFO os_vif [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:51:98,bridge_name='br-int',has_traffic_filtering=True,id=0546e618-e785-46c7-aa82-d527ec295deb,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0546e618-e7')
Aug 15 19:26:50 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Deleting instance files /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df_del
Aug 15 19:26:50 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Deletion of /opt/stack/data/nova/instances/b3dd183e-7ab1-40ae-b282-40575a9e47df_del complete
Aug 15 19:26:50 user nova-compute[73188]: INFO nova.compute.manager [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 15 19:26:50 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:26:50 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:26:50 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:26:51 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:26:51 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Took 0.93 seconds to deallocate network for instance.
Aug 15 19:26:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-6a9ddf89-8171-4130-b02f-3dc1b936c774 req-beaf3f83-c0bb-4e53-bdd2-66881b60d081 service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received event network-vif-deleted-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:26:51 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:26:51 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:26:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:26:51 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Deleted allocations for instance b3dd183e-7ab1-40ae-b282-40575a9e47df
Aug 15 19:26:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-345c1a8b-0cb6-4928-a211-83b5c8054734 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.134s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:26:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-d9928725-b143-4097-982e-05d2a3c3ddfe req-7e0bf105-f2a3-4682-b7f4-a30dd7f0676e service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received event network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:26:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d9928725-b143-4097-982e-05d2a3c3ddfe req-7e0bf105-f2a3-4682-b7f4-a30dd7f0676e service nova] Acquiring lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d9928725-b143-4097-982e-05d2a3c3ddfe req-7e0bf105-f2a3-4682-b7f4-a30dd7f0676e service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d9928725-b143-4097-982e-05d2a3c3ddfe req-7e0bf105-f2a3-4682-b7f4-a30dd7f0676e service nova] Lock "b3dd183e-7ab1-40ae-b282-40575a9e47df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:26:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-d9928725-b143-4097-982e-05d2a3c3ddfe req-7e0bf105-f2a3-4682-b7f4-a30dd7f0676e service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] No waiting events found dispatching network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:26:52 user nova-compute[73188]: WARNING nova.compute.manager [req-d9928725-b143-4097-982e-05d2a3c3ddfe req-7e0bf105-f2a3-4682-b7f4-a30dd7f0676e service nova] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Received unexpected event network-vif-plugged-0546e618-e785-46c7-aa82-d527ec295deb for instance with vm_state deleted and task_state None.
Aug 15 19:26:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "215077af-60a1-4a82-b24e-1545349363d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "215077af-60a1-4a82-b24e-1545349363d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "215077af-60a1-4a82-b24e-1545349363d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "215077af-60a1-4a82-b24e-1545349363d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "215077af-60a1-4a82-b24e-1545349363d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:26:57 user nova-compute[73188]: INFO nova.compute.manager [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Terminating instance
Aug 15 19:26:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:26:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-4f8fe953-960b-47ab-b144-5ae93149c887 req-9d9ec35c-6c04-4cf2-ad18-e7a2ac893700 service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Received event network-vif-unplugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:26:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4f8fe953-960b-47ab-b144-5ae93149c887 req-9d9ec35c-6c04-4cf2-ad18-e7a2ac893700 service nova] Acquiring lock "215077af-60a1-4a82-b24e-1545349363d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4f8fe953-960b-47ab-b144-5ae93149c887 req-9d9ec35c-6c04-4cf2-ad18-e7a2ac893700 service nova] Lock "215077af-60a1-4a82-b24e-1545349363d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4f8fe953-960b-47ab-b144-5ae93149c887 req-9d9ec35c-6c04-4cf2-ad18-e7a2ac893700 service nova] Lock "215077af-60a1-4a82-b24e-1545349363d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:26:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-4f8fe953-960b-47ab-b144-5ae93149c887 req-9d9ec35c-6c04-4cf2-ad18-e7a2ac893700 service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] No waiting events found dispatching network-vif-unplugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:26:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-4f8fe953-960b-47ab-b144-5ae93149c887 req-9d9ec35c-6c04-4cf2-ad18-e7a2ac893700 service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Received event network-vif-unplugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:26:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:58 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Instance destroyed successfully.
Aug 15 19:26:58 user nova-compute[73188]: DEBUG nova.objects.instance [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'resources' on Instance uuid 215077af-60a1-4a82-b24e-1545349363d0 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:26:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-151802008',display_name='tempest-ServerRescueNegativeTestJSON-server-151802008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-151802008',id=19,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:12:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eeb950591a3349908b17b33c0ebca302',ramdisk_id='',reservation_id='r-j4tpbmap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-990996828',owner_user_name='tempest-ServerRescueNegativeTestJSON-990996828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:12:24Z,user_data=None,user_id='88c0edd2a58744da9497d7c5164f22a2',uuid=215077af-60a1-4a82-b24e-1545349363d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "address": "fa:16:3e:d0:70:59", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38266cdc-3c", "ovs_interfaceid": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:26:58 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converting VIF {"id": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "address": "fa:16:3e:d0:70:59", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38266cdc-3c", "ovs_interfaceid": "38266cdc-3cf0-422f-b63b-4cec2cbc3eaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:26:58 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:70:59,bridge_name='br-int',has_traffic_filtering=True,id=38266cdc-3cf0-422f-b63b-4cec2cbc3eaf,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38266cdc-3c') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:26:58 user nova-compute[73188]: DEBUG os_vif [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:70:59,bridge_name='br-int',has_traffic_filtering=True,id=38266cdc-3cf0-422f-b63b-4cec2cbc3eaf,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38266cdc-3c') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:26:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38266cdc-3c, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:26:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:26:58 user nova-compute[73188]: INFO os_vif [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:70:59,bridge_name='br-int',has_traffic_filtering=True,id=38266cdc-3cf0-422f-b63b-4cec2cbc3eaf,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38266cdc-3c')
Aug 15 19:26:58 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Deleting instance files /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0_del
Aug 15 19:26:58 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Deletion of /opt/stack/data/nova/instances/215077af-60a1-4a82-b24e-1545349363d0_del complete
Aug 15 19:26:58 user nova-compute[73188]: INFO nova.compute.manager [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 15 19:26:58 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:26:58 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:26:58 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 215077af-60a1-4a82-b24e-1545349363d0] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:26:59 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:26:59 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Took 0.59 seconds to deallocate network for instance.
Aug 15 19:26:59 user nova-compute[73188]: DEBUG nova.compute.manager [req-ed1f04f0-e232-4fe8-aa39-a780defa30df req-2ced812e-b6a3-4a30-b661-2be5ab80994a service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Received event network-vif-deleted-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:26:59 user nova-compute[73188]: INFO nova.compute.manager [req-ed1f04f0-e232-4fe8-aa39-a780defa30df req-2ced812e-b6a3-4a30-b661-2be5ab80994a service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Neutron deleted interface 38266cdc-3cf0-422f-b63b-4cec2cbc3eaf; detaching it from the instance and deleting it from the info cache
Aug 15 19:26:59 user nova-compute[73188]: DEBUG nova.network.neutron [req-ed1f04f0-e232-4fe8-aa39-a780defa30df req-2ced812e-b6a3-4a30-b661-2be5ab80994a service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:26:59 user nova-compute[73188]: DEBUG nova.compute.manager [req-ed1f04f0-e232-4fe8-aa39-a780defa30df req-2ced812e-b6a3-4a30-b661-2be5ab80994a service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Detach interface failed, port_id=38266cdc-3cf0-422f-b63b-4cec2cbc3eaf, reason: Instance 215077af-60a1-4a82-b24e-1545349363d0 could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:26:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:26:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:26:59 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:26:59 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:26:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:26:59 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Deleted allocations for instance 215077af-60a1-4a82-b24e-1545349363d0
Aug 15 19:26:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c914506c-4eb2-4d6e-bcee-981462a4c83c tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "215077af-60a1-4a82-b24e-1545349363d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.964s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:27:00 user nova-compute[73188]: DEBUG nova.compute.manager [req-df10a0f5-6023-4520-b823-06c72b54971f req-ee88ac9b-0bbe-4a16-b377-3fdd5044ff55 service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Received event network-vif-plugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:27:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-df10a0f5-6023-4520-b823-06c72b54971f req-ee88ac9b-0bbe-4a16-b377-3fdd5044ff55 service nova] Acquiring lock "215077af-60a1-4a82-b24e-1545349363d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:27:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-df10a0f5-6023-4520-b823-06c72b54971f req-ee88ac9b-0bbe-4a16-b377-3fdd5044ff55 service nova] Lock "215077af-60a1-4a82-b24e-1545349363d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:27:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-df10a0f5-6023-4520-b823-06c72b54971f req-ee88ac9b-0bbe-4a16-b377-3fdd5044ff55 service nova] Lock "215077af-60a1-4a82-b24e-1545349363d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:27:00 user nova-compute[73188]: DEBUG nova.compute.manager [req-df10a0f5-6023-4520-b823-06c72b54971f req-ee88ac9b-0bbe-4a16-b377-3fdd5044ff55 service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] No waiting events found dispatching network-vif-plugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:27:00 user nova-compute[73188]: WARNING nova.compute.manager [req-df10a0f5-6023-4520-b823-06c72b54971f req-ee88ac9b-0bbe-4a16-b377-3fdd5044ff55 service nova] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Received unexpected event network-vif-plugged-38266cdc-3cf0-422f-b63b-4cec2cbc3eaf for instance with vm_state deleted and task_state None.
Aug 15 19:27:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:05 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127610.3038206, b3dd183e-7ab1-40ae-b282-40575a9e47df => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:27:05 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] VM Stopped (Lifecycle Event)
Aug 15 19:27:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b22df6bf-9101-4476-af7a-65099eb84906 None None] [instance: b3dd183e-7ab1-40ae-b282-40575a9e47df] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:27:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:13 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127618.7915401, 215077af-60a1-4a82-b24e-1545349363d0 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:27:13 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 215077af-60a1-4a82-b24e-1545349363d0] VM Stopped (Lifecycle Event)
Aug 15 19:27:13 user nova-compute[73188]: DEBUG nova.compute.manager [None req-41afe046-4a0f-45ac-a0eb-70792bb039f0 None None] [instance: 215077af-60a1-4a82-b24e-1545349363d0] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:27:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:27:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:27:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:27:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:27:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:22 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:27:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:27:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:27:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:27:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:27:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:27:29 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:27:29 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:27:30 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:27:30 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:27:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:27:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:27:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:27:30 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:27:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:27:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:27:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:27:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:27:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:27:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:27:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:27:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:27:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:27:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:27:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:27:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:27:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:27:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:27:32 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:27:32 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:27:32 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8067MB free_disk=25.361190795898438GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:27:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:27:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:27:32 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e00adf53-085f-436d-a09f-e97e92ca79cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:27:32 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 139ccf1c-4792-4653-9475-c61b1f9c4846 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:27:32 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:27:32 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 18846be1-6828-4182-9285-12a40ecd41b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:27:32 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance d780864e-d471-4a9a-94e2-3ebd9cb08fe2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:27:32 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:27:32 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:27:32 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:27:32 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:27:32 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:27:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:27:33 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:27:33 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:27:33 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:27:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-e00adf53-085f-436d-a09f-e97e92ca79cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:27:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-e00adf53-085f-436d-a09f-e97e92ca79cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:27:33 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:27:33 user nova-compute[73188]: DEBUG nova.objects.instance [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lazy-loading 'info_cache' on Instance uuid e00adf53-085f-436d-a09f-e97e92ca79cd {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:27:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:27:34 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Updating instance_info_cache with network_info: [{"id": "4646dbfd-e829-4653-9e76-e34901f8ad33", "address": "fa:16:3e:db:be:12", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4646dbfd-e8", "ovs_interfaceid": "4646dbfd-e829-4653-9e76-e34901f8ad33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:27:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-e00adf53-085f-436d-a09f-e97e92ca79cd" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:27:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:27:34 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:27:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:27:35 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:27:35 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:27:36 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:27:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:27:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:27:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:27:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:27:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:27:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:27:38 user nova-compute[73188]: INFO nova.compute.manager [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Terminating instance
Aug 15 19:27:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:39 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Instance destroyed successfully.
Aug 15 19:27:39 user nova-compute[73188]: DEBUG nova.objects.instance [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'resources' on Instance uuid e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1831045405',display_name='tempest-ServerActionsTestOtherA-server-1831045405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1831045405',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIh7IYSXIzW76yUh0lcXYRIDkLihwOuaxeqKxDoqlHxog01X1wGWUVb+WSkm+7EoRfQvo2EKI4l4BqBnCc2BP7hJFNq/yIn4BoRVp0zONEwe3FPB6tn+4jOCYVx7bU/R3g==',key_name='tempest-keypair-1497630278',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:23:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3c085a0ccf841e297d98037c07a7111',ramdisk_id='',reservation_id='r-gn04qlii',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2026424764',owner_user_name='tempest-ServerActionsTestOtherA-2026424764-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:24:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30de55a2834422c8f6df816899b881e',uuid=e0d0b28d-602f-47dd-a798-2d9c54b1a2c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "address": "fa:16:3e:20:ae:90", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b20fd1-f9", "ovs_interfaceid": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converting VIF {"id": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "address": "fa:16:3e:20:ae:90", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b20fd1-f9", "ovs_interfaceid": "35b20fd1-f9c9-4cd7-8744-77f418bd0428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:ae:90,bridge_name='br-int',has_traffic_filtering=True,id=35b20fd1-f9c9-4cd7-8744-77f418bd0428,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35b20fd1-f9') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG os_vif [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:ae:90,bridge_name='br-int',has_traffic_filtering=True,id=35b20fd1-f9c9-4cd7-8744-77f418bd0428,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35b20fd1-f9') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35b20fd1-f9, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:39 user nova-compute[73188]: INFO os_vif [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:ae:90,bridge_name='br-int',has_traffic_filtering=True,id=35b20fd1-f9c9-4cd7-8744-77f418bd0428,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35b20fd1-f9')
Aug 15 19:27:39 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RbgQdsPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:27:39 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:27:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG nova.compute.manager [req-73998726-88de-46e0-b9ec-327298b0ec51 req-666aca14-ee52-4ff0-b8fa-f8a1f5221e2c service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Received event network-vif-unplugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-73998726-88de-46e0-b9ec-327298b0ec51 req-666aca14-ee52-4ff0-b8fa-f8a1f5221e2c service nova] Acquiring lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-73998726-88de-46e0-b9ec-327298b0ec51 req-666aca14-ee52-4ff0-b8fa-f8a1f5221e2c service nova] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-73998726-88de-46e0-b9ec-327298b0ec51 req-666aca14-ee52-4ff0-b8fa-f8a1f5221e2c service nova] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG nova.compute.manager [req-73998726-88de-46e0-b9ec-327298b0ec51 req-666aca14-ee52-4ff0-b8fa-f8a1f5221e2c service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] No waiting events found dispatching network-vif-unplugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG nova.compute.manager [req-73998726-88de-46e0-b9ec-327298b0ec51 req-666aca14-ee52-4ff0-b8fa-f8a1f5221e2c service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Received event network-vif-unplugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b207bf-59bb-4fbb-a22e-f3c8471229c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b828be33-9eb4-411d-8712-008874c30fe7]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:27:39 user nova-compute[73188]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:27:39 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 (non-flash)
Aug 15 19:27:39 user nova-compute[73188]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:27:39 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281028e950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69'): ({'sdc'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Removing single pathed devices sdc {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[36064b7a-db1d-47ed-b4a8-62ef9fec076f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1648e964-46c3-47d1-bb46-4d19c6036152]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Flushing IO for device /dev/sdc {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e039e43-3c32-4b30-988e-06b443dc697e]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0651a94d-18f8-4b0e-9327-e8a194a21721]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] SCSI volumes sdc have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO907b1451-b3910d69a43a6962', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_907b1451', '/dev/disk/by-id/scsi-26233393130643639') {{(pid=83967) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfec1993-f8de-4720-8dd9-4d142dc01bec]: (4, None) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e80b05-cc85-40c7-b0d5-139e265a6203]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:27:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:27:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:27:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b85d926-38ed-49b5-91e6-c5e08d358e52]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:27:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69, portal: 172.16.0.220,3260]
Aug 15 19:27:40 user nova-compute[73188]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69, portal: 172.16.0.220,3260] successful.
Aug 15 19:27:40 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:27:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:27:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7f56af9-f1ab-443d-a7ec-63468e65fb69 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:27:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed500941-519c-45fc-9767-5e34da327237]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:27:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:27:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:27:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] <== disconnect_volume: return (317ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:27:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:27:40 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Deleting instance files /opt/stack/data/nova/instances/e0d0b28d-602f-47dd-a798-2d9c54b1a2c7_del
Aug 15 19:27:40 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Deletion of /opt/stack/data/nova/instances/e0d0b28d-602f-47dd-a798-2d9c54b1a2c7_del complete
Aug 15 19:27:40 user nova-compute[73188]: INFO nova.compute.manager [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 15 19:27:40 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:27:40 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:27:40 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:27:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:41 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:27:41 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Took 1.20 seconds to deallocate network for instance.
Aug 15 19:27:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-63666c21-6aa2-4c00-a71b-7666223e1cf6 req-ae705ec5-a85c-49be-9d53-514e7b8d864e service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Received event network-vif-deleted-35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:27:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-bdc1a423-c66b-416e-a829-cd4cb2281003 req-d15abdfc-2231-4727-9f45-6acff82f3baf service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Received event network-vif-plugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:27:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-bdc1a423-c66b-416e-a829-cd4cb2281003 req-d15abdfc-2231-4727-9f45-6acff82f3baf service nova] Acquiring lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:27:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-bdc1a423-c66b-416e-a829-cd4cb2281003 req-d15abdfc-2231-4727-9f45-6acff82f3baf service nova] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:27:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-bdc1a423-c66b-416e-a829-cd4cb2281003 req-d15abdfc-2231-4727-9f45-6acff82f3baf service nova] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:27:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-bdc1a423-c66b-416e-a829-cd4cb2281003 req-d15abdfc-2231-4727-9f45-6acff82f3baf service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] No waiting events found dispatching network-vif-plugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:27:41 user nova-compute[73188]: WARNING nova.compute.manager [req-bdc1a423-c66b-416e-a829-cd4cb2281003 req-d15abdfc-2231-4727-9f45-6acff82f3baf service nova] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Received unexpected event network-vif-plugged-35b20fd1-f9c9-4cd7-8744-77f418bd0428 for instance with vm_state active and task_state deleting.
Aug 15 19:27:42 user nova-compute[73188]: INFO nova.compute.manager [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Took 0.81 seconds to detach 1 volumes for instance.
Aug 15 19:27:42 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Deleting volume: a7f56af9-f1ab-443d-a7ec-63468e65fb69 {{(pid=73188) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 19:27:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:27:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:27:42 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:27:42 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:27:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:27:42 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Deleted allocations for instance e0d0b28d-602f-47dd-a798-2d9c54b1a2c7
Aug 15 19:27:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1f8a6bbe-c2ef-4173-8224-fec61f47ceaa tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "e0d0b28d-602f-47dd-a798-2d9c54b1a2c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.662s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:27:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:27:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:27:44 user nova-compute[73188]: DEBUG nova.compute.manager [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:27:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:27:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:27:44 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:27:44 user nova-compute[73188]: INFO nova.compute.claims [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Claim successful on node user
Aug 15 19:27:44 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:27:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:44 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:27:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.281s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:27:44 user nova-compute[73188]: DEBUG nova.compute.manager [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:27:44 user nova-compute[73188]: DEBUG nova.compute.manager [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:27:44 user nova-compute[73188]: DEBUG nova.network.neutron [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:27:44 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:27:44 user nova-compute[73188]: DEBUG nova.compute.manager [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:27:44 user nova-compute[73188]: DEBUG nova.policy [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae5b2b05980944af80c4ffe09cd20de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399c3c31298f41dbb11ae1c0bc593e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:27:44 user nova-compute[73188]: DEBUG nova.compute.manager [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:27:44 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:27:44 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Creating image(s)
Aug 15 19:27:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ebc579b-f9a3-484c-8719-dfee6bbd9c97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:27:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "/opt/stack/data/nova/instances/8ebc579b-f9a3-484c-8719-dfee6bbd9c97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:27:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "/opt/stack/data/nova/instances/8ebc579b-f9a3-484c-8719-dfee6bbd9c97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:27:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:27:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.194s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:27:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:27:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:27:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:27:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.187s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:27:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/8ebc579b-f9a3-484c-8719-dfee6bbd9c97/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:27:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/8ebc579b-f9a3-484c-8719-dfee6bbd9c97/disk 1073741824" returned: 0 in 0.079s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:27:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:27:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:27:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.191s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:27:45 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ebc579b-f9a3-484c-8719-dfee6bbd9c97/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:27:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebc579b-f9a3-484c-8719-dfee6bbd9c97/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:27:45 user nova-compute[73188]: DEBUG nova.network.neutron [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Successfully created port: 02ff20dc-ceb3-4897-bad7-7984f2b26693 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:27:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebc579b-f9a3-484c-8719-dfee6bbd9c97/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:27:45 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Cannot resize image /opt/stack/data/nova/instances/8ebc579b-f9a3-484c-8719-dfee6bbd9c97/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:27:45 user nova-compute[73188]: DEBUG nova.objects.instance [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'migration_context' on Instance uuid 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:27:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:27:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Ensure instance console log exists: /opt/stack/data/nova/instances/8ebc579b-f9a3-484c-8719-dfee6bbd9c97/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:27:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:27:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:27:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:27:46 user nova-compute[73188]: DEBUG nova.network.neutron [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Successfully updated port: 02ff20dc-ceb3-4897-bad7-7984f2b26693 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:27:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "refresh_cache-8ebc579b-f9a3-484c-8719-dfee6bbd9c97" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:27:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquired lock "refresh_cache-8ebc579b-f9a3-484c-8719-dfee6bbd9c97" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:27:46 user nova-compute[73188]: DEBUG nova.network.neutron [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:27:46 user nova-compute[73188]: DEBUG nova.compute.manager [req-ba1bfe59-f0b2-48ed-8124-3be932e95d3a req-60594b1c-757f-4f94-81cf-a86b8b6e87ac service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Received event network-changed-02ff20dc-ceb3-4897-bad7-7984f2b26693 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:27:46 user nova-compute[73188]: DEBUG nova.compute.manager [req-ba1bfe59-f0b2-48ed-8124-3be932e95d3a req-60594b1c-757f-4f94-81cf-a86b8b6e87ac service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Refreshing instance network info cache due to event network-changed-02ff20dc-ceb3-4897-bad7-7984f2b26693. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:27:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ba1bfe59-f0b2-48ed-8124-3be932e95d3a req-60594b1c-757f-4f94-81cf-a86b8b6e87ac service nova] Acquiring lock "refresh_cache-8ebc579b-f9a3-484c-8719-dfee6bbd9c97" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:27:46 user nova-compute[73188]: DEBUG nova.network.neutron [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.network.neutron [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Updating instance_info_cache with network_info: [{"id": "02ff20dc-ceb3-4897-bad7-7984f2b26693", "address": "fa:16:3e:97:d9:9c", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ff20dc-ce", "ovs_interfaceid": "02ff20dc-ceb3-4897-bad7-7984f2b26693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Releasing lock "refresh_cache-8ebc579b-f9a3-484c-8719-dfee6bbd9c97" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.compute.manager [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Instance network_info: |[{"id": "02ff20dc-ceb3-4897-bad7-7984f2b26693", "address": "fa:16:3e:97:d9:9c", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ff20dc-ce", "ovs_interfaceid": "02ff20dc-ceb3-4897-bad7-7984f2b26693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ba1bfe59-f0b2-48ed-8124-3be932e95d3a req-60594b1c-757f-4f94-81cf-a86b8b6e87ac service nova] Acquired lock "refresh_cache-8ebc579b-f9a3-484c-8719-dfee6bbd9c97" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.network.neutron [req-ba1bfe59-f0b2-48ed-8124-3be932e95d3a req-60594b1c-757f-4f94-81cf-a86b8b6e87ac service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Refreshing network info cache for port 02ff20dc-ceb3-4897-bad7-7984f2b26693 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Start _get_guest_xml network_info=[{"id": "02ff20dc-ceb3-4897-bad7-7984f2b26693", "address": "fa:16:3e:97:d9:9c", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ff20dc-ce", "ovs_interfaceid": "02ff20dc-ceb3-4897-bad7-7984f2b26693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:27:47 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:27:47 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2107503239',display_name='tempest-AttachVolumeTestJSON-server-2107503239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2107503239',id=41,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCilFQzM06CpMgk2KlSWNZFq/FXZKPBdXDxnhWk/OmHtTLWOWWjTt1Rk0dMeZ3fDi2lV70snUwr9z0kIKQ7MfWng/J7D46q547830gkEg6CFBps3MDKUdp8gwQOn+e4h4w==',key_name='tempest-keypair-1920802908',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='399c3c31298f41dbb11ae1c0bc593e1f',ramdisk_id='',reservation_id='r-0seagge4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-953696987',owner_user_name='tempest-AttachVolumeTestJSON-953696987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:27:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae5b2b05980944af80c4ffe09cd20de1',uuid=8ebc579b-f9a3-484c-8719-dfee6bbd9c97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02ff20dc-ceb3-4897-bad7-7984f2b26693", "address": "fa:16:3e:97:d9:9c", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ff20dc-ce", "ovs_interfaceid": "02ff20dc-ceb3-4897-bad7-7984f2b26693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converting VIF {"id": "02ff20dc-ceb3-4897-bad7-7984f2b26693", "address": "fa:16:3e:97:d9:9c", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ff20dc-ce", "ovs_interfaceid": "02ff20dc-ceb3-4897-bad7-7984f2b26693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:d9:9c,bridge_name='br-int',has_traffic_filtering=True,id=02ff20dc-ceb3-4897-bad7-7984f2b26693,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02ff20dc-ce') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.objects.instance [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:27:47 user nova-compute[73188]:   <uuid>8ebc579b-f9a3-484c-8719-dfee6bbd9c97</uuid>
Aug 15 19:27:47 user nova-compute[73188]:   <name>instance-00000029</name>
Aug 15 19:27:47 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:27:47 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:27:47 user nova-compute[73188]:   <metadata>
Aug 15 19:27:47 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:27:47 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:27:47 user nova-compute[73188]:       <nova:name>tempest-AttachVolumeTestJSON-server-2107503239</nova:name>
Aug 15 19:27:47 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:27:47</nova:creationTime>
Aug 15 19:27:47 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:27:47 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:27:47 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:27:47 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:27:47 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:27:47 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:27:47 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:27:47 user nova-compute[73188]:       <nova:owner>
Aug 15 19:27:47 user nova-compute[73188]:         <nova:user uuid="ae5b2b05980944af80c4ffe09cd20de1">tempest-AttachVolumeTestJSON-953696987-project-member</nova:user>
Aug 15 19:27:47 user nova-compute[73188]:         <nova:project uuid="399c3c31298f41dbb11ae1c0bc593e1f">tempest-AttachVolumeTestJSON-953696987</nova:project>
Aug 15 19:27:47 user nova-compute[73188]:       </nova:owner>
Aug 15 19:27:47 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:27:47 user nova-compute[73188]:       <nova:ports>
Aug 15 19:27:47 user nova-compute[73188]:         <nova:port uuid="02ff20dc-ceb3-4897-bad7-7984f2b26693">
Aug 15 19:27:47 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 19:27:47 user nova-compute[73188]:         </nova:port>
Aug 15 19:27:47 user nova-compute[73188]:       </nova:ports>
Aug 15 19:27:47 user nova-compute[73188]:     </nova:instance>
Aug 15 19:27:47 user nova-compute[73188]:   </metadata>
Aug 15 19:27:47 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:27:47 user nova-compute[73188]:     <system>
Aug 15 19:27:47 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:27:47 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:27:47 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:27:47 user nova-compute[73188]:       <entry name="serial">8ebc579b-f9a3-484c-8719-dfee6bbd9c97</entry>
Aug 15 19:27:47 user nova-compute[73188]:       <entry name="uuid">8ebc579b-f9a3-484c-8719-dfee6bbd9c97</entry>
Aug 15 19:27:47 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:27:47 user nova-compute[73188]:     </system>
Aug 15 19:27:47 user nova-compute[73188]:   </sysinfo>
Aug 15 19:27:47 user nova-compute[73188]:   <os>
Aug 15 19:27:47 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:27:47 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:27:47 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:27:47 user nova-compute[73188]:   </os>
Aug 15 19:27:47 user nova-compute[73188]:   <features>
Aug 15 19:27:47 user nova-compute[73188]:     <acpi/>
Aug 15 19:27:47 user nova-compute[73188]:     <apic/>
Aug 15 19:27:47 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:27:47 user nova-compute[73188]:   </features>
Aug 15 19:27:47 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:27:47 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:27:47 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:27:47 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:27:47 user nova-compute[73188]:   </clock>
Aug 15 19:27:47 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:27:47 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:27:47 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:27:47 user nova-compute[73188]:   </cpu>
Aug 15 19:27:47 user nova-compute[73188]:   <devices>
Aug 15 19:27:47 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:27:47 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:27:47 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/8ebc579b-f9a3-484c-8719-dfee6bbd9c97/disk"/>
Aug 15 19:27:47 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:27:47 user nova-compute[73188]:     </disk>
Aug 15 19:27:47 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:27:47 user nova-compute[73188]:       <mac address="fa:16:3e:97:d9:9c"/>
Aug 15 19:27:47 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:27:47 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:27:47 user nova-compute[73188]:       <target dev="tap02ff20dc-ce"/>
Aug 15 19:27:47 user nova-compute[73188]:     </interface>
Aug 15 19:27:47 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:27:47 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/8ebc579b-f9a3-484c-8719-dfee6bbd9c97/console.log" append="off"/>
Aug 15 19:27:47 user nova-compute[73188]:     </serial>
Aug 15 19:27:47 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:27:47 user nova-compute[73188]:     <video>
Aug 15 19:27:47 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:27:47 user nova-compute[73188]:     </video>
Aug 15 19:27:47 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:27:47 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:27:47 user nova-compute[73188]:     </rng>
Aug 15 19:27:47 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:27:47 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:27:47 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:27:47 user nova-compute[73188]:     </memballoon>
Aug 15 19:27:47 user nova-compute[73188]:   </devices>
Aug 15 19:27:47 user nova-compute[73188]: </domain>
Aug 15 19:27:47 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2107503239',display_name='tempest-AttachVolumeTestJSON-server-2107503239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2107503239',id=41,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCilFQzM06CpMgk2KlSWNZFq/FXZKPBdXDxnhWk/OmHtTLWOWWjTt1Rk0dMeZ3fDi2lV70snUwr9z0kIKQ7MfWng/J7D46q547830gkEg6CFBps3MDKUdp8gwQOn+e4h4w==',key_name='tempest-keypair-1920802908',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='399c3c31298f41dbb11ae1c0bc593e1f',ramdisk_id='',reservation_id='r-0seagge4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-953696987',owner_user_name='tempest-AttachVolumeTestJSON-953696987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:27:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae5b2b05980944af80c4ffe09cd20de1',uuid=8ebc579b-f9a3-484c-8719-dfee6bbd9c97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02ff20dc-ceb3-4897-bad7-7984f2b26693", "address": "fa:16:3e:97:d9:9c", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ff20dc-ce", "ovs_interfaceid": "02ff20dc-ceb3-4897-bad7-7984f2b26693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converting VIF {"id": "02ff20dc-ceb3-4897-bad7-7984f2b26693", "address": "fa:16:3e:97:d9:9c", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ff20dc-ce", "ovs_interfaceid": "02ff20dc-ceb3-4897-bad7-7984f2b26693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:d9:9c,bridge_name='br-int',has_traffic_filtering=True,id=02ff20dc-ceb3-4897-bad7-7984f2b26693,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02ff20dc-ce') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG os_vif [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:d9:9c,bridge_name='br-int',has_traffic_filtering=True,id=02ff20dc-ceb3-4897-bad7-7984f2b26693,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02ff20dc-ce') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02ff20dc-ce, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap02ff20dc-ce, col_values=(('external_ids', {'iface-id': '02ff20dc-ceb3-4897-bad7-7984f2b26693', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:d9:9c', 'vm-uuid': '8ebc579b-f9a3-484c-8719-dfee6bbd9c97'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:47 user nova-compute[73188]: INFO os_vif [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:d9:9c,bridge_name='br-int',has_traffic_filtering=True,id=02ff20dc-ceb3-4897-bad7-7984f2b26693,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02ff20dc-ce')
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] No VIF found with MAC fa:16:3e:97:d9:9c, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.network.neutron [req-ba1bfe59-f0b2-48ed-8124-3be932e95d3a req-60594b1c-757f-4f94-81cf-a86b8b6e87ac service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Updated VIF entry in instance network info cache for port 02ff20dc-ceb3-4897-bad7-7984f2b26693. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG nova.network.neutron [req-ba1bfe59-f0b2-48ed-8124-3be932e95d3a req-60594b1c-757f-4f94-81cf-a86b8b6e87ac service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Updating instance_info_cache with network_info: [{"id": "02ff20dc-ceb3-4897-bad7-7984f2b26693", "address": "fa:16:3e:97:d9:9c", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ff20dc-ce", "ovs_interfaceid": "02ff20dc-ceb3-4897-bad7-7984f2b26693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:27:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ba1bfe59-f0b2-48ed-8124-3be932e95d3a req-60594b1c-757f-4f94-81cf-a86b8b6e87ac service nova] Releasing lock "refresh_cache-8ebc579b-f9a3-484c-8719-dfee6bbd9c97" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:27:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "139ccf1c-4792-4653-9475-c61b1f9c4846" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:27:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:27:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:27:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:27:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:27:48 user nova-compute[73188]: INFO nova.compute.manager [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Terminating instance
Aug 15 19:27:48 user nova-compute[73188]: DEBUG nova.compute.manager [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:27:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:48 user nova-compute[73188]: DEBUG nova.compute.manager [req-20578c0b-2404-4170-8f90-9c3e33f3f0d4 req-c1c5cf93-1059-4177-9baa-4f6fa1e84c4c service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Received event network-vif-plugged-02ff20dc-ceb3-4897-bad7-7984f2b26693 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:27:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-20578c0b-2404-4170-8f90-9c3e33f3f0d4 req-c1c5cf93-1059-4177-9baa-4f6fa1e84c4c service nova] Acquiring lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:27:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-20578c0b-2404-4170-8f90-9c3e33f3f0d4 req-c1c5cf93-1059-4177-9baa-4f6fa1e84c4c service nova] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:27:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-20578c0b-2404-4170-8f90-9c3e33f3f0d4 req-c1c5cf93-1059-4177-9baa-4f6fa1e84c4c service nova] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:27:48 user nova-compute[73188]: DEBUG nova.compute.manager [req-20578c0b-2404-4170-8f90-9c3e33f3f0d4 req-c1c5cf93-1059-4177-9baa-4f6fa1e84c4c service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] No waiting events found dispatching network-vif-plugged-02ff20dc-ceb3-4897-bad7-7984f2b26693 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:27:48 user nova-compute[73188]: WARNING nova.compute.manager [req-20578c0b-2404-4170-8f90-9c3e33f3f0d4 req-c1c5cf93-1059-4177-9baa-4f6fa1e84c4c service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Received unexpected event network-vif-plugged-02ff20dc-ceb3-4897-bad7-7984f2b26693 for instance with vm_state building and task_state spawning.
Aug 15 19:27:48 user nova-compute[73188]: DEBUG nova.compute.manager [req-f46f62d7-c2d2-4258-98a8-0f4176519e61 req-a89eb3f2-3abe-4fdf-b941-0010ea016d6e service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received event network-vif-unplugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:27:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f46f62d7-c2d2-4258-98a8-0f4176519e61 req-a89eb3f2-3abe-4fdf-b941-0010ea016d6e service nova] Acquiring lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:27:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f46f62d7-c2d2-4258-98a8-0f4176519e61 req-a89eb3f2-3abe-4fdf-b941-0010ea016d6e service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:27:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f46f62d7-c2d2-4258-98a8-0f4176519e61 req-a89eb3f2-3abe-4fdf-b941-0010ea016d6e service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:27:48 user nova-compute[73188]: DEBUG nova.compute.manager [req-f46f62d7-c2d2-4258-98a8-0f4176519e61 req-a89eb3f2-3abe-4fdf-b941-0010ea016d6e service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] No waiting events found dispatching network-vif-unplugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:27:48 user nova-compute[73188]: DEBUG nova.compute.manager [req-f46f62d7-c2d2-4258-98a8-0f4176519e61 req-a89eb3f2-3abe-4fdf-b941-0010ea016d6e service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received event network-vif-unplugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:27:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:49 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Instance destroyed successfully.
Aug 15 19:27:49 user nova-compute[73188]: DEBUG nova.objects.instance [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lazy-loading 'resources' on Instance uuid 139ccf1c-4792-4653-9475-c61b1f9c4846 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:27:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-800852989',display_name='tempest-ServerRescueNegativeTestJSON-server-800852989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-800852989',id=18,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:15:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eeb950591a3349908b17b33c0ebca302',ramdisk_id='',reservation_id='r-p4zf3894',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-990996828',owner_user_name='tempest-ServerRescueNegativeTestJSON-990996828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:17:13Z,user_data=None,user_id='88c0edd2a58744da9497d7c5164f22a2',uuid=139ccf1c-4792-4653-9475-c61b1f9c4846,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "address": "fa:16:3e:49:14:b8", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2485f75-d3", "ovs_interfaceid": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:27:49 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converting VIF {"id": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "address": "fa:16:3e:49:14:b8", "network": {"id": "86d104a5-5d67-467a-8e97-2883bd9543b2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1671715143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeb950591a3349908b17b33c0ebca302", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2485f75-d3", "ovs_interfaceid": "b2485f75-d3d0-4b58-9246-8e8f9fd60d49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:27:49 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:14:b8,bridge_name='br-int',has_traffic_filtering=True,id=b2485f75-d3d0-4b58-9246-8e8f9fd60d49,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2485f75-d3') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:27:49 user nova-compute[73188]: DEBUG os_vif [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:14:b8,bridge_name='br-int',has_traffic_filtering=True,id=b2485f75-d3d0-4b58-9246-8e8f9fd60d49,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2485f75-d3') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:27:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2485f75-d3, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:27:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:27:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:49 user nova-compute[73188]: INFO os_vif [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:14:b8,bridge_name='br-int',has_traffic_filtering=True,id=b2485f75-d3d0-4b58-9246-8e8f9fd60d49,network=Network(86d104a5-5d67-467a-8e97-2883bd9543b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2485f75-d3')
Aug 15 19:27:49 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Deleting instance files /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846_del
Aug 15 19:27:49 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Deletion of /opt/stack/data/nova/instances/139ccf1c-4792-4653-9475-c61b1f9c4846_del complete
Aug 15 19:27:49 user nova-compute[73188]: INFO nova.compute.manager [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 15 19:27:49 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:27:49 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:27:49 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:27:49 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:27:49 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Took 0.52 seconds to deallocate network for instance.
Aug 15 19:27:49 user nova-compute[73188]: DEBUG nova.compute.manager [req-b8d0e5bf-4e5a-4cd8-b4ef-ade1217262e7 req-341f79ac-62a9-463c-83df-1c76332edf67 service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received event network-vif-deleted-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:27:49 user nova-compute[73188]: INFO nova.compute.manager [req-b8d0e5bf-4e5a-4cd8-b4ef-ade1217262e7 req-341f79ac-62a9-463c-83df-1c76332edf67 service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Neutron deleted interface b2485f75-d3d0-4b58-9246-8e8f9fd60d49; detaching it from the instance and deleting it from the info cache
Aug 15 19:27:49 user nova-compute[73188]: DEBUG nova.network.neutron [req-b8d0e5bf-4e5a-4cd8-b4ef-ade1217262e7 req-341f79ac-62a9-463c-83df-1c76332edf67 service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:27:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-b8d0e5bf-4e5a-4cd8-b4ef-ade1217262e7 req-341f79ac-62a9-463c-83df-1c76332edf67 service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Detach interface failed, port_id=b2485f75-d3d0-4b58-9246-8e8f9fd60d49, reason: Instance 139ccf1c-4792-4653-9475-c61b1f9c4846 could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:27:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:27:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:27:50 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:27:50 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:27:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:27:50 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Deleted allocations for instance 139ccf1c-4792-4653-9475-c61b1f9c4846
Aug 15 19:27:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2fd2f90d-ad60-482a-9b27-82141edea7b0 tempest-ServerRescueNegativeTestJSON-990996828 tempest-ServerRescueNegativeTestJSON-990996828-project-member] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.940s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:27:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-da25f246-6d96-4457-9c67-b1600474c86a req-f39b672d-d81e-4004-a52d-4475a0b69331 service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Received event network-vif-plugged-02ff20dc-ceb3-4897-bad7-7984f2b26693 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:27:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-da25f246-6d96-4457-9c67-b1600474c86a req-f39b672d-d81e-4004-a52d-4475a0b69331 service nova] Acquiring lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:27:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-da25f246-6d96-4457-9c67-b1600474c86a req-f39b672d-d81e-4004-a52d-4475a0b69331 service nova] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:27:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-da25f246-6d96-4457-9c67-b1600474c86a req-f39b672d-d81e-4004-a52d-4475a0b69331 service nova] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:27:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-da25f246-6d96-4457-9c67-b1600474c86a req-f39b672d-d81e-4004-a52d-4475a0b69331 service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] No waiting events found dispatching network-vif-plugged-02ff20dc-ceb3-4897-bad7-7984f2b26693 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:27:50 user nova-compute[73188]: WARNING nova.compute.manager [req-da25f246-6d96-4457-9c67-b1600474c86a req-f39b672d-d81e-4004-a52d-4475a0b69331 service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Received unexpected event network-vif-plugged-02ff20dc-ceb3-4897-bad7-7984f2b26693 for instance with vm_state building and task_state spawning.
Aug 15 19:27:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-cf7393ff-051e-4ce8-ab45-43ee708b2687 req-8ecbdb54-89b9-418c-9161-d9e62392a90d service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received event network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:27:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cf7393ff-051e-4ce8-ab45-43ee708b2687 req-8ecbdb54-89b9-418c-9161-d9e62392a90d service nova] Acquiring lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:27:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cf7393ff-051e-4ce8-ab45-43ee708b2687 req-8ecbdb54-89b9-418c-9161-d9e62392a90d service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:27:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cf7393ff-051e-4ce8-ab45-43ee708b2687 req-8ecbdb54-89b9-418c-9161-d9e62392a90d service nova] Lock "139ccf1c-4792-4653-9475-c61b1f9c4846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:27:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-cf7393ff-051e-4ce8-ab45-43ee708b2687 req-8ecbdb54-89b9-418c-9161-d9e62392a90d service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] No waiting events found dispatching network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:27:51 user nova-compute[73188]: WARNING nova.compute.manager [req-cf7393ff-051e-4ce8-ab45-43ee708b2687 req-8ecbdb54-89b9-418c-9161-d9e62392a90d service nova] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Received unexpected event network-vif-plugged-b2485f75-d3d0-4b58-9246-8e8f9fd60d49 for instance with vm_state deleted and task_state None.
Aug 15 19:27:51 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127671.0766404, 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:27:51 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] VM Resumed (Lifecycle Event)
Aug 15 19:27:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:27:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:27:51 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Instance spawned successfully.
Aug 15 19:27:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:27:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:27:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:27:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:27:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:27:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:27:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:27:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:27:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:27:51 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:27:51 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127671.0790555, 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:27:51 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] VM Started (Lifecycle Event)
Aug 15 19:27:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:27:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:27:51 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:27:51 user nova-compute[73188]: INFO nova.compute.manager [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Took 6.26 seconds to spawn the instance on the hypervisor.
Aug 15 19:27:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:27:51 user nova-compute[73188]: INFO nova.compute.manager [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Took 6.92 seconds to build instance.
Aug 15 19:27:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-841882d2-b78b-4577-a80e-7121744213b2 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.093s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:27:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:53 user nova-compute[73188]: DEBUG nova.compute.manager [req-78e52529-254b-4a72-a1a8-0241f50765f2 req-76efec2b-8009-4972-b9cf-993e65e25bd0 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Received event network-changed-0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:27:53 user nova-compute[73188]: DEBUG nova.compute.manager [req-78e52529-254b-4a72-a1a8-0241f50765f2 req-76efec2b-8009-4972-b9cf-993e65e25bd0 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Refreshing instance network info cache due to event network-changed-0338047a-ec92-4e13-8b39-95d1feedd2ba. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:27:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-78e52529-254b-4a72-a1a8-0241f50765f2 req-76efec2b-8009-4972-b9cf-993e65e25bd0 service nova] Acquiring lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:27:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-78e52529-254b-4a72-a1a8-0241f50765f2 req-76efec2b-8009-4972-b9cf-993e65e25bd0 service nova] Acquired lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:27:53 user nova-compute[73188]: DEBUG nova.network.neutron [req-78e52529-254b-4a72-a1a8-0241f50765f2 req-76efec2b-8009-4972-b9cf-993e65e25bd0 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Refreshing network info cache for port 0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:27:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:54 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127659.6762946, e0d0b28d-602f-47dd-a798-2d9c54b1a2c7 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:27:54 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] VM Stopped (Lifecycle Event)
Aug 15 19:27:54 user nova-compute[73188]: DEBUG nova.network.neutron [req-78e52529-254b-4a72-a1a8-0241f50765f2 req-76efec2b-8009-4972-b9cf-993e65e25bd0 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Updated VIF entry in instance network info cache for port 0338047a-ec92-4e13-8b39-95d1feedd2ba. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:27:54 user nova-compute[73188]: DEBUG nova.network.neutron [req-78e52529-254b-4a72-a1a8-0241f50765f2 req-76efec2b-8009-4972-b9cf-993e65e25bd0 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Updating instance_info_cache with network_info: [{"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0338047a-ec", "ovs_interfaceid": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:27:54 user nova-compute[73188]: DEBUG nova.compute.manager [None req-2441c070-e903-426d-8c1c-80b3f85e6126 None None] [instance: e0d0b28d-602f-47dd-a798-2d9c54b1a2c7] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:27:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-78e52529-254b-4a72-a1a8-0241f50765f2 req-76efec2b-8009-4972-b9cf-993e65e25bd0 service nova] Releasing lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:27:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "18846be1-6828-4182-9285-12a40ecd41b1" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:27:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "18846be1-6828-4182-9285-12a40ecd41b1" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:27:59 user nova-compute[73188]: INFO nova.compute.manager [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Shelving
Aug 15 19:27:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:27:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:00 user nova-compute[73188]: DEBUG nova.compute.manager [req-ad98acf4-ce2e-4cb4-b61a-716ac923f417 req-1592b2b2-8794-42ba-a7a4-358217889c77 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Received event network-vif-unplugged-0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:28:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ad98acf4-ce2e-4cb4-b61a-716ac923f417 req-1592b2b2-8794-42ba-a7a4-358217889c77 service nova] Acquiring lock "18846be1-6828-4182-9285-12a40ecd41b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:28:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ad98acf4-ce2e-4cb4-b61a-716ac923f417 req-1592b2b2-8794-42ba-a7a4-358217889c77 service nova] Lock "18846be1-6828-4182-9285-12a40ecd41b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:28:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ad98acf4-ce2e-4cb4-b61a-716ac923f417 req-1592b2b2-8794-42ba-a7a4-358217889c77 service nova] Lock "18846be1-6828-4182-9285-12a40ecd41b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:28:00 user nova-compute[73188]: DEBUG nova.compute.manager [req-ad98acf4-ce2e-4cb4-b61a-716ac923f417 req-1592b2b2-8794-42ba-a7a4-358217889c77 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] No waiting events found dispatching network-vif-unplugged-0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:28:00 user nova-compute[73188]: WARNING nova.compute.manager [req-ad98acf4-ce2e-4cb4-b61a-716ac923f417 req-1592b2b2-8794-42ba-a7a4-358217889c77 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Received unexpected event network-vif-unplugged-0338047a-ec92-4e13-8b39-95d1feedd2ba for instance with vm_state active and task_state shelving.
Aug 15 19:28:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:00 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Instance destroyed successfully.
Aug 15 19:28:00 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Beginning cold snapshot process
Aug 15 19:28:00 user nova-compute[73188]: DEBUG nova.privsep.utils [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73188) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 19:28:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk /opt/stack/data/nova/instances/snapshots/tmpfcnnh6lg/40cb5b90393844439cd552fbde3867bc {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:28:01 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk /opt/stack/data/nova/instances/snapshots/tmpfcnnh6lg/40cb5b90393844439cd552fbde3867bc" returned: 0 in 0.694s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:28:01 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Snapshot extracted, beginning image upload
Aug 15 19:28:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:02 user nova-compute[73188]: DEBUG nova.compute.manager [req-fca038b9-14cf-411a-a4e4-0399ee1ab59d req-9f6963d5-6df0-41af-8d28-9440f3d876b2 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Received event network-vif-plugged-0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:28:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fca038b9-14cf-411a-a4e4-0399ee1ab59d req-9f6963d5-6df0-41af-8d28-9440f3d876b2 service nova] Acquiring lock "18846be1-6828-4182-9285-12a40ecd41b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:28:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fca038b9-14cf-411a-a4e4-0399ee1ab59d req-9f6963d5-6df0-41af-8d28-9440f3d876b2 service nova] Lock "18846be1-6828-4182-9285-12a40ecd41b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:28:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fca038b9-14cf-411a-a4e4-0399ee1ab59d req-9f6963d5-6df0-41af-8d28-9440f3d876b2 service nova] Lock "18846be1-6828-4182-9285-12a40ecd41b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:28:02 user nova-compute[73188]: DEBUG nova.compute.manager [req-fca038b9-14cf-411a-a4e4-0399ee1ab59d req-9f6963d5-6df0-41af-8d28-9440f3d876b2 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] No waiting events found dispatching network-vif-plugged-0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:28:02 user nova-compute[73188]: WARNING nova.compute.manager [req-fca038b9-14cf-411a-a4e4-0399ee1ab59d req-9f6963d5-6df0-41af-8d28-9440f3d876b2 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Received unexpected event network-vif-plugged-0338047a-ec92-4e13-8b39-95d1feedd2ba for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 19:28:03 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Snapshot image upload complete
Aug 15 19:28:03 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:28:03 user nova-compute[73188]: INFO nova.compute.manager [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Shelve offloading
Aug 15 19:28:03 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Instance destroyed successfully.
Aug 15 19:28:03 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:28:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:28:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquired lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:28:03 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:28:04 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127669.284842, 139ccf1c-4792-4653-9475-c61b1f9c4846 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:28:04 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] VM Stopped (Lifecycle Event)
Aug 15 19:28:04 user nova-compute[73188]: DEBUG nova.compute.manager [None req-fd3e66f6-5248-4ac4-998f-0c011416ffbe None None] [instance: 139ccf1c-4792-4653-9475-c61b1f9c4846] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:28:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:04 user nova-compute[73188]: DEBUG nova.network.neutron [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Updating instance_info_cache with network_info: [{"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0338047a-ec", "ovs_interfaceid": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:28:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Releasing lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:28:05 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Instance destroyed successfully.
Aug 15 19:28:05 user nova-compute[73188]: DEBUG nova.objects.instance [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'resources' on Instance uuid 18846be1-6828-4182-9285-12a40ecd41b1 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:28:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-134988234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-134988234',id=39,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzhzrPYTstDFJPRT2CNxzjEcWo8QkZkkQu0rijNzdeU9mLcgs9nv11HKnQZj+hbSx336GiMjlVjxornF/lx6nVpFTcoPy+i149zVtWOmKxbXBVb/jnZeNzmGFLeJ6tPJA==',key_name='tempest-keypair-353430524',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:26:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='409362f6976b454ba96b7580b35db949',ramdisk_id='',reservation_id='r-3p2mm8lv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1675372664',owner_user_name='tempest-AttachVolumeShelveTestJSON-1675372664-project-member',shelved_at='2023-08-15T19:28:03.822715',shelved_host='user',shelved_image_id='41226e9e-dbf8-4fa9-808f-c5387982db18'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:28:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7df4b06e72a452ca1dd4643694ce570',uuid=18846be1-6828-4182-9285-12a40ecd41b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0338047a-ec", "ovs_interfaceid": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:28:05 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converting VIF {"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0338047a-ec", "ovs_interfaceid": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:28:05 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:0a:75,bridge_name='br-int',has_traffic_filtering=True,id=0338047a-ec92-4e13-8b39-95d1feedd2ba,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0338047a-ec') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:28:05 user nova-compute[73188]: DEBUG os_vif [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:0a:75,bridge_name='br-int',has_traffic_filtering=True,id=0338047a-ec92-4e13-8b39-95d1feedd2ba,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0338047a-ec') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:28:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0338047a-ec, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:28:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:05 user nova-compute[73188]: DEBUG nova.compute.manager [req-ad5caad4-d64e-4775-899b-8747425b8503 req-c1589f28-bba4-453d-b096-7555b19ddef2 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Received event network-changed-0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:28:05 user nova-compute[73188]: DEBUG nova.compute.manager [req-ad5caad4-d64e-4775-899b-8747425b8503 req-c1589f28-bba4-453d-b096-7555b19ddef2 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Refreshing instance network info cache due to event network-changed-0338047a-ec92-4e13-8b39-95d1feedd2ba. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:28:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ad5caad4-d64e-4775-899b-8747425b8503 req-c1589f28-bba4-453d-b096-7555b19ddef2 service nova] Acquiring lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:28:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ad5caad4-d64e-4775-899b-8747425b8503 req-c1589f28-bba4-453d-b096-7555b19ddef2 service nova] Acquired lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:28:05 user nova-compute[73188]: DEBUG nova.network.neutron [req-ad5caad4-d64e-4775-899b-8747425b8503 req-c1589f28-bba4-453d-b096-7555b19ddef2 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Refreshing network info cache for port 0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:28:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:28:05 user nova-compute[73188]: INFO os_vif [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:0a:75,bridge_name='br-int',has_traffic_filtering=True,id=0338047a-ec92-4e13-8b39-95d1feedd2ba,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0338047a-ec')
Aug 15 19:28:05 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Deleting instance files /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1_del
Aug 15 19:28:05 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Deletion of /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1_del complete
Aug 15 19:28:05 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Deleted allocations for instance 18846be1-6828-4182-9285-12a40ecd41b1
Aug 15 19:28:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:28:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:28:05 user nova-compute[73188]: DEBUG nova.objects.instance [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'numa_topology' on Instance uuid 18846be1-6828-4182-9285-12a40ecd41b1 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:28:05 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:28:05 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:28:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:28:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b6bdda85-1148-4e10-828d-11dc99ff66ce tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "18846be1-6828-4182-9285-12a40ecd41b1" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.910s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:28:05 user nova-compute[73188]: DEBUG nova.network.neutron [req-ad5caad4-d64e-4775-899b-8747425b8503 req-c1589f28-bba4-453d-b096-7555b19ddef2 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Updated VIF entry in instance network info cache for port 0338047a-ec92-4e13-8b39-95d1feedd2ba. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:28:05 user nova-compute[73188]: DEBUG nova.network.neutron [req-ad5caad4-d64e-4775-899b-8747425b8503 req-c1589f28-bba4-453d-b096-7555b19ddef2 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Updating instance_info_cache with network_info: [{"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0338047a-ec", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:28:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ad5caad4-d64e-4775-899b-8747425b8503 req-c1589f28-bba4-453d-b096-7555b19ddef2 service nova] Releasing lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:28:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:15 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127680.5496318, 18846be1-6828-4182-9285-12a40ecd41b1 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:28:15 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] VM Stopped (Lifecycle Event)
Aug 15 19:28:15 user nova-compute[73188]: DEBUG nova.compute.manager [None req-cde5c1e1-780f-4920-a26c-906807718cef None None] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:28:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:19 user nova-compute[73188]: DEBUG nova.compute.manager [req-aa63baf1-fd14-4aca-9888-d3bc7b6c5993 req-bf3965ac-7242-44bd-939b-2cd5207e5797 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Received event network-changed-e7f8d41f-86d5-48b7-bba5-eab023fadb26 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:28:19 user nova-compute[73188]: DEBUG nova.compute.manager [req-aa63baf1-fd14-4aca-9888-d3bc7b6c5993 req-bf3965ac-7242-44bd-939b-2cd5207e5797 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Refreshing instance network info cache due to event network-changed-e7f8d41f-86d5-48b7-bba5-eab023fadb26. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:28:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-aa63baf1-fd14-4aca-9888-d3bc7b6c5993 req-bf3965ac-7242-44bd-939b-2cd5207e5797 service nova] Acquiring lock "refresh_cache-d780864e-d471-4a9a-94e2-3ebd9cb08fe2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:28:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-aa63baf1-fd14-4aca-9888-d3bc7b6c5993 req-bf3965ac-7242-44bd-939b-2cd5207e5797 service nova] Acquired lock "refresh_cache-d780864e-d471-4a9a-94e2-3ebd9cb08fe2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:28:19 user nova-compute[73188]: DEBUG nova.network.neutron [req-aa63baf1-fd14-4aca-9888-d3bc7b6c5993 req-bf3965ac-7242-44bd-939b-2cd5207e5797 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Refreshing network info cache for port e7f8d41f-86d5-48b7-bba5-eab023fadb26 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:28:19 user nova-compute[73188]: DEBUG nova.network.neutron [req-aa63baf1-fd14-4aca-9888-d3bc7b6c5993 req-bf3965ac-7242-44bd-939b-2cd5207e5797 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Updated VIF entry in instance network info cache for port e7f8d41f-86d5-48b7-bba5-eab023fadb26. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:28:19 user nova-compute[73188]: DEBUG nova.network.neutron [req-aa63baf1-fd14-4aca-9888-d3bc7b6c5993 req-bf3965ac-7242-44bd-939b-2cd5207e5797 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Updating instance_info_cache with network_info: [{"id": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "address": "fa:16:3e:90:71:53", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f8d41f-86", "ovs_interfaceid": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:28:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-aa63baf1-fd14-4aca-9888-d3bc7b6c5993 req-bf3965ac-7242-44bd-939b-2cd5207e5797 service nova] Releasing lock "refresh_cache-d780864e-d471-4a9a-94e2-3ebd9cb08fe2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:28:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:24 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:28:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:29 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:28:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:30 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:28:30 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "b49fafcb-d4b4-460f-a751-60d230ce0c89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "b49fafcb-d4b4-460f-a751-60d230ce0c89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:28:32 user nova-compute[73188]: INFO nova.compute.claims [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Claim successful on node user
Aug 15 19:28:32 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Skipping network cache update for instance because it has been migrated to another host. {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-d780864e-d471-4a9a-94e2-3ebd9cb08fe2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-d780864e-d471-4a9a-94e2-3ebd9cb08fe2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:28:32 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:28:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:28:32 user nova-compute[73188]: INFO nova.virt.block_device [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Booting with volume 33e631c0-41a5-41e3-aca6-3d8051da4645 at /dev/vda
Aug 15 19:28:32 user nova-compute[73188]: DEBUG nova.policy [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9503705066e5402cb569fae3b2bd8976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18eadba32f4547ad9436aca9285b7aad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG os_brick.utils [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[86de3822-19cb-42ba-ae51-cfa70b3ba4ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[82523c91-c0d8-48df-bfb8-a889c2149fb2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe86e28-5ebc-4aea-8df0-3b958f16fc74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca1a6ac-8819-4d94-9f2a-809be3a7790c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:28:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:28:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:28:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:28:33 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:28:33 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[601f5bb5-849b-4863-b4c6-92bb996e9049]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:28:33 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:28:33 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:28:33 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:28:33 user nova-compute[73188]: DEBUG os_brick.utils [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:28:33 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Updating existing volume attachment record: 6617db11-efad-45fe-86ba-f35884c9136e {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:28:33 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Updating instance_info_cache with network_info: [{"id": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "address": "fa:16:3e:90:71:53", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f8d41f-86", "ovs_interfaceid": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:28:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-d780864e-d471-4a9a-94e2-3ebd9cb08fe2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:28:33 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:28:33 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:28:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:28:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:28:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:28:33 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:28:33 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Successfully created port: 54a60d6b-ebf5-4ec3-a140-430617af354b {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:28:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:28:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:28:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:28:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:28:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:28:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebc579b-f9a3-484c-8719-dfee6bbd9c97/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:28:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebc579b-f9a3-484c-8719-dfee6bbd9c97/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:28:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebc579b-f9a3-484c-8719-dfee6bbd9c97/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:28:34 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Successfully updated port: 54a60d6b-ebf5-4ec3-a140-430617af354b {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:28:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "refresh_cache-b49fafcb-d4b4-460f-a751-60d230ce0c89" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:28:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquired lock "refresh_cache-b49fafcb-d4b4-460f-a751-60d230ce0c89" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:28:34 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:28:34 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8d9795e-2661-4476-b1cf-49942c9b7ce4 req-48447a56-a46e-40bc-8bb6-3eb8ece2e253 service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Received event network-changed-54a60d6b-ebf5-4ec3-a140-430617af354b {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:28:34 user nova-compute[73188]: DEBUG nova.compute.manager [req-f8d9795e-2661-4476-b1cf-49942c9b7ce4 req-48447a56-a46e-40bc-8bb6-3eb8ece2e253 service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Refreshing instance network info cache due to event network-changed-54a60d6b-ebf5-4ec3-a140-430617af354b. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:28:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8d9795e-2661-4476-b1cf-49942c9b7ce4 req-48447a56-a46e-40bc-8bb6-3eb8ece2e253 service nova] Acquiring lock "refresh_cache-b49fafcb-d4b4-460f-a751-60d230ce0c89" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:28:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebc579b-f9a3-484c-8719-dfee6bbd9c97/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:28:34 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:28:34 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:28:34 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:28:34 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8342MB free_disk=25.329044342041016GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:28:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:28:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e00adf53-085f-436d-a09f-e97e92ca79cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance d780864e-d471-4a9a-94e2-3ebd9cb08fe2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance b49fafcb-d4b4-460f-a751-60d230ce0c89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Updating instance_info_cache with network_info: [{"id": "54a60d6b-ebf5-4ec3-a140-430617af354b", "address": "fa:16:3e:3f:92:09", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a60d6b-eb", "ovs_interfaceid": "54a60d6b-ebf5-4ec3-a140-430617af354b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Releasing lock "refresh_cache-b49fafcb-d4b4-460f-a751-60d230ce0c89" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Instance network_info: |[{"id": "54a60d6b-ebf5-4ec3-a140-430617af354b", "address": "fa:16:3e:3f:92:09", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a60d6b-eb", "ovs_interfaceid": "54a60d6b-ebf5-4ec3-a140-430617af354b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8d9795e-2661-4476-b1cf-49942c9b7ce4 req-48447a56-a46e-40bc-8bb6-3eb8ece2e253 service nova] Acquired lock "refresh_cache-b49fafcb-d4b4-460f-a751-60d230ce0c89" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG nova.network.neutron [req-f8d9795e-2661-4476-b1cf-49942c9b7ce4 req-48447a56-a46e-40bc-8bb6-3eb8ece2e253 service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Refreshing network info cache for port 54a60d6b-ebf5-4ec3-a140-430617af354b {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG nova.network.neutron [req-f8d9795e-2661-4476-b1cf-49942c9b7ce4 req-48447a56-a46e-40bc-8bb6-3eb8ece2e253 service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Updated VIF entry in instance network info cache for port 54a60d6b-ebf5-4ec3-a140-430617af354b. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG nova.network.neutron [req-f8d9795e-2661-4476-b1cf-49942c9b7ce4 req-48447a56-a46e-40bc-8bb6-3eb8ece2e253 service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Updating instance_info_cache with network_info: [{"id": "54a60d6b-ebf5-4ec3-a140-430617af354b", "address": "fa:16:3e:3f:92:09", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a60d6b-eb", "ovs_interfaceid": "54a60d6b-ebf5-4ec3-a140-430617af354b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f8d9795e-2661-4476-b1cf-49942c9b7ce4 req-48447a56-a46e-40bc-8bb6-3eb8ece2e253 service nova] Releasing lock "refresh_cache-b49fafcb-d4b4-460f-a751-60d230ce0c89" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "e00adf53-085f-436d-a09f-e97e92ca79cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "e00adf53-085f-436d-a09f-e97e92ca79cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "e00adf53-085f-436d-a09f-e97e92ca79cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "e00adf53-085f-436d-a09f-e97e92ca79cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:28:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "e00adf53-085f-436d-a09f-e97e92ca79cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:28:35 user nova-compute[73188]: INFO nova.compute.manager [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Terminating instance
Aug 15 19:28:35 user nova-compute[73188]: DEBUG nova.compute.manager [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG nova.compute.manager [req-f782d18d-968f-472f-a8ba-0a325d094470 req-ec9171a5-4f94-4ca6-a0cc-2b9ddc32f72f service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Received event network-vif-unplugged-4646dbfd-e829-4653-9e76-e34901f8ad33 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f782d18d-968f-472f-a8ba-0a325d094470 req-ec9171a5-4f94-4ca6-a0cc-2b9ddc32f72f service nova] Acquiring lock "e00adf53-085f-436d-a09f-e97e92ca79cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f782d18d-968f-472f-a8ba-0a325d094470 req-ec9171a5-4f94-4ca6-a0cc-2b9ddc32f72f service nova] Lock "e00adf53-085f-436d-a09f-e97e92ca79cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f782d18d-968f-472f-a8ba-0a325d094470 req-ec9171a5-4f94-4ca6-a0cc-2b9ddc32f72f service nova] Lock "e00adf53-085f-436d-a09f-e97e92ca79cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG nova.compute.manager [req-f782d18d-968f-472f-a8ba-0a325d094470 req-ec9171a5-4f94-4ca6-a0cc-2b9ddc32f72f service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] No waiting events found dispatching network-vif-unplugged-4646dbfd-e829-4653-9e76-e34901f8ad33 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG nova.compute.manager [req-f782d18d-968f-472f-a8ba-0a325d094470 req-ec9171a5-4f94-4ca6-a0cc-2b9ddc32f72f service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Received event network-vif-unplugged-4646dbfd-e829-4653-9e76-e34901f8ad33 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:28:36 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Instance destroyed successfully.
Aug 15 19:28:36 user nova-compute[73188]: DEBUG nova.objects.instance [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lazy-loading 'resources' on Instance uuid e00adf53-085f-436d-a09f-e97e92ca79cd {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-781006402',display_name='tempest-ServerActionsTestOtherA-server-781006402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-781006402',id=16,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIh7IYSXIzW76yUh0lcXYRIDkLihwOuaxeqKxDoqlHxog01X1wGWUVb+WSkm+7EoRfQvo2EKI4l4BqBnCc2BP7hJFNq/yIn4BoRVp0zONEwe3FPB6tn+4jOCYVx7bU/R3g==',key_name='tempest-keypair-1497630278',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:09:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3c085a0ccf841e297d98037c07a7111',ramdisk_id='',reservation_id='r-fh9zf6pp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2026424764',owner_user_name='tempest-ServerActionsTestOtherA-2026424764-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:09:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30de55a2834422c8f6df816899b881e',uuid=e00adf53-085f-436d-a09f-e97e92ca79cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4646dbfd-e829-4653-9e76-e34901f8ad33", "address": "fa:16:3e:db:be:12", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4646dbfd-e8", "ovs_interfaceid": "4646dbfd-e829-4653-9e76-e34901f8ad33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converting VIF {"id": "4646dbfd-e829-4653-9e76-e34901f8ad33", "address": "fa:16:3e:db:be:12", "network": {"id": "2cfe9cb3-fe7c-4447-a285-afcf5b91d808", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473389578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c085a0ccf841e297d98037c07a7111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4646dbfd-e8", "ovs_interfaceid": "4646dbfd-e829-4653-9e76-e34901f8ad33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:be:12,bridge_name='br-int',has_traffic_filtering=True,id=4646dbfd-e829-4653-9e76-e34901f8ad33,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4646dbfd-e8') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG os_vif [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:be:12,bridge_name='br-int',has_traffic_filtering=True,id=4646dbfd-e829-4653-9e76-e34901f8ad33,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4646dbfd-e8') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4646dbfd-e8, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:28:36 user nova-compute[73188]: INFO os_vif [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:be:12,bridge_name='br-int',has_traffic_filtering=True,id=4646dbfd-e829-4653-9e76-e34901f8ad33,network=Network(2cfe9cb3-fe7c-4447-a285-afcf5b91d808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4646dbfd-e8')
Aug 15 19:28:36 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Deleting instance files /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd_del
Aug 15 19:28:36 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Deletion of /opt/stack/data/nova/instances/e00adf53-085f-436d-a09f-e97e92ca79cd_del complete
Aug 15 19:28:36 user nova-compute[73188]: INFO nova.compute.manager [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 15 19:28:36 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:28:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:37 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:28:37 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Took 0.89 seconds to deallocate network for instance.
Aug 15 19:28:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:28:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:28:38 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:28:38 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:28:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:28:38 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Deleted allocations for instance e00adf53-085f-436d-a09f-e97e92ca79cd
Aug 15 19:28:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-26f48ef3-3375-4490-b817-167a8ec0ae70 tempest-ServerActionsTestOtherA-2026424764 tempest-ServerActionsTestOtherA-2026424764-project-member] Lock "e00adf53-085f-436d-a09f-e97e92ca79cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.279s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:28:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-b701d966-69d5-4cea-b9c4-ff3da1d5c7d7 req-d4ceda1a-88b4-4f9b-989e-3a5425123d53 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Received event network-vif-plugged-4646dbfd-e829-4653-9e76-e34901f8ad33 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:28:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b701d966-69d5-4cea-b9c4-ff3da1d5c7d7 req-d4ceda1a-88b4-4f9b-989e-3a5425123d53 service nova] Acquiring lock "e00adf53-085f-436d-a09f-e97e92ca79cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:28:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b701d966-69d5-4cea-b9c4-ff3da1d5c7d7 req-d4ceda1a-88b4-4f9b-989e-3a5425123d53 service nova] Lock "e00adf53-085f-436d-a09f-e97e92ca79cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:28:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b701d966-69d5-4cea-b9c4-ff3da1d5c7d7 req-d4ceda1a-88b4-4f9b-989e-3a5425123d53 service nova] Lock "e00adf53-085f-436d-a09f-e97e92ca79cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:28:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-b701d966-69d5-4cea-b9c4-ff3da1d5c7d7 req-d4ceda1a-88b4-4f9b-989e-3a5425123d53 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] No waiting events found dispatching network-vif-plugged-4646dbfd-e829-4653-9e76-e34901f8ad33 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:28:38 user nova-compute[73188]: WARNING nova.compute.manager [req-b701d966-69d5-4cea-b9c4-ff3da1d5c7d7 req-d4ceda1a-88b4-4f9b-989e-3a5425123d53 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Received unexpected event network-vif-plugged-4646dbfd-e829-4653-9e76-e34901f8ad33 for instance with vm_state deleted and task_state None.
Aug 15 19:28:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-b701d966-69d5-4cea-b9c4-ff3da1d5c7d7 req-d4ceda1a-88b4-4f9b-989e-3a5425123d53 service nova] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Received event network-vif-deleted-4646dbfd-e829-4653-9e76-e34901f8ad33 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:28:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:28:42 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Creating image(s)
Aug 15 19:28:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Did not create local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Ensure instance console log exists: /opt/stack/data/nova/instances/b49fafcb-d4b4-460f-a751-60d230ce0c89/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Start _get_guest_xml network_info=[{"id": "54a60d6b-ebf5-4ec3-a140-430617af354b", "address": "fa:16:3e:3f:92:09", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a60d6b-eb", "ovs_interfaceid": "54a60d6b-ebf5-4ec3-a140-430617af354b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZqgXyUri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b49fafcb-d4b4-460f-a751-60d230ce0c89', 'attached_at': '', 'detached_at': '', 'volume_id': '33e631c0-41a5-41e3-aca6-3d8051da4645', 'serial': '33e631c0-41a5-41e3-aca6-3d8051da4645'}, 'attachment_id': '6617db11-efad-45fe-86ba-f35884c9136e', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:28:42 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:28:42 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:28:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZqgXyUri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:28:42 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:28:42 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:28:42 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae53f67-8323-4cde-a030-ed4bd0ac8725]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:28:42 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c9e5cd-261e-4c9b-893b-85ab86f9ed33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645] added
Aug 15 19:28:42 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9a70f7-2db5-434d-85fe-d0f2dc8c75ef]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd18fff-bbd7-43c4-8bc4-65450fff082e]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZqgXyUri {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZqgXyUri" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b213b79b-c9f4-4402-b73b-e07df870aafc]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZqgXyUri'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[38242ebe-7e28-41fe-9b67-3eaf2b3a3ff3]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abffa5f-0b18-442e-b208-0d768e9a3a04]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:28:42 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:28:42 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a590242a-58b7-4b30-a71d-0d305cbb8a8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645, portal: 172.16.0.220,3260]
Aug 15 19:28:42 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645, portal: 172.16.0.220,3260] successful.
Aug 15 19:28:42 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[53719071-dbd1-474b-8cfa-2d668de53d2e]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e249dc1-1a6e-4a9e-8ba2-3dddd706f49e]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:28:42 user nova-compute[73188]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)
Aug 15 19:28:42 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:28:42 user nova-compute[73188]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)
Aug 15 19:28:42 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae705b2-6644-4a1e-b435-53e7181289d5]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:28:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZqgXyUri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:28:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:28:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26437656462666232', 'path': '/dev/sdc'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:28:43 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437656462666232', 'path': '/dev/sdc'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:28:43 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1136787592',display_name='tempest-TestVolumeBootPattern-server-1136787592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1136787592',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdjONelCosej3I/pGPD4UfCZO2hIpepMykeX7dOlXZGpPLQP0eHCaELWxQF5jeHsky1dPgp1Jk+Jsu/dHFRA3/Yz5MW9r+VfrqEngMakotyTy6CftX4lIdZFQ2vRevOkg==',key_name='tempest-TestVolumeBootPattern-1653977396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18eadba32f4547ad9436aca9285b7aad',ramdisk_id='',reservation_id='r-wapq9ehm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2114363476',owner_user_name='tempest-TestVolumeBootPattern-2114363476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:28:33Z,user_data=None,user_id='9503705066e5402cb569fae3b2bd8976',uuid=b49fafcb-d4b4-460f-a751-60d230ce0c89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54a60d6b-ebf5-4ec3-a140-430617af354b", "address": "fa:16:3e:3f:92:09", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a60d6b-eb", "ovs_interfaceid": "54a60d6b-ebf5-4ec3-a140-430617af354b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:28:43 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converting VIF {"id": "54a60d6b-ebf5-4ec3-a140-430617af354b", "address": "fa:16:3e:3f:92:09", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a60d6b-eb", "ovs_interfaceid": "54a60d6b-ebf5-4ec3-a140-430617af354b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:28:43 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:92:09,bridge_name='br-int',has_traffic_filtering=True,id=54a60d6b-ebf5-4ec3-a140-430617af354b,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a60d6b-eb') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:28:43 user nova-compute[73188]: DEBUG nova.objects.instance [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lazy-loading 'pci_devices' on Instance uuid b49fafcb-d4b4-460f-a751-60d230ce0c89 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:28:43 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:28:43 user nova-compute[73188]:   <uuid>b49fafcb-d4b4-460f-a751-60d230ce0c89</uuid>
Aug 15 19:28:43 user nova-compute[73188]:   <name>instance-0000002a</name>
Aug 15 19:28:43 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:28:43 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:28:43 user nova-compute[73188]:   <metadata>
Aug 15 19:28:43 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:28:43 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:28:43 user nova-compute[73188]:       <nova:name>tempest-TestVolumeBootPattern-server-1136787592</nova:name>
Aug 15 19:28:43 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:28:42</nova:creationTime>
Aug 15 19:28:43 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:28:43 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:28:43 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:28:43 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:28:43 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:28:43 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:28:43 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:28:43 user nova-compute[73188]:       <nova:owner>
Aug 15 19:28:43 user nova-compute[73188]:         <nova:user uuid="9503705066e5402cb569fae3b2bd8976">tempest-TestVolumeBootPattern-2114363476-project-member</nova:user>
Aug 15 19:28:43 user nova-compute[73188]:         <nova:project uuid="18eadba32f4547ad9436aca9285b7aad">tempest-TestVolumeBootPattern-2114363476</nova:project>
Aug 15 19:28:43 user nova-compute[73188]:       </nova:owner>
Aug 15 19:28:43 user nova-compute[73188]:       <nova:ports>
Aug 15 19:28:43 user nova-compute[73188]:         <nova:port uuid="54a60d6b-ebf5-4ec3-a140-430617af354b">
Aug 15 19:28:43 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 19:28:43 user nova-compute[73188]:         </nova:port>
Aug 15 19:28:43 user nova-compute[73188]:       </nova:ports>
Aug 15 19:28:43 user nova-compute[73188]:     </nova:instance>
Aug 15 19:28:43 user nova-compute[73188]:   </metadata>
Aug 15 19:28:43 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:28:43 user nova-compute[73188]:     <system>
Aug 15 19:28:43 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:28:43 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:28:43 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:28:43 user nova-compute[73188]:       <entry name="serial">b49fafcb-d4b4-460f-a751-60d230ce0c89</entry>
Aug 15 19:28:43 user nova-compute[73188]:       <entry name="uuid">b49fafcb-d4b4-460f-a751-60d230ce0c89</entry>
Aug 15 19:28:43 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:28:43 user nova-compute[73188]:     </system>
Aug 15 19:28:43 user nova-compute[73188]:   </sysinfo>
Aug 15 19:28:43 user nova-compute[73188]:   <os>
Aug 15 19:28:43 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:28:43 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:28:43 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:28:43 user nova-compute[73188]:   </os>
Aug 15 19:28:43 user nova-compute[73188]:   <features>
Aug 15 19:28:43 user nova-compute[73188]:     <acpi/>
Aug 15 19:28:43 user nova-compute[73188]:     <apic/>
Aug 15 19:28:43 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:28:43 user nova-compute[73188]:   </features>
Aug 15 19:28:43 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:28:43 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:28:43 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:28:43 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:28:43 user nova-compute[73188]:   </clock>
Aug 15 19:28:43 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:28:43 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:28:43 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:28:43 user nova-compute[73188]:   </cpu>
Aug 15 19:28:43 user nova-compute[73188]:   <devices>
Aug 15 19:28:43 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:28:43 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:28:43 user nova-compute[73188]:       <source dev="/dev/sdc"/>
Aug 15 19:28:43 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:28:43 user nova-compute[73188]:       <serial>33e631c0-41a5-41e3-aca6-3d8051da4645</serial>
Aug 15 19:28:43 user nova-compute[73188]:     </disk>
Aug 15 19:28:43 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:28:43 user nova-compute[73188]:       <mac address="fa:16:3e:3f:92:09"/>
Aug 15 19:28:43 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:28:43 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:28:43 user nova-compute[73188]:       <target dev="tap54a60d6b-eb"/>
Aug 15 19:28:43 user nova-compute[73188]:     </interface>
Aug 15 19:28:43 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:28:43 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/b49fafcb-d4b4-460f-a751-60d230ce0c89/console.log" append="off"/>
Aug 15 19:28:43 user nova-compute[73188]:     </serial>
Aug 15 19:28:43 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:28:43 user nova-compute[73188]:     <video>
Aug 15 19:28:43 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:28:43 user nova-compute[73188]:     </video>
Aug 15 19:28:43 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:28:43 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:28:43 user nova-compute[73188]:     </rng>
Aug 15 19:28:43 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:28:43 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:28:43 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:28:43 user nova-compute[73188]:     </memballoon>
Aug 15 19:28:43 user nova-compute[73188]:   </devices>
Aug 15 19:28:43 user nova-compute[73188]: </domain>
Aug 15 19:28:43 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:28:43 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1136787592',display_name='tempest-TestVolumeBootPattern-server-1136787592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1136787592',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdjONelCosej3I/pGPD4UfCZO2hIpepMykeX7dOlXZGpPLQP0eHCaELWxQF5jeHsky1dPgp1Jk+Jsu/dHFRA3/Yz5MW9r+VfrqEngMakotyTy6CftX4lIdZFQ2vRevOkg==',key_name='tempest-TestVolumeBootPattern-1653977396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18eadba32f4547ad9436aca9285b7aad',ramdisk_id='',reservation_id='r-wapq9ehm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2114363476',owner_user_name='tempest-TestVolumeBootPattern-2114363476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:28:33Z,user_data=None,user_id='9503705066e5402cb569fae3b2bd8976',uuid=b49fafcb-d4b4-460f-a751-60d230ce0c89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54a60d6b-ebf5-4ec3-a140-430617af354b", "address": "fa:16:3e:3f:92:09", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a60d6b-eb", "ovs_interfaceid": "54a60d6b-ebf5-4ec3-a140-430617af354b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:28:43 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converting VIF {"id": "54a60d6b-ebf5-4ec3-a140-430617af354b", "address": "fa:16:3e:3f:92:09", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a60d6b-eb", "ovs_interfaceid": "54a60d6b-ebf5-4ec3-a140-430617af354b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:28:43 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:92:09,bridge_name='br-int',has_traffic_filtering=True,id=54a60d6b-ebf5-4ec3-a140-430617af354b,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a60d6b-eb') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:28:43 user nova-compute[73188]: DEBUG os_vif [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:92:09,bridge_name='br-int',has_traffic_filtering=True,id=54a60d6b-ebf5-4ec3-a140-430617af354b,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a60d6b-eb') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:28:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:28:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:28:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54a60d6b-eb, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:28:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap54a60d6b-eb, col_values=(('external_ids', {'iface-id': '54a60d6b-ebf5-4ec3-a140-430617af354b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:92:09', 'vm-uuid': 'b49fafcb-d4b4-460f-a751-60d230ce0c89'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:28:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:28:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:43 user nova-compute[73188]: INFO os_vif [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:92:09,bridge_name='br-int',has_traffic_filtering=True,id=54a60d6b-ebf5-4ec3-a140-430617af354b,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a60d6b-eb')
Aug 15 19:28:43 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:28:43 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] No VIF found with MAC fa:16:3e:3f:92:09, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:28:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:45 user nova-compute[73188]: DEBUG nova.compute.manager [req-cfd8ce2a-7782-41fb-83a8-4d5cbc1ad9d3 req-dfb5aafe-06f0-453f-8622-36c69b704c7b service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Received event network-vif-plugged-54a60d6b-ebf5-4ec3-a140-430617af354b {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:28:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cfd8ce2a-7782-41fb-83a8-4d5cbc1ad9d3 req-dfb5aafe-06f0-453f-8622-36c69b704c7b service nova] Acquiring lock "b49fafcb-d4b4-460f-a751-60d230ce0c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:28:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cfd8ce2a-7782-41fb-83a8-4d5cbc1ad9d3 req-dfb5aafe-06f0-453f-8622-36c69b704c7b service nova] Lock "b49fafcb-d4b4-460f-a751-60d230ce0c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:28:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cfd8ce2a-7782-41fb-83a8-4d5cbc1ad9d3 req-dfb5aafe-06f0-453f-8622-36c69b704c7b service nova] Lock "b49fafcb-d4b4-460f-a751-60d230ce0c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:28:45 user nova-compute[73188]: DEBUG nova.compute.manager [req-cfd8ce2a-7782-41fb-83a8-4d5cbc1ad9d3 req-dfb5aafe-06f0-453f-8622-36c69b704c7b service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] No waiting events found dispatching network-vif-plugged-54a60d6b-ebf5-4ec3-a140-430617af354b {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:28:45 user nova-compute[73188]: WARNING nova.compute.manager [req-cfd8ce2a-7782-41fb-83a8-4d5cbc1ad9d3 req-dfb5aafe-06f0-453f-8622-36c69b704c7b service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Received unexpected event network-vif-plugged-54a60d6b-ebf5-4ec3-a140-430617af354b for instance with vm_state building and task_state spawning.
Aug 15 19:28:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:46 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127726.9250834, b49fafcb-d4b4-460f-a751-60d230ce0c89 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:28:46 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] VM Resumed (Lifecycle Event)
Aug 15 19:28:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:28:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:28:46 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Instance spawned successfully.
Aug 15 19:28:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:28:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:28:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:28:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:28:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:28:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:28:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:28:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:28:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:28:46 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:28:46 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127726.9269748, b49fafcb-d4b4-460f-a751-60d230ce0c89 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:28:46 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] VM Started (Lifecycle Event)
Aug 15 19:28:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:28:47 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:28:47 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:28:47 user nova-compute[73188]: INFO nova.compute.manager [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Took 4.92 seconds to spawn the instance on the hypervisor.
Aug 15 19:28:47 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:28:47 user nova-compute[73188]: DEBUG nova.compute.manager [req-a7f7def6-7390-439c-9f56-7e00fe7bef62 req-433597a7-2b82-4136-bce2-bd18e3ece8e9 service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Received event network-vif-plugged-54a60d6b-ebf5-4ec3-a140-430617af354b {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:28:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a7f7def6-7390-439c-9f56-7e00fe7bef62 req-433597a7-2b82-4136-bce2-bd18e3ece8e9 service nova] Acquiring lock "b49fafcb-d4b4-460f-a751-60d230ce0c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:28:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a7f7def6-7390-439c-9f56-7e00fe7bef62 req-433597a7-2b82-4136-bce2-bd18e3ece8e9 service nova] Lock "b49fafcb-d4b4-460f-a751-60d230ce0c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:28:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a7f7def6-7390-439c-9f56-7e00fe7bef62 req-433597a7-2b82-4136-bce2-bd18e3ece8e9 service nova] Lock "b49fafcb-d4b4-460f-a751-60d230ce0c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:28:47 user nova-compute[73188]: DEBUG nova.compute.manager [req-a7f7def6-7390-439c-9f56-7e00fe7bef62 req-433597a7-2b82-4136-bce2-bd18e3ece8e9 service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] No waiting events found dispatching network-vif-plugged-54a60d6b-ebf5-4ec3-a140-430617af354b {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:28:47 user nova-compute[73188]: WARNING nova.compute.manager [req-a7f7def6-7390-439c-9f56-7e00fe7bef62 req-433597a7-2b82-4136-bce2-bd18e3ece8e9 service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Received unexpected event network-vif-plugged-54a60d6b-ebf5-4ec3-a140-430617af354b for instance with vm_state active and task_state None.
Aug 15 19:28:47 user nova-compute[73188]: INFO nova.compute.manager [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Took 14.84 seconds to build instance.
Aug 15 19:28:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ebc3baca-db39-4794-b1f6-0a23f5586bbb tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "b49fafcb-d4b4-460f-a751-60d230ce0c89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.933s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:28:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:51 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127716.7399604, e00adf53-085f-436d-a09f-e97e92ca79cd => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:28:51 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] VM Stopped (Lifecycle Event)
Aug 15 19:28:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-d13a9faa-d81d-446a-a5e7-279c2bbfde05 None None] [instance: e00adf53-085f-436d-a09f-e97e92ca79cd] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:28:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:28:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:24 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:29:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:29:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:30 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:29:31 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:29:32 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:29:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:29:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:29:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-d780864e-d471-4a9a-94e2-3ebd9cb08fe2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:29:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-d780864e-d471-4a9a-94e2-3ebd9cb08fe2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:29:32 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:29:32 user nova-compute[73188]: DEBUG nova.objects.instance [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lazy-loading 'info_cache' on Instance uuid d780864e-d471-4a9a-94e2-3ebd9cb08fe2 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:29:33 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Updating instance_info_cache with network_info: [{"id": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "address": "fa:16:3e:90:71:53", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f8d41f-86", "ovs_interfaceid": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:29:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-d780864e-d471-4a9a-94e2-3ebd9cb08fe2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:29:33 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:29:33 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:29:33 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:29:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:29:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:29:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:29:33 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:29:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:29:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebc579b-f9a3-484c-8719-dfee6bbd9c97/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebc579b-f9a3-484c-8719-dfee6bbd9c97/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:29:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebc579b-f9a3-484c-8719-dfee6bbd9c97/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebc579b-f9a3-484c-8719-dfee6bbd9c97/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:29:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:29:34 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:29:34 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:29:34 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8395MB free_disk=25.353736877441406GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:29:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:29:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:29:34 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance d780864e-d471-4a9a-94e2-3ebd9cb08fe2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:29:34 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:29:34 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance b49fafcb-d4b4-460f-a751-60d230ce0c89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:29:34 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:29:34 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:29:34 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:29:34 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:29:34 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:29:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:29:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-9d8edcd4-217a-44c5-834f-2e04793848ae req-d95f6c7b-69df-4871-a905-5dd984e20e7e service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Received event network-changed-02ff20dc-ceb3-4897-bad7-7984f2b26693 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:29:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-9d8edcd4-217a-44c5-834f-2e04793848ae req-d95f6c7b-69df-4871-a905-5dd984e20e7e service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Refreshing instance network info cache due to event network-changed-02ff20dc-ceb3-4897-bad7-7984f2b26693. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:29:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9d8edcd4-217a-44c5-834f-2e04793848ae req-d95f6c7b-69df-4871-a905-5dd984e20e7e service nova] Acquiring lock "refresh_cache-8ebc579b-f9a3-484c-8719-dfee6bbd9c97" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:29:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9d8edcd4-217a-44c5-834f-2e04793848ae req-d95f6c7b-69df-4871-a905-5dd984e20e7e service nova] Acquired lock "refresh_cache-8ebc579b-f9a3-484c-8719-dfee6bbd9c97" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:29:35 user nova-compute[73188]: DEBUG nova.network.neutron [req-9d8edcd4-217a-44c5-834f-2e04793848ae req-d95f6c7b-69df-4871-a905-5dd984e20e7e service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Refreshing network info cache for port 02ff20dc-ceb3-4897-bad7-7984f2b26693 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:29:36 user nova-compute[73188]: DEBUG nova.network.neutron [req-9d8edcd4-217a-44c5-834f-2e04793848ae req-d95f6c7b-69df-4871-a905-5dd984e20e7e service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Updated VIF entry in instance network info cache for port 02ff20dc-ceb3-4897-bad7-7984f2b26693. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:29:36 user nova-compute[73188]: DEBUG nova.network.neutron [req-9d8edcd4-217a-44c5-834f-2e04793848ae req-d95f6c7b-69df-4871-a905-5dd984e20e7e service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Updating instance_info_cache with network_info: [{"id": "02ff20dc-ceb3-4897-bad7-7984f2b26693", "address": "fa:16:3e:97:d9:9c", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ff20dc-ce", "ovs_interfaceid": "02ff20dc-ceb3-4897-bad7-7984f2b26693", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:29:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9d8edcd4-217a-44c5-834f-2e04793848ae req-d95f6c7b-69df-4871-a905-5dd984e20e7e service nova] Releasing lock "refresh_cache-8ebc579b-f9a3-484c-8719-dfee6bbd9c97" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:29:36 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:29:36 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:29:36 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:29:36 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:29:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:37 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:29:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG nova.objects.instance [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'flavor' on Instance uuid 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:29:39 user nova-compute[73188]: INFO nova.compute.manager [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Attaching volume 99fe25e9-e29e-4f13-8662-0fd44a571c87 to /dev/vdb
Aug 15 19:29:39 user nova-compute[73188]: DEBUG os_brick.utils [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef805576-e032-4d9a-bc95-b6f8c8aeeacc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[737b00e3-2e92-456f-be19-4521e3d526dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4610cb-a434-42f7-9021-44c924afe101]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab93416a-24dd-4110-866d-50c5a2b5239f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:29:39 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:29:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ed5e95-7c4d-4dae-88d8-a3d9ef19d27b]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG os_brick.utils [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:29:39 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Updating existing volume attachment record: 5dfcf2b9-f649-4667-ab35-d5d68edbe7b6 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:29:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "18846be1-6828-4182-9285-12a40ecd41b1" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:29:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "18846be1-6828-4182-9285-12a40ecd41b1" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:29:52 user nova-compute[73188]: INFO nova.compute.manager [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Unshelving
Aug 15 19:29:52 user nova-compute[73188]: INFO nova.virt.block_device [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Booting with volume 3e7c6248-db44-4037-b40b-0523d5a9d7f9 at /dev/vdc
Aug 15 19:29:52 user nova-compute[73188]: DEBUG os_brick.utils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:29:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.038s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:29:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2254790-251b-4e6b-be61-a3f22809b20d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:29:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:29:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[591d9439-6aa4-43d5-b67c-0b85235d2801]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:29:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:29:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6050554e-444c-4ae3-91d4-0eed15759501]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:29:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7b84fe-26d8-4671-af3a-2517b49645b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:29:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:29:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:29:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:29:52 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:29:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[906b7a59-7ef6-479d-a8c2-dde79acd52ce]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:29:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:29:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:29:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:29:52 user nova-compute[73188]: DEBUG os_brick.utils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:29:52 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Updating existing volume attachment record: 8ed3d099-b123-4aa3-9f8d-11757c43a45f {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:29:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VGIeBqmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:29:56 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:29:56 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:29:56 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ba1666-8cfd-448d-a93a-0f9bb4107ec3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:29:56 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e257fe17-0590-405e-9b51-7ebcc18ce0cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87] added
Aug 15 19:29:56 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6012e674-b84e-4c99-ad30-40d8fb88b935]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a9a39f-aeda-4a3a-861d-f419c6f02313]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VGIeBqmL {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VGIeBqmL" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[25eac5c4-8311-45bf-a2ba-1677b7cc7010]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VGIeBqmL'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5907f69-76f2-452a-9b11-4946177dabc2]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee947ff7-3890-4405-acab-27489d1a391a]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:29:56 user nova-compute[73188]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)
Aug 15 19:29:56 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:29:56 user nova-compute[73188]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)
Aug 15 19:29:56 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85aedbd-eb27-4fcf-bbbc-05b67739a481]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87, portal: 172.16.0.220,3260]
Aug 15 19:29:56 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87, portal: 172.16.0.220,3260] successful.
Aug 15 19:29:56 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3780034-4e53-491c-8714-58901f0b573b]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0e7579-19be-4719-9992-dd16da496af3]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:29:56 user nova-compute[73188]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)
Aug 15 19:29:56 user nova-compute[73188]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 (non-flash)
Aug 15 19:29:56 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:29:56 user nova-compute[73188]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)
Aug 15 19:29:56 user nova-compute[73188]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 (non-flash)
Aug 15 19:29:56 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c07165-bffb-48c7-a88d-274f65653e6f]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VGIeBqmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:29:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:29:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:29:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26634633662613163', 'path': '/dev/sdd'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:29:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634633662613163', 'path': '/dev/sdd'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:29:57 user nova-compute[73188]: DEBUG nova.objects.instance [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'flavor' on Instance uuid 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:29:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:29:57 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:29:57 user nova-compute[73188]:   <source dev="/dev/sdd"/>
Aug 15 19:29:57 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:29:57 user nova-compute[73188]:   <serial>99fe25e9-e29e-4f13-8662-0fd44a571c87</serial>
Aug 15 19:29:57 user nova-compute[73188]: </disk>
Aug 15 19:29:57 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:29:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:29:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:29:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] No VIF found with MAC fa:16:3e:97:d9:9c, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:29:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-402943b7-5707-47bf-a824-fec116d65fd4 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.475s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:29:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:02 user nova-compute[73188]: DEBUG nova.objects.instance [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'flavor' on Instance uuid 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:30:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:02 user nova-compute[73188]: INFO nova.compute.manager [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Attaching volume ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb to /dev/vdc
Aug 15 19:30:03 user nova-compute[73188]: DEBUG os_brick.utils [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:30:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:03 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[07452645-c77c-47b2-995e-648c14424676]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:03 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34d4c24-9a60-4363-94a2-b82f859da752]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:03 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46d7eda-1585-4845-b821-65998c70b881]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:03 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be5f3bc-cfa7-4b3d-a13c-a05e074344ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:30:03 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:30:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:03 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:30:03 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:30:03 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[589effe0-dc09-4ea8-a0ad-b2a6ab4b499c]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:03 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:30:03 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:30:03 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:30:03 user nova-compute[73188]: DEBUG os_brick.utils [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:30:03 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Updating existing volume attachment record: 33024def-2657-40fb-8cc5-a07411439421 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:30:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:04 user nova-compute[73188]: DEBUG nova.objects.instance [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'pci_requests' on Instance uuid 18846be1-6828-4182-9285-12a40ecd41b1 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:30:04 user nova-compute[73188]: DEBUG nova.objects.instance [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'numa_topology' on Instance uuid 18846be1-6828-4182-9285-12a40ecd41b1 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:30:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:30:04 user nova-compute[73188]: INFO nova.compute.claims [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Claim successful on node user
Aug 15 19:30:04 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:30:04 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:30:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:04 user nova-compute[73188]: INFO nova.network.neutron [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Updating port 0338047a-ec92-4e13-8b39-95d1feedd2ba with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 19:30:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:30:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquired lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:30:05 user nova-compute[73188]: DEBUG nova.network.neutron [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:30:05 user nova-compute[73188]: DEBUG nova.compute.manager [req-7ba96919-bd69-4e40-9c6e-20d23d90f66d req-60bb8317-d236-4ce6-bad5-bdac72ac4d20 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Received event network-changed-0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:30:05 user nova-compute[73188]: DEBUG nova.compute.manager [req-7ba96919-bd69-4e40-9c6e-20d23d90f66d req-60bb8317-d236-4ce6-bad5-bdac72ac4d20 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Refreshing instance network info cache due to event network-changed-0338047a-ec92-4e13-8b39-95d1feedd2ba. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:30:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7ba96919-bd69-4e40-9c6e-20d23d90f66d req-60bb8317-d236-4ce6-bad5-bdac72ac4d20 service nova] Acquiring lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:30:05 user nova-compute[73188]: DEBUG nova.network.neutron [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Updating instance_info_cache with network_info: [{"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0338047a-ec", "ovs_interfaceid": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:30:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Releasing lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:30:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:30:05 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Creating image(s)
Aug 15 19:30:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "/opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "/opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "/opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:05 user nova-compute[73188]: DEBUG nova.objects.instance [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'trusted_certs' on Instance uuid 18846be1-6828-4182-9285-12a40ecd41b1 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:30:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7ba96919-bd69-4e40-9c6e-20d23d90f66d req-60bb8317-d236-4ce6-bad5-bdac72ac4d20 service nova] Acquired lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:30:05 user nova-compute[73188]: DEBUG nova.network.neutron [req-7ba96919-bd69-4e40-9c6e-20d23d90f66d req-60bb8317-d236-4ce6-bad5-bdac72ac4d20 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Refreshing network info cache for port 0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:30:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "30124c79b513114e1ceb54d1623640b83c4fb6eb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "30124c79b513114e1ceb54d1623640b83c4fb6eb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30124c79b513114e1ceb54d1623640b83c4fb6eb.part --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "c696f77d-eb36-426f-a86d-26bfca9a1918" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "c696f77d-eb36-426f-a86d-26bfca9a1918" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:07 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:30:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30124c79b513114e1ceb54d1623640b83c4fb6eb.part --force-share --output=json" returned: 0 in 0.191s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:07 user nova-compute[73188]: DEBUG nova.virt.images [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] 41226e9e-dbf8-4fa9-808f-c5387982db18 was qcow2, converting to raw {{(pid=73188) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 19:30:07 user nova-compute[73188]: DEBUG nova.privsep.utils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73188) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 19:30:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/30124c79b513114e1ceb54d1623640b83c4fb6eb.part /opt/stack/data/nova/instances/_base/30124c79b513114e1ceb54d1623640b83c4fb6eb.converted {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:07 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:30:07 user nova-compute[73188]: INFO nova.compute.claims [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Claim successful on node user
Aug 15 19:30:07 user nova-compute[73188]: DEBUG nova.network.neutron [req-7ba96919-bd69-4e40-9c6e-20d23d90f66d req-60bb8317-d236-4ce6-bad5-bdac72ac4d20 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Updated VIF entry in instance network info cache for port 0338047a-ec92-4e13-8b39-95d1feedd2ba. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:30:07 user nova-compute[73188]: DEBUG nova.network.neutron [req-7ba96919-bd69-4e40-9c6e-20d23d90f66d req-60bb8317-d236-4ce6-bad5-bdac72ac4d20 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Updating instance_info_cache with network_info: [{"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0338047a-ec", "ovs_interfaceid": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:30:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7ba96919-bd69-4e40-9c6e-20d23d90f66d req-60bb8317-d236-4ce6-bad5-bdac72ac4d20 service nova] Releasing lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/30124c79b513114e1ceb54d1623640b83c4fb6eb.part /opt/stack/data/nova/instances/_base/30124c79b513114e1ceb54d1623640b83c4fb6eb.converted" returned: 0 in 0.862s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30124c79b513114e1ceb54d1623640b83c4fb6eb.converted --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.872s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG nova.network.neutron [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:30:08 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:30:08 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30124c79b513114e1ceb54d1623640b83c4fb6eb.converted --force-share --output=json" returned: 0 in 0.208s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "30124c79b513114e1ceb54d1623640b83c4fb6eb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.543s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30124c79b513114e1ceb54d1623640b83c4fb6eb --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG nova.policy [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae2fd38dc21248609f17533079193d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffec07b2185b4bd4a14793f9885a43d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:30:08 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Creating image(s)
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "/opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "/opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "/opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30124c79b513114e1ceb54d1623640b83c4fb6eb --force-share --output=json" returned: 0 in 0.183s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "30124c79b513114e1ceb54d1623640b83c4fb6eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "30124c79b513114e1ceb54d1623640b83c4fb6eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30124c79b513114e1ceb54d1623640b83c4fb6eb --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.189s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30124c79b513114e1ceb54d1623640b83c4fb6eb --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/30124c79b513114e1ceb54d1623640b83c4fb6eb,backing_fmt=raw /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/30124c79b513114e1ceb54d1623640b83c4fb6eb,backing_fmt=raw /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk 1073741824" returned: 0 in 0.049s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "30124c79b513114e1ceb54d1623640b83c4fb6eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30124c79b513114e1ceb54d1623640b83c4fb6eb --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk 1073741824" returned: 0 in 0.065s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30124c79b513114e1ceb54d1623640b83c4fb6eb --force-share --output=json" returned: 0 in 0.206s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:09 user nova-compute[73188]: DEBUG nova.objects.instance [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'migration_context' on Instance uuid 18846be1-6828-4182-9285-12a40ecd41b1 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:30:09 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Rebasing disk image.
Aug 15 19:30:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.223s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:09 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:30:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.213s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f -F raw /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:09 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:09 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Cannot resize image /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:30:09 user nova-compute[73188]: DEBUG nova.objects.instance [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lazy-loading 'migration_context' on Instance uuid c696f77d-eb36-426f-a86d-26bfca9a1918 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:30:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:30:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Ensure instance console log exists: /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:30:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:10 user nova-compute[73188]: DEBUG nova.network.neutron [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Successfully created port: 34c74787-4e7e-4c3a-b084-7ccf460a65f8 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.network.neutron [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Successfully updated port: 34c74787-4e7e-4c3a-b084-7ccf460a65f8 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "refresh_cache-c696f77d-eb36-426f-a86d-26bfca9a1918" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquired lock "refresh_cache-c696f77d-eb36-426f-a86d-26bfca9a1918" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.network.neutron [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-ef11ea1a-008c-42df-b6e3-c753ee8e66bf req-998d0dd3-be5b-42e7-9ddd-6a52ab7276ed service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Received event network-changed-34c74787-4e7e-4c3a-b084-7ccf460a65f8 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-ef11ea1a-008c-42df-b6e3-c753ee8e66bf req-998d0dd3-be5b-42e7-9ddd-6a52ab7276ed service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Refreshing instance network info cache due to event network-changed-34c74787-4e7e-4c3a-b084-7ccf460a65f8. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ef11ea1a-008c-42df-b6e3-c753ee8e66bf req-998d0dd3-be5b-42e7-9ddd-6a52ab7276ed service nova] Acquiring lock "refresh_cache-c696f77d-eb36-426f-a86d-26bfca9a1918" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.network.neutron [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f -F raw /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk" returned: 0 in 2.485s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Ensure instance console log exists: /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.005s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Start _get_guest_xml network_info=[{"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0338047a-ec", "ovs_interfaceid": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='813bb29c493ce075f2db5ce1a4c6709c',container_format='bare',created_at=2023-08-15T19:28:00Z,direct_url=<?>,disk_format='qcow2',id=41226e9e-dbf8-4fa9-808f-c5387982db18,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-134988234-shelved',owner='409362f6976b454ba96b7580b35db949',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T19:28:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epJyXvoh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '18846be1-6828-4182-9285-12a40ecd41b1', 'attached_at': '', 'detached_at': '', 'volume_id': '3e7c6248-db44-4037-b40b-0523d5a9d7f9', 'serial': '3e7c6248-db44-4037-b40b-0523d5a9d7f9'}, 'attachment_id': '8ed3d099-b123-4aa3-9f8d-11757c43a45f', 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:30:11 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:30:11 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='813bb29c493ce075f2db5ce1a4c6709c',container_format='bare',created_at=2023-08-15T19:28:00Z,direct_url=<?>,disk_format='qcow2',id=41226e9e-dbf8-4fa9-808f-c5387982db18,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-134988234-shelved',owner='409362f6976b454ba96b7580b35db949',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T19:28:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:30:11 user nova-compute[73188]: DEBUG nova.objects.instance [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'vcpu_model' on Instance uuid 18846be1-6828-4182-9285-12a40ecd41b1 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epJyXvoh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:30:12 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:30:12 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:30:12 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.network.neutron [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Updating instance_info_cache with network_info: [{"id": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "address": "fa:16:3e:48:2b:43", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c74787-4e", "ovs_interfaceid": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 -p 172.16.0.220:3260" returned: 21 in 0.108s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfff40c3-f2c2-4332-82c8-3858c13b8a08]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:30:12 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Releasing lock "refresh_cache-c696f77d-eb36-426f-a86d-26bfca9a1918" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Instance network_info: |[{"id": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "address": "fa:16:3e:48:2b:43", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c74787-4e", "ovs_interfaceid": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ef11ea1a-008c-42df-b6e3-c753ee8e66bf req-998d0dd3-be5b-42e7-9ddd-6a52ab7276ed service nova] Acquired lock "refresh_cache-c696f77d-eb36-426f-a86d-26bfca9a1918" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.network.neutron [req-ef11ea1a-008c-42df-b6e3-c753ee8e66bf req-998d0dd3-be5b-42e7-9ddd-6a52ab7276ed service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Refreshing network info cache for port 34c74787-4e7e-4c3a-b084-7ccf460a65f8 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Start _get_guest_xml network_info=[{"id": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "address": "fa:16:3e:48:2b:43", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c74787-4e", "ovs_interfaceid": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[083b336a-cde7-4ad8-931f-dd6cb4af9e16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9] added
Aug 15 19:30:12 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:12 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:30:12 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1494379546',display_name='tempest-TestStampPattern-server-1494379546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1494379546',id=43,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPttPXTMMfrjFLW7G+VtG1rMa5FI1ksBOcYrsCtyrYTreKkrGoeDmah2iW0MvYJZ2Kgf5QUOX0XjOu9+OQOllEXo6T6FtGW/D6IrYtS7SxmNxxryUDEUap8dr1QEagH2lQ==',key_name='tempest-TestStampPattern-390215866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ffec07b2185b4bd4a14793f9885a43d0',ramdisk_id='',reservation_id='r-i1kyd8r6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1547019054',owner_user_name='tempest-TestStampPattern-1547019054-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:30:08Z,user_data=None,user_id='ae2fd38dc21248609f17533079193d2d',uuid=c696f77d-eb36-426f-a86d-26bfca9a1918,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "address": "fa:16:3e:48:2b:43", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c74787-4e", "ovs_interfaceid": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Converting VIF {"id": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "address": "fa:16:3e:48:2b:43", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c74787-4e", "ovs_interfaceid": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:2b:43,bridge_name='br-int',has_traffic_filtering=True,id=34c74787-4e7e-4c3a-b084-7ccf460a65f8,network=Network(e3f0d46e-35ab-4b09-ac9d-ee8728aa820a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34c74787-4e') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.objects.instance [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lazy-loading 'pci_devices' on Instance uuid c696f77d-eb36-426f-a86d-26bfca9a1918 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f873e8-91c8-419f-a5a4-5e797d6a2cf2]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:30:12 user nova-compute[73188]:   <uuid>c696f77d-eb36-426f-a86d-26bfca9a1918</uuid>
Aug 15 19:30:12 user nova-compute[73188]:   <name>instance-0000002b</name>
Aug 15 19:30:12 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:30:12 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:30:12 user nova-compute[73188]:   <metadata>
Aug 15 19:30:12 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:30:12 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:30:12 user nova-compute[73188]:       <nova:name>tempest-TestStampPattern-server-1494379546</nova:name>
Aug 15 19:30:12 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:30:12</nova:creationTime>
Aug 15 19:30:12 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:30:12 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:30:12 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:30:12 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:30:12 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:30:12 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:30:12 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:30:12 user nova-compute[73188]:       <nova:owner>
Aug 15 19:30:12 user nova-compute[73188]:         <nova:user uuid="ae2fd38dc21248609f17533079193d2d">tempest-TestStampPattern-1547019054-project-member</nova:user>
Aug 15 19:30:12 user nova-compute[73188]:         <nova:project uuid="ffec07b2185b4bd4a14793f9885a43d0">tempest-TestStampPattern-1547019054</nova:project>
Aug 15 19:30:12 user nova-compute[73188]:       </nova:owner>
Aug 15 19:30:12 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:30:12 user nova-compute[73188]:       <nova:ports>
Aug 15 19:30:12 user nova-compute[73188]:         <nova:port uuid="34c74787-4e7e-4c3a-b084-7ccf460a65f8">
Aug 15 19:30:12 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 19:30:12 user nova-compute[73188]:         </nova:port>
Aug 15 19:30:12 user nova-compute[73188]:       </nova:ports>
Aug 15 19:30:12 user nova-compute[73188]:     </nova:instance>
Aug 15 19:30:12 user nova-compute[73188]:   </metadata>
Aug 15 19:30:12 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:30:12 user nova-compute[73188]:     <system>
Aug 15 19:30:12 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:30:12 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:30:12 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:30:12 user nova-compute[73188]:       <entry name="serial">c696f77d-eb36-426f-a86d-26bfca9a1918</entry>
Aug 15 19:30:12 user nova-compute[73188]:       <entry name="uuid">c696f77d-eb36-426f-a86d-26bfca9a1918</entry>
Aug 15 19:30:12 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:30:12 user nova-compute[73188]:     </system>
Aug 15 19:30:12 user nova-compute[73188]:   </sysinfo>
Aug 15 19:30:12 user nova-compute[73188]:   <os>
Aug 15 19:30:12 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:30:12 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:30:12 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:30:12 user nova-compute[73188]:   </os>
Aug 15 19:30:12 user nova-compute[73188]:   <features>
Aug 15 19:30:12 user nova-compute[73188]:     <acpi/>
Aug 15 19:30:12 user nova-compute[73188]:     <apic/>
Aug 15 19:30:12 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:30:12 user nova-compute[73188]:   </features>
Aug 15 19:30:12 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:30:12 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:30:12 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:30:12 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:30:12 user nova-compute[73188]:   </clock>
Aug 15 19:30:12 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:30:12 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:30:12 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:30:12 user nova-compute[73188]:   </cpu>
Aug 15 19:30:12 user nova-compute[73188]:   <devices>
Aug 15 19:30:12 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:30:12 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:30:12 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk"/>
Aug 15 19:30:12 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:30:12 user nova-compute[73188]:     </disk>
Aug 15 19:30:12 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:30:12 user nova-compute[73188]:       <mac address="fa:16:3e:48:2b:43"/>
Aug 15 19:30:12 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:30:12 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:30:12 user nova-compute[73188]:       <target dev="tap34c74787-4e"/>
Aug 15 19:30:12 user nova-compute[73188]:     </interface>
Aug 15 19:30:12 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:30:12 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/console.log" append="off"/>
Aug 15 19:30:12 user nova-compute[73188]:     </serial>
Aug 15 19:30:12 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:30:12 user nova-compute[73188]:     <video>
Aug 15 19:30:12 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:30:12 user nova-compute[73188]:     </video>
Aug 15 19:30:12 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:30:12 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:30:12 user nova-compute[73188]:     </rng>
Aug 15 19:30:12 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:30:12 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:30:12 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:30:12 user nova-compute[73188]:     </memballoon>
Aug 15 19:30:12 user nova-compute[73188]:   </devices>
Aug 15 19:30:12 user nova-compute[73188]: </domain>
Aug 15 19:30:12 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1494379546',display_name='tempest-TestStampPattern-server-1494379546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1494379546',id=43,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPttPXTMMfrjFLW7G+VtG1rMa5FI1ksBOcYrsCtyrYTreKkrGoeDmah2iW0MvYJZ2Kgf5QUOX0XjOu9+OQOllEXo6T6FtGW/D6IrYtS7SxmNxxryUDEUap8dr1QEagH2lQ==',key_name='tempest-TestStampPattern-390215866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ffec07b2185b4bd4a14793f9885a43d0',ramdisk_id='',reservation_id='r-i1kyd8r6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1547019054',owner_user_name='tempest-TestStampPattern-1547019054-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:30:08Z,user_data=None,user_id='ae2fd38dc21248609f17533079193d2d',uuid=c696f77d-eb36-426f-a86d-26bfca9a1918,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "address": "fa:16:3e:48:2b:43", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c74787-4e", "ovs_interfaceid": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Converting VIF {"id": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "address": "fa:16:3e:48:2b:43", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c74787-4e", "ovs_interfaceid": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:2b:43,bridge_name='br-int',has_traffic_filtering=True,id=34c74787-4e7e-4c3a-b084-7ccf460a65f8,network=Network(e3f0d46e-35ab-4b09-ac9d-ee8728aa820a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34c74787-4e') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_vif [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:2b:43,bridge_name='br-int',has_traffic_filtering=True,id=34c74787-4e7e-4c3a-b084-7ccf460a65f8,network=Network(e3f0d46e-35ab-4b09-ac9d-ee8728aa820a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34c74787-4e') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[04923e13-97aa-47a5-9170-d2555408ebd2]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34c74787-4e, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap34c74787-4e, col_values=(('external_ids', {'iface-id': '34c74787-4e7e-4c3a-b084-7ccf460a65f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:2b:43', 'vm-uuid': 'c696f77d-eb36-426f-a86d-26bfca9a1918'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v epJyXvoh {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:12 user nova-compute[73188]: INFO os_vif [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:2b:43,bridge_name='br-int',has_traffic_filtering=True,id=34c74787-4e7e-4c3a-b084-7ccf460a65f8,network=Network(e3f0d46e-35ab-4b09-ac9d-ee8728aa820a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34c74787-4e')
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v epJyXvoh" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3645fc08-189d-4bb7-a269-1e7278c9611f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'epJyXvoh'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4e7f71-407c-4360-b6df-a4dc78bd1287]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] No VIF found with MAC fa:16:3e:48:2b:43, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4708c0aa-467e-4284-a3bf-5431d03ddb63]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:30:12 user nova-compute[73188]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)
Aug 15 19:30:12 user nova-compute[73188]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 (non-flash)
Aug 15 19:30:12 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:30:12 user nova-compute[73188]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)
Aug 15 19:30:12 user nova-compute[73188]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 (non-flash)
Aug 15 19:30:12 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8df2cc9-b090-414b-be76-d7557aac1ebe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9, portal: 172.16.0.220,3260]
Aug 15 19:30:12 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9, portal: 172.16.0.220,3260] successful.
Aug 15 19:30:12 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e400e88a-f3e2-4feb-afd1-6fe4d5baf504]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb3a7fb-ae94-4f3a-84a2-a2e11a20f83f]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:30:12 user nova-compute[73188]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)
Aug 15 19:30:12 user nova-compute[73188]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 (non-flash)
Aug 15 19:30:12 user nova-compute[73188]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)
Aug 15 19:30:12 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:30:12 user nova-compute[73188]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)
Aug 15 19:30:12 user nova-compute[73188]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 (non-flash)
Aug 15 19:30:12 user nova-compute[73188]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)
Aug 15 19:30:12 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.458s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[548aa9b3-3a30-4c5c-8625-4ea52b9765e6]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epJyXvoh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.network.neutron [req-ef11ea1a-008c-42df-b6e3-c753ee8e66bf req-998d0dd3-be5b-42e7-9ddd-6a52ab7276ed service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Updated VIF entry in instance network info cache for port 34c74787-4e7e-4c3a-b084-7ccf460a65f8. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG nova.network.neutron [req-ef11ea1a-008c-42df-b6e3-c753ee8e66bf req-998d0dd3-be5b-42e7-9ddd-6a52ab7276ed service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Updating instance_info_cache with network_info: [{"id": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "address": "fa:16:3e:48:2b:43", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c74787-4e", "ovs_interfaceid": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:30:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ef11ea1a-008c-42df-b6e3-c753ee8e66bf req-998d0dd3-be5b-42e7-9ddd-6a52ab7276ed service nova] Releasing lock "refresh_cache-c696f77d-eb36-426f-a86d-26bfca9a1918" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.501s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] <== connect_volume: return (1503ms) {'type': 'block', 'scsi_wwn': '23732373734303239', 'path': '/dev/sde'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732373734303239', 'path': '/dev/sde'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T19:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-134988234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-134988234',id=39,image_ref='41226e9e-dbf8-4fa9-808f-c5387982db18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-353430524',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:26:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='409362f6976b454ba96b7580b35db949',ramdisk_id='',reservation_id='r-3p2mm8lv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1675372664',owner_user_name='tempest-AttachVolumeShelveTestJSON-1675372664-project-member',shelved_at='2023-08-15T19:28:03.822715',shelved_host='user',shelved_image_id='41226e9e-dbf8-4fa9-808f-c5387982db18'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:29:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7df4b06e72a452ca1dd4643694ce570',uuid=18846be1-6828-4182-9285-12a40ecd41b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0338047a-ec", "ovs_interfaceid": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converting VIF {"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0338047a-ec", "ovs_interfaceid": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:0a:75,bridge_name='br-int',has_traffic_filtering=True,id=0338047a-ec92-4e13-8b39-95d1feedd2ba,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0338047a-ec') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG nova.objects.instance [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'pci_devices' on Instance uuid 18846be1-6828-4182-9285-12a40ecd41b1 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:30:13 user nova-compute[73188]:   <uuid>18846be1-6828-4182-9285-12a40ecd41b1</uuid>
Aug 15 19:30:13 user nova-compute[73188]:   <name>instance-00000027</name>
Aug 15 19:30:13 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:30:13 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:30:13 user nova-compute[73188]:   <metadata>
Aug 15 19:30:13 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:30:13 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:30:13 user nova-compute[73188]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-134988234</nova:name>
Aug 15 19:30:13 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:30:11</nova:creationTime>
Aug 15 19:30:13 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:30:13 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:30:13 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:30:13 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:30:13 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:30:13 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:30:13 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:30:13 user nova-compute[73188]:       <nova:owner>
Aug 15 19:30:13 user nova-compute[73188]:         <nova:user uuid="e7df4b06e72a452ca1dd4643694ce570">tempest-AttachVolumeShelveTestJSON-1675372664-project-member</nova:user>
Aug 15 19:30:13 user nova-compute[73188]:         <nova:project uuid="409362f6976b454ba96b7580b35db949">tempest-AttachVolumeShelveTestJSON-1675372664</nova:project>
Aug 15 19:30:13 user nova-compute[73188]:       </nova:owner>
Aug 15 19:30:13 user nova-compute[73188]:       <nova:root type="image" uuid="41226e9e-dbf8-4fa9-808f-c5387982db18"/>
Aug 15 19:30:13 user nova-compute[73188]:       <nova:ports>
Aug 15 19:30:13 user nova-compute[73188]:         <nova:port uuid="0338047a-ec92-4e13-8b39-95d1feedd2ba">
Aug 15 19:30:13 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 19:30:13 user nova-compute[73188]:         </nova:port>
Aug 15 19:30:13 user nova-compute[73188]:       </nova:ports>
Aug 15 19:30:13 user nova-compute[73188]:     </nova:instance>
Aug 15 19:30:13 user nova-compute[73188]:   </metadata>
Aug 15 19:30:13 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:30:13 user nova-compute[73188]:     <system>
Aug 15 19:30:13 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:30:13 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:30:13 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:30:13 user nova-compute[73188]:       <entry name="serial">18846be1-6828-4182-9285-12a40ecd41b1</entry>
Aug 15 19:30:13 user nova-compute[73188]:       <entry name="uuid">18846be1-6828-4182-9285-12a40ecd41b1</entry>
Aug 15 19:30:13 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:30:13 user nova-compute[73188]:     </system>
Aug 15 19:30:13 user nova-compute[73188]:   </sysinfo>
Aug 15 19:30:13 user nova-compute[73188]:   <os>
Aug 15 19:30:13 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:30:13 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:30:13 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:30:13 user nova-compute[73188]:   </os>
Aug 15 19:30:13 user nova-compute[73188]:   <features>
Aug 15 19:30:13 user nova-compute[73188]:     <acpi/>
Aug 15 19:30:13 user nova-compute[73188]:     <apic/>
Aug 15 19:30:13 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:30:13 user nova-compute[73188]:   </features>
Aug 15 19:30:13 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:30:13 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:30:13 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:30:13 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:30:13 user nova-compute[73188]:   </clock>
Aug 15 19:30:13 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:30:13 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:30:13 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:30:13 user nova-compute[73188]:   </cpu>
Aug 15 19:30:13 user nova-compute[73188]:   <devices>
Aug 15 19:30:13 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:30:13 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:30:13 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk"/>
Aug 15 19:30:13 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:30:13 user nova-compute[73188]:     </disk>
Aug 15 19:30:13 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:30:13 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:30:13 user nova-compute[73188]:       <source dev="/dev/sde"/>
Aug 15 19:30:13 user nova-compute[73188]:       <target dev="vdc" bus="virtio"/>
Aug 15 19:30:13 user nova-compute[73188]:       <serial>3e7c6248-db44-4037-b40b-0523d5a9d7f9</serial>
Aug 15 19:30:13 user nova-compute[73188]:     </disk>
Aug 15 19:30:13 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:30:13 user nova-compute[73188]:       <mac address="fa:16:3e:0f:0a:75"/>
Aug 15 19:30:13 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:30:13 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:30:13 user nova-compute[73188]:       <target dev="tap0338047a-ec"/>
Aug 15 19:30:13 user nova-compute[73188]:     </interface>
Aug 15 19:30:13 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:30:13 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/console.log" append="off"/>
Aug 15 19:30:13 user nova-compute[73188]:     </serial>
Aug 15 19:30:13 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:30:13 user nova-compute[73188]:     <video>
Aug 15 19:30:13 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:30:13 user nova-compute[73188]:     </video>
Aug 15 19:30:13 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:30:13 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:30:13 user nova-compute[73188]:     </rng>
Aug 15 19:30:13 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:30:13 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:30:13 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:30:13 user nova-compute[73188]:     </memballoon>
Aug 15 19:30:13 user nova-compute[73188]:   </devices>
Aug 15 19:30:13 user nova-compute[73188]: </domain>
Aug 15 19:30:13 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T19:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-134988234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-134988234',id=39,image_ref='41226e9e-dbf8-4fa9-808f-c5387982db18',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-353430524',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:26:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='409362f6976b454ba96b7580b35db949',ramdisk_id='',reservation_id='r-3p2mm8lv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1675372664',owner_user_name='tempest-AttachVolumeShelveTestJSON-1675372664-project-member',shelved_at='2023-08-15T19:28:03.822715',shelved_host='user',shelved_image_id='41226e9e-dbf8-4fa9-808f-c5387982db18'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:29:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7df4b06e72a452ca1dd4643694ce570',uuid=18846be1-6828-4182-9285-12a40ecd41b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0338047a-ec", "ovs_interfaceid": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converting VIF {"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0338047a-ec", "ovs_interfaceid": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:0a:75,bridge_name='br-int',has_traffic_filtering=True,id=0338047a-ec92-4e13-8b39-95d1feedd2ba,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0338047a-ec') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_vif [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:0a:75,bridge_name='br-int',has_traffic_filtering=True,id=0338047a-ec92-4e13-8b39-95d1feedd2ba,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0338047a-ec') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0338047a-ec, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0338047a-ec, col_values=(('external_ids', {'iface-id': '0338047a-ec92-4e13-8b39-95d1feedd2ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:0a:75', 'vm-uuid': '18846be1-6828-4182-9285-12a40ecd41b1'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:13 user nova-compute[73188]: INFO os_vif [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:0a:75,bridge_name='br-int',has_traffic_filtering=True,id=0338047a-ec92-4e13-8b39-95d1feedd2ba,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0338047a-ec')
Aug 15 19:30:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] No VIF found with MAC fa:16:3e:0f:0a:75, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdsLMrWH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:30:13 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:30:13 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:30:13 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3c9bd2-6034-4a0b-9822-b337bf1aa1f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:30:13 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1160dc3d-1698-48ab-9c67-f0239dd02623]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb] added
Aug 15 19:30:13 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff15215-85a7-423b-823e-2e1021a2e3a9]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f0bc24-850e-4166-8de8-a8c2720d754a]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DdsLMrWH {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DdsLMrWH" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e0d8d7-6b45-4ac2-a54a-be7f9ee7077f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DdsLMrWH'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a6b8c0-25fc-4f21-91d7-776820fe27c8]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[587b28a0-30e6-4e06-b099-c779a1992207]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:30:13 user nova-compute[73188]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)
Aug 15 19:30:13 user nova-compute[73188]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 (non-flash)
Aug 15 19:30:13 user nova-compute[73188]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)
Aug 15 19:30:13 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:30:13 user nova-compute[73188]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)
Aug 15 19:30:13 user nova-compute[73188]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 (non-flash)
Aug 15 19:30:13 user nova-compute[73188]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)
Aug 15 19:30:13 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG nova.compute.manager [req-01ffdcde-2575-4699-be38-95445ead4137 req-05fc0554-88d7-47ef-b117-b271c8744aa7 service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Received event network-vif-plugged-34c74787-4e7e-4c3a-b084-7ccf460a65f8 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-01ffdcde-2575-4699-be38-95445ead4137 req-05fc0554-88d7-47ef-b117-b271c8744aa7 service nova] Acquiring lock "c696f77d-eb36-426f-a86d-26bfca9a1918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-01ffdcde-2575-4699-be38-95445ead4137 req-05fc0554-88d7-47ef-b117-b271c8744aa7 service nova] Lock "c696f77d-eb36-426f-a86d-26bfca9a1918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-01ffdcde-2575-4699-be38-95445ead4137 req-05fc0554-88d7-47ef-b117-b271c8744aa7 service nova] Lock "c696f77d-eb36-426f-a86d-26bfca9a1918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG nova.compute.manager [req-01ffdcde-2575-4699-be38-95445ead4137 req-05fc0554-88d7-47ef-b117-b271c8744aa7 service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] No waiting events found dispatching network-vif-plugged-34c74787-4e7e-4c3a-b084-7ccf460a65f8 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:30:13 user nova-compute[73188]: WARNING nova.compute.manager [req-01ffdcde-2575-4699-be38-95445ead4137 req-05fc0554-88d7-47ef-b117-b271c8744aa7 service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Received unexpected event network-vif-plugged-34c74787-4e7e-4c3a-b084-7ccf460a65f8 for instance with vm_state building and task_state spawning.
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[147ddab0-75d1-4934-8fd2-63ca28c331fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb, portal: 172.16.0.220,3260]
Aug 15 19:30:13 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb, portal: 172.16.0.220,3260] successful.
Aug 15 19:30:13 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac34404-02ae-443c-ba10-c2a86e7ae42c]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cf7487-0661-43e0-825c-ea347471cd3b]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:30:13 user nova-compute[73188]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)
Aug 15 19:30:13 user nova-compute[73188]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 (non-flash)
Aug 15 19:30:13 user nova-compute[73188]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)
Aug 15 19:30:13 user nova-compute[73188]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb (non-flash)
Aug 15 19:30:13 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:30:13 user nova-compute[73188]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)
Aug 15 19:30:13 user nova-compute[73188]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 (non-flash)
Aug 15 19:30:13 user nova-compute[73188]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)
Aug 15 19:30:13 user nova-compute[73188]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb (non-flash)
Aug 15 19:30:13 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] HCTL ('37', '-', '-', 0) found on session 45 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:30:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0792a8-dbc8-4d19-a387-da63945dfa07]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:14 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Searching for a device in session 45 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:30:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdsLMrWH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:30:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:14 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26436313862616131', 'path': '/dev/sdf'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436313862616131', 'path': '/dev/sdf'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG nova.objects.instance [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'flavor' on Instance uuid 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:30:15 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:30:15 user nova-compute[73188]:   <source dev="/dev/sdf"/>
Aug 15 19:30:15 user nova-compute[73188]:   <target dev="vdc" bus="virtio"/>
Aug 15 19:30:15 user nova-compute[73188]:   <serial>ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb</serial>
Aug 15 19:30:15 user nova-compute[73188]: </disk>
Aug 15 19:30:15 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG nova.compute.manager [req-247d87cc-feff-4e67-97a7-1611cbaf2409 req-01c84b4f-8324-4444-a258-5a2966a00f5b service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Received event network-vif-plugged-0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-247d87cc-feff-4e67-97a7-1611cbaf2409 req-01c84b4f-8324-4444-a258-5a2966a00f5b service nova] Acquiring lock "18846be1-6828-4182-9285-12a40ecd41b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-247d87cc-feff-4e67-97a7-1611cbaf2409 req-01c84b4f-8324-4444-a258-5a2966a00f5b service nova] Lock "18846be1-6828-4182-9285-12a40ecd41b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-247d87cc-feff-4e67-97a7-1611cbaf2409 req-01c84b4f-8324-4444-a258-5a2966a00f5b service nova] Lock "18846be1-6828-4182-9285-12a40ecd41b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG nova.compute.manager [req-247d87cc-feff-4e67-97a7-1611cbaf2409 req-01c84b4f-8324-4444-a258-5a2966a00f5b service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] No waiting events found dispatching network-vif-plugged-0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:30:15 user nova-compute[73188]: WARNING nova.compute.manager [req-247d87cc-feff-4e67-97a7-1611cbaf2409 req-01c84b4f-8324-4444-a258-5a2966a00f5b service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Received unexpected event network-vif-plugged-0338047a-ec92-4e13-8b39-95d1feedd2ba for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 19:30:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] No VIF found with MAC fa:16:3e:97:d9:9c, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f5526ee8-32ca-4188-af66-14b7900a70e6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.901s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG nova.compute.manager [req-ed021056-6039-443c-a249-6b178ae23260 req-89ff722c-9235-4c4c-a927-64c54587f028 service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Received event network-vif-plugged-34c74787-4e7e-4c3a-b084-7ccf460a65f8 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ed021056-6039-443c-a249-6b178ae23260 req-89ff722c-9235-4c4c-a927-64c54587f028 service nova] Acquiring lock "c696f77d-eb36-426f-a86d-26bfca9a1918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ed021056-6039-443c-a249-6b178ae23260 req-89ff722c-9235-4c4c-a927-64c54587f028 service nova] Lock "c696f77d-eb36-426f-a86d-26bfca9a1918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ed021056-6039-443c-a249-6b178ae23260 req-89ff722c-9235-4c4c-a927-64c54587f028 service nova] Lock "c696f77d-eb36-426f-a86d-26bfca9a1918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:15 user nova-compute[73188]: DEBUG nova.compute.manager [req-ed021056-6039-443c-a249-6b178ae23260 req-89ff722c-9235-4c4c-a927-64c54587f028 service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] No waiting events found dispatching network-vif-plugged-34c74787-4e7e-4c3a-b084-7ccf460a65f8 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:30:15 user nova-compute[73188]: WARNING nova.compute.manager [req-ed021056-6039-443c-a249-6b178ae23260 req-89ff722c-9235-4c4c-a927-64c54587f028 service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Received unexpected event network-vif-plugged-34c74787-4e7e-4c3a-b084-7ccf460a65f8 for instance with vm_state building and task_state spawning.
Aug 15 19:30:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:17 user nova-compute[73188]: INFO nova.compute.manager [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Detaching volume 99fe25e9-e29e-4f13-8662-0fd44a571c87
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-a4a4d80d-1b52-4617-a120-38bee5dbf170 req-13c5e776-f9cf-44c3-8cc1-d06c558e93bb service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Received event network-vif-plugged-0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:30:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a4a4d80d-1b52-4617-a120-38bee5dbf170 req-13c5e776-f9cf-44c3-8cc1-d06c558e93bb service nova] Acquiring lock "18846be1-6828-4182-9285-12a40ecd41b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a4a4d80d-1b52-4617-a120-38bee5dbf170 req-13c5e776-f9cf-44c3-8cc1-d06c558e93bb service nova] Lock "18846be1-6828-4182-9285-12a40ecd41b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a4a4d80d-1b52-4617-a120-38bee5dbf170 req-13c5e776-f9cf-44c3-8cc1-d06c558e93bb service nova] Lock "18846be1-6828-4182-9285-12a40ecd41b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-a4a4d80d-1b52-4617-a120-38bee5dbf170 req-13c5e776-f9cf-44c3-8cc1-d06c558e93bb service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] No waiting events found dispatching network-vif-plugged-0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:30:17 user nova-compute[73188]: WARNING nova.compute.manager [req-a4a4d80d-1b52-4617-a120-38bee5dbf170 req-13c5e776-f9cf-44c3-8cc1-d06c558e93bb service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Received unexpected event network-vif-plugged-0338047a-ec92-4e13-8b39-95d1feedd2ba for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 19:30:17 user nova-compute[73188]: INFO nova.virt.block_device [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Attempting to driver detach volume 99fe25e9-e29e-4f13-8662-0fd44a571c87 from mountpoint /dev/vdb
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Attempting to detach device vdb from instance 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:30:17 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:30:17 user nova-compute[73188]:   <source dev="/dev/sdd"/>
Aug 15 19:30:17 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:30:17 user nova-compute[73188]:   <serial>99fe25e9-e29e-4f13-8662-0fd44a571c87</serial>
Aug 15 19:30:17 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:30:17 user nova-compute[73188]: </disk>
Aug 15 19:30:17 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:30:17 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Successfully detached device vdb from instance 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 from the persistent domain config.
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:30:17 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:30:17 user nova-compute[73188]:   <source dev="/dev/sdd"/>
Aug 15 19:30:17 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:30:17 user nova-compute[73188]:   <serial>99fe25e9-e29e-4f13-8662-0fd44a571c87</serial>
Aug 15 19:30:17 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:30:17 user nova-compute[73188]: </disk>
Aug 15 19:30:17 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127817.652518, c696f77d-eb36-426f-a86d-26bfca9a1918 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:30:17 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] VM Resumed (Lifecycle Event)
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:30:17 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Instance spawned successfully.
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:30:17 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127817.6543121, c696f77d-eb36-426f-a86d-26bfca9a1918 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:30:17 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] VM Started (Lifecycle Event)
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:30:17 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:30:17 user nova-compute[73188]: INFO nova.compute.manager [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Took 9.14 seconds to spawn the instance on the hypervisor.
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:30:17 user nova-compute[73188]: INFO nova.compute.manager [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Took 10.48 seconds to build instance.
Aug 15 19:30:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c1cb6e27-7ee0-4966-b619-84ad2646f7ce tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "c696f77d-eb36-426f-a86d-26bfca9a1918" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.590s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127817.924514, 18846be1-6828-4182-9285-12a40ecd41b1 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:30:17 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] VM Resumed (Lifecycle Event)
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:30:17 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Instance spawned successfully.
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:30:17 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:30:17 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127817.9261038, 18846be1-6828-4182-9285-12a40ecd41b1 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:30:17 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] VM Started (Lifecycle Event)
Aug 15 19:30:18 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:30:18 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:30:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692127818.039181, 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:30:18 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Successfully detached device vdb from instance 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 from the live domain config.
Aug 15 19:30:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VGIeBqmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:30:18 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:30:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[15613ef7-d13c-4d32-89ab-65cbacab8105]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b39c97c-64a0-4f58-b89c-b189f77dfd28]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:30:18 user nova-compute[73188]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)
Aug 15 19:30:18 user nova-compute[73188]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 (non-flash)
Aug 15 19:30:18 user nova-compute[73188]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)
Aug 15 19:30:18 user nova-compute[73188]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb (non-flash)
Aug 15 19:30:18 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:30:18 user nova-compute[73188]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)
Aug 15 19:30:18 user nova-compute[73188]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 (non-flash)
Aug 15 19:30:18 user nova-compute[73188]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)
Aug 15 19:30:18 user nova-compute[73188]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb (non-flash)
Aug 15 19:30:18 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2808188160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87'): ({'sdd'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Removing single pathed devices sdd {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2e70a5-8660-4b1c-a075-cf42d6261c3a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe8a123-d5fe-4851-8bf8-f36c0b454208]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Flushing IO for device /dev/sdd {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d5e78c-1b6c-4dd8-b5b5-aef9eed302ac]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG nova.compute.manager [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0292958d-3268-4fa5-b01b-01de5e0dfbc5]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] SCSI volumes sdd have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a331c60-b2f0-48fc-a537-4f7345392b53]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-9d43d5c6-b0b9-4206-9928-3362c85285e9 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "18846be1-6828-4182-9285-12a40ecd41b1" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.199s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6088e2f1-c47c-4158-bb0e-cfa96615e97d]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87, portal: 172.16.0.220,3260]
Aug 15 19:30:18 user nova-compute[73188]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87, portal: 172.16.0.220,3260] successful.
Aug 15 19:30:18 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99fe25e9-e29e-4f13-8662-0fd44a571c87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a36885-aabd-4d34-a374-5cfa48ff78f7]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] <== disconnect_volume: return (353ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:30:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:19 user nova-compute[73188]: DEBUG nova.objects.instance [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'flavor' on Instance uuid 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:30:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4097e424-d89b-49fb-92f5-ab9be6178655 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.807s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:20 user nova-compute[73188]: INFO nova.compute.manager [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Detaching volume ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb
Aug 15 19:30:20 user nova-compute[73188]: INFO nova.virt.block_device [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Attempting to driver detach volume ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb from mountpoint /dev/vdc
Aug 15 19:30:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Attempting to detach device vdc from instance 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:30:20 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:30:20 user nova-compute[73188]:   <source dev="/dev/sdf"/>
Aug 15 19:30:20 user nova-compute[73188]:   <target dev="vdc" bus="virtio"/>
Aug 15 19:30:20 user nova-compute[73188]:   <serial>ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb</serial>
Aug 15 19:30:20 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 19:30:20 user nova-compute[73188]: </disk>
Aug 15 19:30:20 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:30:20 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Successfully detached device vdc from instance 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 from the persistent domain config.
Aug 15 19:30:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:30:20 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:30:20 user nova-compute[73188]:   <source dev="/dev/sdf"/>
Aug 15 19:30:20 user nova-compute[73188]:   <target dev="vdc" bus="virtio"/>
Aug 15 19:30:20 user nova-compute[73188]:   <serial>ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb</serial>
Aug 15 19:30:20 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 19:30:20 user nova-compute[73188]: </disk>
Aug 15 19:30:20 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692127820.5916207, 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:30:20 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Successfully detached device vdc from instance 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 from the live domain config.
Aug 15 19:30:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdsLMrWH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:30:20 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:30:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd38e4c4-5c0e-40ea-8d56-ff85da999e74]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f809c60-7efe-4d26-aaa1-693e70b735d2]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:30:20 user nova-compute[73188]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)
Aug 15 19:30:20 user nova-compute[73188]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)
Aug 15 19:30:20 user nova-compute[73188]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb (non-flash)
Aug 15 19:30:20 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:30:20 user nova-compute[73188]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)
Aug 15 19:30:20 user nova-compute[73188]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)
Aug 15 19:30:20 user nova-compute[73188]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb (non-flash)
Aug 15 19:30:20 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f280818a830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb'): ({'sdf'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Removing single pathed devices sdf {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[55761a8b-f91a-4c92-b7d6-a8f022722bbe]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99804cb-9f4c-43b8-8b04-765530c0255a]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Flushing IO for device /dev/sdf {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[579157ca-0877-4ac1-a2fc-db55cd2beeba]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[944d8c36-e811-4a7e-b500-f6e0b0454567]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] SCSI volumes sdf have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[126a390f-366e-4e89-b484-fcbccf6e8bca]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4e4864-f3b8-4c28-9aa8-528bbce9e3a1]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb, portal: 172.16.0.220,3260]
Aug 15 19:30:20 user nova-compute[73188]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb, portal: 172.16.0.220,3260] successful.
Aug 15 19:30:20 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae9f9e8f-9fd6-4600-a6ba-a55b7ada88eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3fb1c4-587b-4644-8c1d-09a89e2e940f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] <== disconnect_volume: return (331ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:30:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:30:21 user nova-compute[73188]: DEBUG nova.objects.instance [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'flavor' on Instance uuid 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:30:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a3f61221-9705-49c7-8ef2-890eff865bb6 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.974s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:22 user nova-compute[73188]: INFO nova.compute.manager [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Terminating instance
Aug 15 19:30:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:30:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:23 user nova-compute[73188]: DEBUG nova.compute.manager [req-c935122a-40e8-4cd8-a120-57d8e58d5145 req-2f257329-e674-4e9b-ade7-45a03755972d service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Received event network-vif-unplugged-02ff20dc-ceb3-4897-bad7-7984f2b26693 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:30:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c935122a-40e8-4cd8-a120-57d8e58d5145 req-2f257329-e674-4e9b-ade7-45a03755972d service nova] Acquiring lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c935122a-40e8-4cd8-a120-57d8e58d5145 req-2f257329-e674-4e9b-ade7-45a03755972d service nova] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c935122a-40e8-4cd8-a120-57d8e58d5145 req-2f257329-e674-4e9b-ade7-45a03755972d service nova] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:23 user nova-compute[73188]: DEBUG nova.compute.manager [req-c935122a-40e8-4cd8-a120-57d8e58d5145 req-2f257329-e674-4e9b-ade7-45a03755972d service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] No waiting events found dispatching network-vif-unplugged-02ff20dc-ceb3-4897-bad7-7984f2b26693 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:30:23 user nova-compute[73188]: DEBUG nova.compute.manager [req-c935122a-40e8-4cd8-a120-57d8e58d5145 req-2f257329-e674-4e9b-ade7-45a03755972d service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Received event network-vif-unplugged-02ff20dc-ceb3-4897-bad7-7984f2b26693 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:30:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:23 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Instance destroyed successfully.
Aug 15 19:30:23 user nova-compute[73188]: DEBUG nova.objects.instance [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lazy-loading 'resources' on Instance uuid 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:30:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2107503239',display_name='tempest-AttachVolumeTestJSON-server-2107503239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2107503239',id=41,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCilFQzM06CpMgk2KlSWNZFq/FXZKPBdXDxnhWk/OmHtTLWOWWjTt1Rk0dMeZ3fDi2lV70snUwr9z0kIKQ7MfWng/J7D46q547830gkEg6CFBps3MDKUdp8gwQOn+e4h4w==',key_name='tempest-keypair-1920802908',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:27:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='399c3c31298f41dbb11ae1c0bc593e1f',ramdisk_id='',reservation_id='r-0seagge4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-953696987',owner_user_name='tempest-AttachVolumeTestJSON-953696987-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:27:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae5b2b05980944af80c4ffe09cd20de1',uuid=8ebc579b-f9a3-484c-8719-dfee6bbd9c97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02ff20dc-ceb3-4897-bad7-7984f2b26693", "address": "fa:16:3e:97:d9:9c", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ff20dc-ce", "ovs_interfaceid": "02ff20dc-ceb3-4897-bad7-7984f2b26693", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:30:23 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converting VIF {"id": "02ff20dc-ceb3-4897-bad7-7984f2b26693", "address": "fa:16:3e:97:d9:9c", "network": {"id": "dd6508a0-64ff-496f-a1a7-4fc735e93817", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-373203524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "399c3c31298f41dbb11ae1c0bc593e1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02ff20dc-ce", "ovs_interfaceid": "02ff20dc-ceb3-4897-bad7-7984f2b26693", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:30:23 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:d9:9c,bridge_name='br-int',has_traffic_filtering=True,id=02ff20dc-ceb3-4897-bad7-7984f2b26693,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02ff20dc-ce') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:30:23 user nova-compute[73188]: DEBUG os_vif [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:d9:9c,bridge_name='br-int',has_traffic_filtering=True,id=02ff20dc-ceb3-4897-bad7-7984f2b26693,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02ff20dc-ce') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:30:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02ff20dc-ce, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:30:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:30:23 user nova-compute[73188]: INFO os_vif [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:d9:9c,bridge_name='br-int',has_traffic_filtering=True,id=02ff20dc-ceb3-4897-bad7-7984f2b26693,network=Network(dd6508a0-64ff-496f-a1a7-4fc735e93817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02ff20dc-ce')
Aug 15 19:30:23 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Deleting instance files /opt/stack/data/nova/instances/8ebc579b-f9a3-484c-8719-dfee6bbd9c97_del
Aug 15 19:30:23 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Deletion of /opt/stack/data/nova/instances/8ebc579b-f9a3-484c-8719-dfee6bbd9c97_del complete
Aug 15 19:30:23 user nova-compute[73188]: INFO nova.compute.manager [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 15 19:30:23 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:30:23 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:30:23 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:30:24 user nova-compute[73188]: DEBUG nova.compute.manager [req-95e1af34-0a26-40e7-b072-b3a79e722705 req-d408b852-6b40-4532-8081-e86f7ff17d20 service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Received event network-changed-54a60d6b-ebf5-4ec3-a140-430617af354b {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:30:24 user nova-compute[73188]: DEBUG nova.compute.manager [req-95e1af34-0a26-40e7-b072-b3a79e722705 req-d408b852-6b40-4532-8081-e86f7ff17d20 service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Refreshing instance network info cache due to event network-changed-54a60d6b-ebf5-4ec3-a140-430617af354b. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:30:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-95e1af34-0a26-40e7-b072-b3a79e722705 req-d408b852-6b40-4532-8081-e86f7ff17d20 service nova] Acquiring lock "refresh_cache-b49fafcb-d4b4-460f-a751-60d230ce0c89" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:30:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-95e1af34-0a26-40e7-b072-b3a79e722705 req-d408b852-6b40-4532-8081-e86f7ff17d20 service nova] Acquired lock "refresh_cache-b49fafcb-d4b4-460f-a751-60d230ce0c89" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:30:24 user nova-compute[73188]: DEBUG nova.network.neutron [req-95e1af34-0a26-40e7-b072-b3a79e722705 req-d408b852-6b40-4532-8081-e86f7ff17d20 service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Refreshing network info cache for port 54a60d6b-ebf5-4ec3-a140-430617af354b {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:30:24 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:30:24 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Took 1.04 seconds to deallocate network for instance.
Aug 15 19:30:25 user nova-compute[73188]: DEBUG nova.compute.manager [req-4ba04cc9-92b2-4db0-be25-5c4abef8b3a6 req-bb68dc4c-310a-488f-b4aa-42e28518e1af service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Received event network-vif-deleted-02ff20dc-ceb3-4897-bad7-7984f2b26693 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:30:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:25 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:30:25 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:30:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:25 user nova-compute[73188]: DEBUG nova.compute.manager [req-6c74a576-76fb-4419-9e37-dc3c559ff29d req-673cad64-5b93-4ebb-bbe2-cc43f68933bd service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Received event network-vif-plugged-02ff20dc-ceb3-4897-bad7-7984f2b26693 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:30:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6c74a576-76fb-4419-9e37-dc3c559ff29d req-673cad64-5b93-4ebb-bbe2-cc43f68933bd service nova] Acquiring lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6c74a576-76fb-4419-9e37-dc3c559ff29d req-673cad64-5b93-4ebb-bbe2-cc43f68933bd service nova] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6c74a576-76fb-4419-9e37-dc3c559ff29d req-673cad64-5b93-4ebb-bbe2-cc43f68933bd service nova] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:25 user nova-compute[73188]: DEBUG nova.compute.manager [req-6c74a576-76fb-4419-9e37-dc3c559ff29d req-673cad64-5b93-4ebb-bbe2-cc43f68933bd service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] No waiting events found dispatching network-vif-plugged-02ff20dc-ceb3-4897-bad7-7984f2b26693 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:30:25 user nova-compute[73188]: WARNING nova.compute.manager [req-6c74a576-76fb-4419-9e37-dc3c559ff29d req-673cad64-5b93-4ebb-bbe2-cc43f68933bd service nova] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Received unexpected event network-vif-plugged-02ff20dc-ceb3-4897-bad7-7984f2b26693 for instance with vm_state deleted and task_state None.
Aug 15 19:30:25 user nova-compute[73188]: DEBUG nova.network.neutron [req-95e1af34-0a26-40e7-b072-b3a79e722705 req-d408b852-6b40-4532-8081-e86f7ff17d20 service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Updated VIF entry in instance network info cache for port 54a60d6b-ebf5-4ec3-a140-430617af354b. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:30:25 user nova-compute[73188]: DEBUG nova.network.neutron [req-95e1af34-0a26-40e7-b072-b3a79e722705 req-d408b852-6b40-4532-8081-e86f7ff17d20 service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Updating instance_info_cache with network_info: [{"id": "54a60d6b-ebf5-4ec3-a140-430617af354b", "address": "fa:16:3e:3f:92:09", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a60d6b-eb", "ovs_interfaceid": "54a60d6b-ebf5-4ec3-a140-430617af354b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:30:25 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Deleted allocations for instance 8ebc579b-f9a3-484c-8719-dfee6bbd9c97
Aug 15 19:30:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-95e1af34-0a26-40e7-b072-b3a79e722705 req-d408b852-6b40-4532-8081-e86f7ff17d20 service nova] Releasing lock "refresh_cache-b49fafcb-d4b4-460f-a751-60d230ce0c89" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:30:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-a38fd0fa-a899-4758-ab9f-da70424f88d9 tempest-AttachVolumeTestJSON-953696987 tempest-AttachVolumeTestJSON-953696987-project-member] Lock "8ebc579b-f9a3-484c-8719-dfee6bbd9c97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.622s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "b49fafcb-d4b4-460f-a751-60d230ce0c89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "b49fafcb-d4b4-460f-a751-60d230ce0c89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "b49fafcb-d4b4-460f-a751-60d230ce0c89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "b49fafcb-d4b4-460f-a751-60d230ce0c89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "b49fafcb-d4b4-460f-a751-60d230ce0c89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:25 user nova-compute[73188]: INFO nova.compute.manager [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Terminating instance
Aug 15 19:30:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:30:26 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Instance destroyed successfully.
Aug 15 19:30:26 user nova-compute[73188]: DEBUG nova.objects.instance [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lazy-loading 'resources' on Instance uuid b49fafcb-d4b4-460f-a751-60d230ce0c89 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1136787592',display_name='tempest-TestVolumeBootPattern-server-1136787592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1136787592',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdjONelCosej3I/pGPD4UfCZO2hIpepMykeX7dOlXZGpPLQP0eHCaELWxQF5jeHsky1dPgp1Jk+Jsu/dHFRA3/Yz5MW9r+VfrqEngMakotyTy6CftX4lIdZFQ2vRevOkg==',key_name='tempest-TestVolumeBootPattern-1653977396',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:28:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18eadba32f4547ad9436aca9285b7aad',ramdisk_id='',reservation_id='r-wapq9ehm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2114363476',owner_user_name='tempest-TestVolumeBootPattern-2114363476-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:28:47Z,user_data=None,user_id='9503705066e5402cb569fae3b2bd8976',uuid=b49fafcb-d4b4-460f-a751-60d230ce0c89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54a60d6b-ebf5-4ec3-a140-430617af354b", "address": "fa:16:3e:3f:92:09", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a60d6b-eb", "ovs_interfaceid": "54a60d6b-ebf5-4ec3-a140-430617af354b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converting VIF {"id": "54a60d6b-ebf5-4ec3-a140-430617af354b", "address": "fa:16:3e:3f:92:09", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a60d6b-eb", "ovs_interfaceid": "54a60d6b-ebf5-4ec3-a140-430617af354b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:92:09,bridge_name='br-int',has_traffic_filtering=True,id=54a60d6b-ebf5-4ec3-a140-430617af354b,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a60d6b-eb') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG os_vif [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:92:09,bridge_name='br-int',has_traffic_filtering=True,id=54a60d6b-ebf5-4ec3-a140-430617af354b,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a60d6b-eb') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54a60d6b-eb, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:30:26 user nova-compute[73188]: INFO os_vif [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:92:09,bridge_name='br-int',has_traffic_filtering=True,id=54a60d6b-ebf5-4ec3-a140-430617af354b,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54a60d6b-eb')
Aug 15 19:30:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZqgXyUri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:30:26 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:30:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[259427ba-9f73-40d5-8a99-0eb965fbbd3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5000b869-5ba7-4959-b286-4b9860197f98]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:30:26 user nova-compute[73188]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)
Aug 15 19:30:26 user nova-compute[73188]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)
Aug 15 19:30:26 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:30:26 user nova-compute[73188]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 (non-flash)
Aug 15 19:30:26 user nova-compute[73188]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)
Aug 15 19:30:26 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2808188670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645'): ({'sdc'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Removing single pathed devices sdc {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG nova.compute.manager [req-a3f3ca34-b66b-4733-a476-4b0009906298 req-2c4bb1fa-cfcd-4438-9ae3-ea6409eaa94b service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Received event network-vif-unplugged-54a60d6b-ebf5-4ec3-a140-430617af354b {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a3f3ca34-b66b-4733-a476-4b0009906298 req-2c4bb1fa-cfcd-4438-9ae3-ea6409eaa94b service nova] Acquiring lock "b49fafcb-d4b4-460f-a751-60d230ce0c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a3f3ca34-b66b-4733-a476-4b0009906298 req-2c4bb1fa-cfcd-4438-9ae3-ea6409eaa94b service nova] Lock "b49fafcb-d4b4-460f-a751-60d230ce0c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a3f3ca34-b66b-4733-a476-4b0009906298 req-2c4bb1fa-cfcd-4438-9ae3-ea6409eaa94b service nova] Lock "b49fafcb-d4b4-460f-a751-60d230ce0c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG nova.compute.manager [req-a3f3ca34-b66b-4733-a476-4b0009906298 req-2c4bb1fa-cfcd-4438-9ae3-ea6409eaa94b service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] No waiting events found dispatching network-vif-unplugged-54a60d6b-ebf5-4ec3-a140-430617af354b {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG nova.compute.manager [req-a3f3ca34-b66b-4733-a476-4b0009906298 req-2c4bb1fa-cfcd-4438-9ae3-ea6409eaa94b service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Received event network-vif-unplugged-54a60d6b-ebf5-4ec3-a140-430617af354b for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG nova.compute.manager [req-a3f3ca34-b66b-4733-a476-4b0009906298 req-2c4bb1fa-cfcd-4438-9ae3-ea6409eaa94b service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Received event network-vif-plugged-54a60d6b-ebf5-4ec3-a140-430617af354b {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a3f3ca34-b66b-4733-a476-4b0009906298 req-2c4bb1fa-cfcd-4438-9ae3-ea6409eaa94b service nova] Acquiring lock "b49fafcb-d4b4-460f-a751-60d230ce0c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a3f3ca34-b66b-4733-a476-4b0009906298 req-2c4bb1fa-cfcd-4438-9ae3-ea6409eaa94b service nova] Lock "b49fafcb-d4b4-460f-a751-60d230ce0c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a3f3ca34-b66b-4733-a476-4b0009906298 req-2c4bb1fa-cfcd-4438-9ae3-ea6409eaa94b service nova] Lock "b49fafcb-d4b4-460f-a751-60d230ce0c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG nova.compute.manager [req-a3f3ca34-b66b-4733-a476-4b0009906298 req-2c4bb1fa-cfcd-4438-9ae3-ea6409eaa94b service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] No waiting events found dispatching network-vif-plugged-54a60d6b-ebf5-4ec3-a140-430617af354b {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:30:26 user nova-compute[73188]: WARNING nova.compute.manager [req-a3f3ca34-b66b-4733-a476-4b0009906298 req-2c4bb1fa-cfcd-4438-9ae3-ea6409eaa94b service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Received unexpected event network-vif-plugged-54a60d6b-ebf5-4ec3-a140-430617af354b for instance with vm_state active and task_state deleting.
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[797a87b3-4702-46a7-b1fa-936bc8ea0644]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[495c40f7-cc35-4bc3-9160-913c93adb5fc]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Flushing IO for device /dev/sdc {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96880bb-b22d-4c3f-a700-7c08d093b65a]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48872db-2cb9-4f9b-af55-90d189104ecf]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:30:26 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] SCSI volumes sdc have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOcb0e862e-d7edbfb2cd5fef05', '/dev/disk/by-id/scsi-26437656462666232', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_cb0e862e') {{(pid=83967) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[319c7edc-3882-44f6-b968-c1d0036fac5e]: (4, None) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3cac17-bd2e-4682-9067-166411581bb4]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG nova.compute.manager [req-fc89b1cc-efd4-4ab8-bf73-8fbcc01e3d52 req-06286d44-5ff2-4e71-b88c-2ea705c4689e service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Received event network-changed-54a60d6b-ebf5-4ec3-a140-430617af354b {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG nova.compute.manager [req-fc89b1cc-efd4-4ab8-bf73-8fbcc01e3d52 req-06286d44-5ff2-4e71-b88c-2ea705c4689e service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Refreshing instance network info cache due to event network-changed-54a60d6b-ebf5-4ec3-a140-430617af354b. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fc89b1cc-efd4-4ab8-bf73-8fbcc01e3d52 req-06286d44-5ff2-4e71-b88c-2ea705c4689e service nova] Acquiring lock "refresh_cache-b49fafcb-d4b4-460f-a751-60d230ce0c89" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fc89b1cc-efd4-4ab8-bf73-8fbcc01e3d52 req-06286d44-5ff2-4e71-b88c-2ea705c4689e service nova] Acquired lock "refresh_cache-b49fafcb-d4b4-460f-a751-60d230ce0c89" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG nova.network.neutron [req-fc89b1cc-efd4-4ab8-bf73-8fbcc01e3d52 req-06286d44-5ff2-4e71-b88c-2ea705c4689e service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Refreshing network info cache for port 54a60d6b-ebf5-4ec3-a140-430617af354b {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fadb29-de0b-41f5-9050-a7c1474d936d]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645, portal: 172.16.0.220,3260]
Aug 15 19:30:27 user nova-compute[73188]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645, portal: 172.16.0.220,3260] successful.
Aug 15 19:30:27 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e631c0-41a5-41e3-aca6-3d8051da4645 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcdf401-ffae-4760-860c-284fb6494239]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] <== disconnect_volume: return (375ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:30:27 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Deleting instance files /opt/stack/data/nova/instances/b49fafcb-d4b4-460f-a751-60d230ce0c89_del
Aug 15 19:30:27 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Deletion of /opt/stack/data/nova/instances/b49fafcb-d4b4-460f-a751-60d230ce0c89_del complete
Aug 15 19:30:27 user nova-compute[73188]: INFO nova.compute.manager [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 15 19:30:27 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG nova.network.neutron [req-fc89b1cc-efd4-4ab8-bf73-8fbcc01e3d52 req-06286d44-5ff2-4e71-b88c-2ea705c4689e service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Updated VIF entry in instance network info cache for port 54a60d6b-ebf5-4ec3-a140-430617af354b. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG nova.network.neutron [req-fc89b1cc-efd4-4ab8-bf73-8fbcc01e3d52 req-06286d44-5ff2-4e71-b88c-2ea705c4689e service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Updating instance_info_cache with network_info: [{"id": "54a60d6b-ebf5-4ec3-a140-430617af354b", "address": "fa:16:3e:3f:92:09", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54a60d6b-eb", "ovs_interfaceid": "54a60d6b-ebf5-4ec3-a140-430617af354b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fc89b1cc-efd4-4ab8-bf73-8fbcc01e3d52 req-06286d44-5ff2-4e71-b88c-2ea705c4689e service nova] Releasing lock "refresh_cache-b49fafcb-d4b4-460f-a751-60d230ce0c89" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:30:27 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:30:27 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Took 0.61 seconds to deallocate network for instance.
Aug 15 19:30:28 user nova-compute[73188]: INFO nova.compute.manager [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Took 0.81 seconds to detach 1 volumes for instance.
Aug 15 19:30:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:28 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:30:28 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:30:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:28 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Deleted allocations for instance b49fafcb-d4b4-460f-a751-60d230ce0c89
Aug 15 19:30:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-30b7637c-1660-4839-9d56-5dd73ced655b tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "b49fafcb-d4b4-460f-a751-60d230ce0c89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.074s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:29 user nova-compute[73188]: DEBUG nova.compute.manager [req-926f870d-1684-4ca9-a682-e4373d28f1a6 req-088f3f3f-84cc-47a5-a62d-eb8f7d3a7863 service nova] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Received event network-vif-deleted-54a60d6b-ebf5-4ec3-a140-430617af354b {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:30:30 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:30:31 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:30:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:32 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:30:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:30:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Didn't find any instances for network info cache update. {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 19:30:33 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:30:33 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:30:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:33 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:30:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:33 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:30:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:30:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:30:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:30:34 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:30:34 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:30:34 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8194MB free_disk=25.316558837890625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:30:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:30:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:30:34 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance d780864e-d471-4a9a-94e2-3ebd9cb08fe2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:30:34 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 18846be1-6828-4182-9285-12a40ecd41b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:30:34 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance c696f77d-eb36-426f-a86d-26bfca9a1918 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:30:34 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:30:34 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:30:35 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:30:35 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:30:35 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:30:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:30:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:30:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:37 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:30:37 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:30:37 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:30:37 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:30:38 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127823.7955022, 8ebc579b-f9a3-484c-8719-dfee6bbd9c97 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:30:38 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] VM Stopped (Lifecycle Event)
Aug 15 19:30:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-91eb260c-d0a3-4d3a-b7f8-bb379dbe7508 None None] [instance: 8ebc579b-f9a3-484c-8719-dfee6bbd9c97] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:30:41 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127826.7321515, b49fafcb-d4b4-460f-a751-60d230ce0c89 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:30:41 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] VM Stopped (Lifecycle Event)
Aug 15 19:30:41 user nova-compute[73188]: DEBUG nova.compute.manager [None req-c3840b0d-c39e-4ed5-acf2-0e4e8f5ac8a5 None None] [instance: b49fafcb-d4b4-460f-a751-60d230ce0c89] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:30:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:30:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:31:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:26 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:31:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:31:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:31:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:31:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:31:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:26 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG nova.compute.manager [req-1dcf165f-0a2b-4422-964e-9bc80063b6e2 req-f43143ba-7207-4b72-ab47-2c12e97e3d7a service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Received event network-changed-e7f8d41f-86d5-48b7-bba5-eab023fadb26 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG nova.compute.manager [req-1dcf165f-0a2b-4422-964e-9bc80063b6e2 req-f43143ba-7207-4b72-ab47-2c12e97e3d7a service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Refreshing instance network info cache due to event network-changed-e7f8d41f-86d5-48b7-bba5-eab023fadb26. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1dcf165f-0a2b-4422-964e-9bc80063b6e2 req-f43143ba-7207-4b72-ab47-2c12e97e3d7a service nova] Acquiring lock "refresh_cache-d780864e-d471-4a9a-94e2-3ebd9cb08fe2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1dcf165f-0a2b-4422-964e-9bc80063b6e2 req-f43143ba-7207-4b72-ab47-2c12e97e3d7a service nova] Acquired lock "refresh_cache-d780864e-d471-4a9a-94e2-3ebd9cb08fe2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG nova.network.neutron [req-1dcf165f-0a2b-4422-964e-9bc80063b6e2 req-f43143ba-7207-4b72-ab47-2c12e97e3d7a service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Refreshing network info cache for port e7f8d41f-86d5-48b7-bba5-eab023fadb26 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "d780864e-d471-4a9a-94e2-3ebd9cb08fe2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "d780864e-d471-4a9a-94e2-3ebd9cb08fe2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "d780864e-d471-4a9a-94e2-3ebd9cb08fe2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "d780864e-d471-4a9a-94e2-3ebd9cb08fe2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "d780864e-d471-4a9a-94e2-3ebd9cb08fe2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:31:30 user nova-compute[73188]: INFO nova.compute.manager [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Terminating instance
Aug 15 19:31:30 user nova-compute[73188]: DEBUG nova.compute.manager [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG nova.compute.manager [req-aebdca0f-b17d-4c95-b966-2c33a0139d33 req-c68a0ac0-ea25-4ea8-ab5b-9b6f6fb7d7bd service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Received event network-vif-unplugged-e7f8d41f-86d5-48b7-bba5-eab023fadb26 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-aebdca0f-b17d-4c95-b966-2c33a0139d33 req-c68a0ac0-ea25-4ea8-ab5b-9b6f6fb7d7bd service nova] Acquiring lock "d780864e-d471-4a9a-94e2-3ebd9cb08fe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-aebdca0f-b17d-4c95-b966-2c33a0139d33 req-c68a0ac0-ea25-4ea8-ab5b-9b6f6fb7d7bd service nova] Lock "d780864e-d471-4a9a-94e2-3ebd9cb08fe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-aebdca0f-b17d-4c95-b966-2c33a0139d33 req-c68a0ac0-ea25-4ea8-ab5b-9b6f6fb7d7bd service nova] Lock "d780864e-d471-4a9a-94e2-3ebd9cb08fe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG nova.compute.manager [req-aebdca0f-b17d-4c95-b966-2c33a0139d33 req-c68a0ac0-ea25-4ea8-ab5b-9b6f6fb7d7bd service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] No waiting events found dispatching network-vif-unplugged-e7f8d41f-86d5-48b7-bba5-eab023fadb26 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG nova.compute.manager [req-aebdca0f-b17d-4c95-b966-2c33a0139d33 req-c68a0ac0-ea25-4ea8-ab5b-9b6f6fb7d7bd service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Received event network-vif-unplugged-e7f8d41f-86d5-48b7-bba5-eab023fadb26 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG nova.network.neutron [req-1dcf165f-0a2b-4422-964e-9bc80063b6e2 req-f43143ba-7207-4b72-ab47-2c12e97e3d7a service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Updated VIF entry in instance network info cache for port e7f8d41f-86d5-48b7-bba5-eab023fadb26. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG nova.network.neutron [req-1dcf165f-0a2b-4422-964e-9bc80063b6e2 req-f43143ba-7207-4b72-ab47-2c12e97e3d7a service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Updating instance_info_cache with network_info: [{"id": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "address": "fa:16:3e:90:71:53", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f8d41f-86", "ovs_interfaceid": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:31:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1dcf165f-0a2b-4422-964e-9bc80063b6e2 req-f43143ba-7207-4b72-ab47-2c12e97e3d7a service nova] Releasing lock "refresh_cache-d780864e-d471-4a9a-94e2-3ebd9cb08fe2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:31:31 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Instance destroyed successfully.
Aug 15 19:31:31 user nova-compute[73188]: DEBUG nova.objects.instance [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lazy-loading 'resources' on Instance uuid d780864e-d471-4a9a-94e2-3ebd9cb08fe2 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1151923873',display_name='tempest-TestVolumeBootPattern-server-1151923873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1151923873',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdjONelCosej3I/pGPD4UfCZO2hIpepMykeX7dOlXZGpPLQP0eHCaELWxQF5jeHsky1dPgp1Jk+Jsu/dHFRA3/Yz5MW9r+VfrqEngMakotyTy6CftX4lIdZFQ2vRevOkg==',key_name='tempest-TestVolumeBootPattern-1653977396',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:26:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18eadba32f4547ad9436aca9285b7aad',ramdisk_id='',reservation_id='r-ccycsiqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2114363476',owner_user_name='tempest-TestVolumeBootPattern-2114363476-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:26:42Z,user_data=None,user_id='9503705066e5402cb569fae3b2bd8976',uuid=d780864e-d471-4a9a-94e2-3ebd9cb08fe2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "address": "fa:16:3e:90:71:53", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f8d41f-86", "ovs_interfaceid": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converting VIF {"id": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "address": "fa:16:3e:90:71:53", "network": {"id": "410c668a-af68-4257-9fef-4531e7d549bd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1903495406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18eadba32f4547ad9436aca9285b7aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f8d41f-86", "ovs_interfaceid": "e7f8d41f-86d5-48b7-bba5-eab023fadb26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:71:53,bridge_name='br-int',has_traffic_filtering=True,id=e7f8d41f-86d5-48b7-bba5-eab023fadb26,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f8d41f-86') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG os_vif [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:71:53,bridge_name='br-int',has_traffic_filtering=True,id=e7f8d41f-86d5-48b7-bba5-eab023fadb26,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f8d41f-86') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7f8d41f-86, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:31 user nova-compute[73188]: INFO os_vif [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:71:53,bridge_name='br-int',has_traffic_filtering=True,id=e7f8d41f-86d5-48b7-bba5-eab023fadb26,network=Network(410c668a-af68-4257-9fef-4531e7d549bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f8d41f-86')
Aug 15 19:31:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLhRyXDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:31:31 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:31:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac6b5f3-95a8-4b5f-959a-8f249a5b7cdc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07c0434-1ef4-41bf-a718-9bdcbc4f5ea0]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:31:31 user nova-compute[73188]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)
Aug 15 19:31:31 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 (non-flash)
Aug 15 19:31:31 user nova-compute[73188]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)
Aug 15 19:31:31 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e474b370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2'): ({'sdb'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Removing single pathed devices sdb {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[59126004-e1aa-428b-bedc-4ff7d8f9cff8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc81850d-936c-4ce5-98d5-7d88dede5086]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Flushing IO for device /dev/sdb {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1302b18-6463-423a-939f-dc9d83027c04]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21d6859-09d8-4ae8-acd2-ce6d0d9139a6]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_20fd2a70', '/dev/disk/by-id/scsi-23263363033363438', '/dev/disk/by-id/scsi-1SCST_BIO20fd2a70-2c6036487af49f66') {{(pid=83967) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d82de6-7a7b-4894-bb1c-29548430f9ab]: (4, None) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6cf84c-ea86-4399-bf12-f7af970be70e]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7885fd3b-ff98-4ce2-bb61-209b8c350511]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2, portal: 172.16.0.220,3260]
Aug 15 19:31:31 user nova-compute[73188]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2, portal: 172.16.0.220,3260] successful.
Aug 15 19:31:31 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0d1c0ed-fb02-4031-a56f-4e15a01873b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9a1f8d-0f42-48e0-a50d-ea81d81741ae]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] <== disconnect_volume: return (306ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:31:31 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Deleting instance files /opt/stack/data/nova/instances/d780864e-d471-4a9a-94e2-3ebd9cb08fe2_del
Aug 15 19:31:31 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Deletion of /opt/stack/data/nova/instances/d780864e-d471-4a9a-94e2-3ebd9cb08fe2_del complete
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:31:31 user nova-compute[73188]: INFO nova.compute.manager [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Took 1.39 seconds to destroy the instance on the hypervisor.
Aug 15 19:31:31 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:31:31 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:31:32 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:31:32 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Took 0.60 seconds to deallocate network for instance.
Aug 15 19:31:32 user nova-compute[73188]: DEBUG nova.compute.manager [req-ea37edf7-e782-4398-ab2e-e4d44eb169c4 req-ebdb1046-269d-437a-b67e-598b665bc5d2 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Received event network-vif-deleted-e7f8d41f-86d5-48b7-bba5-eab023fadb26 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:31:32 user nova-compute[73188]: INFO nova.compute.manager [req-ea37edf7-e782-4398-ab2e-e4d44eb169c4 req-ebdb1046-269d-437a-b67e-598b665bc5d2 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Neutron deleted interface e7f8d41f-86d5-48b7-bba5-eab023fadb26; detaching it from the instance and deleting it from the info cache
Aug 15 19:31:32 user nova-compute[73188]: DEBUG nova.network.neutron [req-ea37edf7-e782-4398-ab2e-e4d44eb169c4 req-ebdb1046-269d-437a-b67e-598b665bc5d2 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:31:32 user nova-compute[73188]: DEBUG nova.compute.manager [req-ea37edf7-e782-4398-ab2e-e4d44eb169c4 req-ebdb1046-269d-437a-b67e-598b665bc5d2 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Detach interface failed, port_id=e7f8d41f-86d5-48b7-bba5-eab023fadb26, reason: Instance d780864e-d471-4a9a-94e2-3ebd9cb08fe2 could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:31:32 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:31:32 user nova-compute[73188]: DEBUG nova.compute.manager [req-9bc5a2bc-a5b4-4959-b8d3-eef80df562c9 req-05159ee6-b732-46e1-ba0d-90c99d80c436 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Received event network-vif-plugged-e7f8d41f-86d5-48b7-bba5-eab023fadb26 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:31:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9bc5a2bc-a5b4-4959-b8d3-eef80df562c9 req-05159ee6-b732-46e1-ba0d-90c99d80c436 service nova] Acquiring lock "d780864e-d471-4a9a-94e2-3ebd9cb08fe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:31:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9bc5a2bc-a5b4-4959-b8d3-eef80df562c9 req-05159ee6-b732-46e1-ba0d-90c99d80c436 service nova] Lock "d780864e-d471-4a9a-94e2-3ebd9cb08fe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:31:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9bc5a2bc-a5b4-4959-b8d3-eef80df562c9 req-05159ee6-b732-46e1-ba0d-90c99d80c436 service nova] Lock "d780864e-d471-4a9a-94e2-3ebd9cb08fe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:31:32 user nova-compute[73188]: DEBUG nova.compute.manager [req-9bc5a2bc-a5b4-4959-b8d3-eef80df562c9 req-05159ee6-b732-46e1-ba0d-90c99d80c436 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] No waiting events found dispatching network-vif-plugged-e7f8d41f-86d5-48b7-bba5-eab023fadb26 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:31:32 user nova-compute[73188]: WARNING nova.compute.manager [req-9bc5a2bc-a5b4-4959-b8d3-eef80df562c9 req-05159ee6-b732-46e1-ba0d-90c99d80c436 service nova] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Received unexpected event network-vif-plugged-e7f8d41f-86d5-48b7-bba5-eab023fadb26 for instance with vm_state active and task_state deleting.
Aug 15 19:31:33 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:31:33 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:31:33 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:31:33 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Skipping network cache update for instance because it is being deleted. {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 15 19:31:33 user nova-compute[73188]: INFO nova.compute.manager [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Took 1.39 seconds to detach 1 volumes for instance.
Aug 15 19:31:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:31:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:31:33 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:31:33 user nova-compute[73188]: DEBUG nova.objects.instance [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lazy-loading 'info_cache' on Instance uuid 18846be1-6828-4182-9285-12a40ecd41b1 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:31:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:31:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:31:33 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Refreshing inventories for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 19:31:33 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Updating ProviderTree inventory for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 19:31:33 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Updating inventory in ProviderTree for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 19:31:34 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Refreshing aggregate associations for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5, aggregates: None {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 19:31:34 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Refreshing trait associations for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 19:31:34 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:31:34 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:31:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.563s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:31:34 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Deleted allocations for instance d780864e-d471-4a9a-94e2-3ebd9cb08fe2
Aug 15 19:31:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-7b80f474-dafd-4db2-8ed2-9e14882646ac tempest-TestVolumeBootPattern-2114363476 tempest-TestVolumeBootPattern-2114363476-project-member] Lock "d780864e-d471-4a9a-94e2-3ebd9cb08fe2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.154s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:31:34 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Updating instance_info_cache with network_info: [{"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0338047a-ec", "ovs_interfaceid": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:31:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-18846be1-6828-4182-9285-12a40ecd41b1" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:31:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:31:34 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:31:34 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:31:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:31:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:31:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:31:34 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:31:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:34 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:35 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:35 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:31:35 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:35 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:35 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:35 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:35 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:31:35 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:31:35 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8465MB free_disk=25.312236785888672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:31:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:31:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:31:35 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 18846be1-6828-4182-9285-12a40ecd41b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:31:35 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance c696f77d-eb36-426f-a86d-26bfca9a1918 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:31:35 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:31:35 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:31:36 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:31:36 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:31:36 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:31:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:31:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:37 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:31:37 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:31:37 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:31:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:37 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:31:37 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:31:38 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:31:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=73188) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 19:31:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "18846be1-6828-4182-9285-12a40ecd41b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:31:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "18846be1-6828-4182-9285-12a40ecd41b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:31:42 user nova-compute[73188]: INFO nova.compute.manager [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Detaching volume 3e7c6248-db44-4037-b40b-0523d5a9d7f9
Aug 15 19:31:42 user nova-compute[73188]: INFO nova.virt.block_device [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Attempting to driver detach volume 3e7c6248-db44-4037-b40b-0523d5a9d7f9 from mountpoint /dev/vdc
Aug 15 19:31:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Attempting to detach device vdc from instance 18846be1-6828-4182-9285-12a40ecd41b1 from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:31:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:31:42 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:31:42 user nova-compute[73188]:   <source dev="/dev/sde"/>
Aug 15 19:31:42 user nova-compute[73188]:   <target dev="vdc" bus="virtio"/>
Aug 15 19:31:42 user nova-compute[73188]:   <serial>3e7c6248-db44-4037-b40b-0523d5a9d7f9</serial>
Aug 15 19:31:42 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 19:31:42 user nova-compute[73188]: </disk>
Aug 15 19:31:42 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:31:42 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Successfully detached device vdc from instance 18846be1-6828-4182-9285-12a40ecd41b1 from the persistent domain config.
Aug 15 19:31:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 18846be1-6828-4182-9285-12a40ecd41b1 from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:31:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:31:42 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:31:42 user nova-compute[73188]:   <source dev="/dev/sde"/>
Aug 15 19:31:42 user nova-compute[73188]:   <target dev="vdc" bus="virtio"/>
Aug 15 19:31:42 user nova-compute[73188]:   <serial>3e7c6248-db44-4037-b40b-0523d5a9d7f9</serial>
Aug 15 19:31:42 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 19:31:42 user nova-compute[73188]: </disk>
Aug 15 19:31:42 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:31:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692127903.249752, 18846be1-6828-4182-9285-12a40ecd41b1 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 18846be1-6828-4182-9285-12a40ecd41b1 {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:31:43 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Successfully detached device vdc from instance 18846be1-6828-4182-9285-12a40ecd41b1 from the live domain config.
Aug 15 19:31:43 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epJyXvoh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:31:43 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:31:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5473d0b5-c618-4282-9d92-5e451cd8a425]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c2ca49-90bd-42fb-bbe7-0cb3dc3b6004]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)
Aug 15 19:31:43 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 (non-flash)
Aug 15 19:31:43 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28082c5bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9'): ({'sde'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Removing single pathed devices sde {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d825b4-a018-4891-af80-2893409674dd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1206aeb6-ab19-464a-98e4-8d7fc4d7f689]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Flushing IO for device /dev/sde {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a649e1-3cb3-4642-b005-e24fca6295a8]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7da416-cfb6-45f6-9001-c706b473caa0]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] SCSI volumes sde have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd998f34-816f-4f78-8f27-30e9151c56d0]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bed788-6fb2-4d41-af8e-ef77dc10070d]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9, portal: 172.16.0.220,3260]
Aug 15 19:31:43 user nova-compute[73188]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9, portal: 172.16.0.220,3260] successful.
Aug 15 19:31:43 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7c6248-db44-4037-b40b-0523d5a9d7f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea41840f-7019-4bd9-b56d-74da5f804243]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] <== disconnect_volume: return (270ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:31:43 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:31:44 user nova-compute[73188]: DEBUG nova.objects.instance [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'flavor' on Instance uuid 18846be1-6828-4182-9285-12a40ecd41b1 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:31:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-032906f9-71d6-4d8c-a53b-140b168c3254 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "18846be1-6828-4182-9285-12a40ecd41b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.855s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:31:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:46 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127891.2067955, d780864e-d471-4a9a-94e2-3ebd9cb08fe2 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:31:46 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] VM Stopped (Lifecycle Event)
Aug 15 19:31:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ac8c4fc8-6a03-4912-aa70-b647e23bcccc None None] [instance: d780864e-d471-4a9a-94e2-3ebd9cb08fe2] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:31:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "adef852b-f515-4cfd-807e-586809ff6aa6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:31:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "adef852b-f515-4cfd-807e-586809ff6aa6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:31:48 user nova-compute[73188]: DEBUG nova.compute.manager [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:31:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:31:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:31:48 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:31:48 user nova-compute[73188]: INFO nova.compute.claims [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Claim successful on node user
Aug 15 19:31:49 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:31:49 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:31:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:31:49 user nova-compute[73188]: DEBUG nova.compute.manager [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:31:49 user nova-compute[73188]: DEBUG nova.compute.manager [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:31:49 user nova-compute[73188]: DEBUG nova.network.neutron [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:31:49 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:31:49 user nova-compute[73188]: DEBUG nova.compute.manager [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:31:49 user nova-compute[73188]: DEBUG nova.policy [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e526de0e03140bea2d410f535f75bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5bc7d940cd1410a878ac89e24a4c4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:31:49 user nova-compute[73188]: DEBUG nova.compute.manager [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:31:49 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:31:49 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Creating image(s)
Aug 15 19:31:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "/opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:31:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "/opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:31:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "/opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:31:49 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:49 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.196s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:31:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:31:49 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.181s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk 1073741824" returned: 0 in 0.046s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:31:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.185s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:50 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Checking if we can resize image /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:31:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:50 user nova-compute[73188]: DEBUG nova.network.neutron [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Successfully created port: a50854ad-f025-4e0d-b13c-4786568261b1 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:31:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:50 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Cannot resize image /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:31:50 user nova-compute[73188]: DEBUG nova.objects.instance [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lazy-loading 'migration_context' on Instance uuid adef852b-f515-4cfd-807e-586809ff6aa6 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:31:50 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:31:50 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Ensure instance console log exists: /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:31:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:31:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:31:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:31:50 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:31:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Cleaning up deleted instances {{(pid=73188) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 19:31:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] There are 0 instances to clean {{(pid=73188) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.network.neutron [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Successfully updated port: a50854ad-f025-4e0d-b13c-4786568261b1 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "refresh_cache-adef852b-f515-4cfd-807e-586809ff6aa6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquired lock "refresh_cache-adef852b-f515-4cfd-807e-586809ff6aa6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.network.neutron [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.network.neutron [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-b65710d6-fa84-4c6b-849e-05086002366f req-9535bc62-eb02-4475-be6b-e5fcaab27f7c service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Received event network-changed-a50854ad-f025-4e0d-b13c-4786568261b1 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.compute.manager [req-b65710d6-fa84-4c6b-849e-05086002366f req-9535bc62-eb02-4475-be6b-e5fcaab27f7c service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Refreshing instance network info cache due to event network-changed-a50854ad-f025-4e0d-b13c-4786568261b1. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b65710d6-fa84-4c6b-849e-05086002366f req-9535bc62-eb02-4475-be6b-e5fcaab27f7c service nova] Acquiring lock "refresh_cache-adef852b-f515-4cfd-807e-586809ff6aa6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.network.neutron [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Updating instance_info_cache with network_info: [{"id": "a50854ad-f025-4e0d-b13c-4786568261b1", "address": "fa:16:3e:4e:b4:be", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa50854ad-f0", "ovs_interfaceid": "a50854ad-f025-4e0d-b13c-4786568261b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Releasing lock "refresh_cache-adef852b-f515-4cfd-807e-586809ff6aa6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Instance network_info: |[{"id": "a50854ad-f025-4e0d-b13c-4786568261b1", "address": "fa:16:3e:4e:b4:be", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa50854ad-f0", "ovs_interfaceid": "a50854ad-f025-4e0d-b13c-4786568261b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b65710d6-fa84-4c6b-849e-05086002366f req-9535bc62-eb02-4475-be6b-e5fcaab27f7c service nova] Acquired lock "refresh_cache-adef852b-f515-4cfd-807e-586809ff6aa6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.network.neutron [req-b65710d6-fa84-4c6b-849e-05086002366f req-9535bc62-eb02-4475-be6b-e5fcaab27f7c service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Refreshing network info cache for port a50854ad-f025-4e0d-b13c-4786568261b1 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Start _get_guest_xml network_info=[{"id": "a50854ad-f025-4e0d-b13c-4786568261b1", "address": "fa:16:3e:4e:b4:be", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa50854ad-f0", "ovs_interfaceid": "a50854ad-f025-4e0d-b13c-4786568261b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:31:51 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:31:51 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:31:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1956775684',display_name='tempest-AttachVolumeNegativeTest-server-1956775684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1956775684',id=44,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIogLPjr6GTN9guqPXvzAMJ94iAoMBaEuGKFjE8An2x1+EURZJ6mreP306LfpqN/pmVZspbRu+x0Q8EgyFsOVgnnQTOzlsFeM53om6hJwbm1SwWkXBOBYHVArXt1zzipnQ==',key_name='tempest-keypair-38166731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5bc7d940cd1410a878ac89e24a4c4bc',ramdisk_id='',reservation_id='r-vwvhulmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1373631227',owner_user_name='tempest-AttachVolumeNegativeTest-1373631227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:31:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e526de0e03140bea2d410f535f75bb7',uuid=adef852b-f515-4cfd-807e-586809ff6aa6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a50854ad-f025-4e0d-b13c-4786568261b1", "address": "fa:16:3e:4e:b4:be", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa50854ad-f0", "ovs_interfaceid": "a50854ad-f025-4e0d-b13c-4786568261b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converting VIF {"id": "a50854ad-f025-4e0d-b13c-4786568261b1", "address": "fa:16:3e:4e:b4:be", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa50854ad-f0", "ovs_interfaceid": "a50854ad-f025-4e0d-b13c-4786568261b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b4:be,bridge_name='br-int',has_traffic_filtering=True,id=a50854ad-f025-4e0d-b13c-4786568261b1,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa50854ad-f0') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.objects.instance [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lazy-loading 'pci_devices' on Instance uuid adef852b-f515-4cfd-807e-586809ff6aa6 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:31:51 user nova-compute[73188]:   <uuid>adef852b-f515-4cfd-807e-586809ff6aa6</uuid>
Aug 15 19:31:51 user nova-compute[73188]:   <name>instance-0000002c</name>
Aug 15 19:31:51 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:31:51 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:31:51 user nova-compute[73188]:   <metadata>
Aug 15 19:31:51 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:31:51 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:31:51 user nova-compute[73188]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1956775684</nova:name>
Aug 15 19:31:51 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:31:51</nova:creationTime>
Aug 15 19:31:51 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:31:51 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:31:51 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:31:51 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:31:51 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:31:51 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:31:51 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:31:51 user nova-compute[73188]:       <nova:owner>
Aug 15 19:31:51 user nova-compute[73188]:         <nova:user uuid="0e526de0e03140bea2d410f535f75bb7">tempest-AttachVolumeNegativeTest-1373631227-project-member</nova:user>
Aug 15 19:31:51 user nova-compute[73188]:         <nova:project uuid="f5bc7d940cd1410a878ac89e24a4c4bc">tempest-AttachVolumeNegativeTest-1373631227</nova:project>
Aug 15 19:31:51 user nova-compute[73188]:       </nova:owner>
Aug 15 19:31:51 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:31:51 user nova-compute[73188]:       <nova:ports>
Aug 15 19:31:51 user nova-compute[73188]:         <nova:port uuid="a50854ad-f025-4e0d-b13c-4786568261b1">
Aug 15 19:31:51 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 19:31:51 user nova-compute[73188]:         </nova:port>
Aug 15 19:31:51 user nova-compute[73188]:       </nova:ports>
Aug 15 19:31:51 user nova-compute[73188]:     </nova:instance>
Aug 15 19:31:51 user nova-compute[73188]:   </metadata>
Aug 15 19:31:51 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:31:51 user nova-compute[73188]:     <system>
Aug 15 19:31:51 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:31:51 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:31:51 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:31:51 user nova-compute[73188]:       <entry name="serial">adef852b-f515-4cfd-807e-586809ff6aa6</entry>
Aug 15 19:31:51 user nova-compute[73188]:       <entry name="uuid">adef852b-f515-4cfd-807e-586809ff6aa6</entry>
Aug 15 19:31:51 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:31:51 user nova-compute[73188]:     </system>
Aug 15 19:31:51 user nova-compute[73188]:   </sysinfo>
Aug 15 19:31:51 user nova-compute[73188]:   <os>
Aug 15 19:31:51 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:31:51 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:31:51 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:31:51 user nova-compute[73188]:   </os>
Aug 15 19:31:51 user nova-compute[73188]:   <features>
Aug 15 19:31:51 user nova-compute[73188]:     <acpi/>
Aug 15 19:31:51 user nova-compute[73188]:     <apic/>
Aug 15 19:31:51 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:31:51 user nova-compute[73188]:   </features>
Aug 15 19:31:51 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:31:51 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:31:51 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:31:51 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:31:51 user nova-compute[73188]:   </clock>
Aug 15 19:31:51 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:31:51 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:31:51 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:31:51 user nova-compute[73188]:   </cpu>
Aug 15 19:31:51 user nova-compute[73188]:   <devices>
Aug 15 19:31:51 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:31:51 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:31:51 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk"/>
Aug 15 19:31:51 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:31:51 user nova-compute[73188]:     </disk>
Aug 15 19:31:51 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:31:51 user nova-compute[73188]:       <mac address="fa:16:3e:4e:b4:be"/>
Aug 15 19:31:51 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:31:51 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:31:51 user nova-compute[73188]:       <target dev="tapa50854ad-f0"/>
Aug 15 19:31:51 user nova-compute[73188]:     </interface>
Aug 15 19:31:51 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:31:51 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/console.log" append="off"/>
Aug 15 19:31:51 user nova-compute[73188]:     </serial>
Aug 15 19:31:51 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:31:51 user nova-compute[73188]:     <video>
Aug 15 19:31:51 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:31:51 user nova-compute[73188]:     </video>
Aug 15 19:31:51 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:31:51 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:31:51 user nova-compute[73188]:     </rng>
Aug 15 19:31:51 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:31:51 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:31:51 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:31:51 user nova-compute[73188]:     </memballoon>
Aug 15 19:31:51 user nova-compute[73188]:   </devices>
Aug 15 19:31:51 user nova-compute[73188]: </domain>
Aug 15 19:31:51 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:31:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1956775684',display_name='tempest-AttachVolumeNegativeTest-server-1956775684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1956775684',id=44,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIogLPjr6GTN9guqPXvzAMJ94iAoMBaEuGKFjE8An2x1+EURZJ6mreP306LfpqN/pmVZspbRu+x0Q8EgyFsOVgnnQTOzlsFeM53om6hJwbm1SwWkXBOBYHVArXt1zzipnQ==',key_name='tempest-keypair-38166731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5bc7d940cd1410a878ac89e24a4c4bc',ramdisk_id='',reservation_id='r-vwvhulmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1373631227',owner_user_name='tempest-AttachVolumeNegativeTest-1373631227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:31:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e526de0e03140bea2d410f535f75bb7',uuid=adef852b-f515-4cfd-807e-586809ff6aa6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a50854ad-f025-4e0d-b13c-4786568261b1", "address": "fa:16:3e:4e:b4:be", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa50854ad-f0", "ovs_interfaceid": "a50854ad-f025-4e0d-b13c-4786568261b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converting VIF {"id": "a50854ad-f025-4e0d-b13c-4786568261b1", "address": "fa:16:3e:4e:b4:be", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa50854ad-f0", "ovs_interfaceid": "a50854ad-f025-4e0d-b13c-4786568261b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b4:be,bridge_name='br-int',has_traffic_filtering=True,id=a50854ad-f025-4e0d-b13c-4786568261b1,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa50854ad-f0') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG os_vif [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b4:be,bridge_name='br-int',has_traffic_filtering=True,id=a50854ad-f025-4e0d-b13c-4786568261b1,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa50854ad-f0') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa50854ad-f0, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa50854ad-f0, col_values=(('external_ids', {'iface-id': 'a50854ad-f025-4e0d-b13c-4786568261b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:b4:be', 'vm-uuid': 'adef852b-f515-4cfd-807e-586809ff6aa6'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:51 user nova-compute[73188]: INFO os_vif [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:b4:be,bridge_name='br-int',has_traffic_filtering=True,id=a50854ad-f025-4e0d-b13c-4786568261b1,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa50854ad-f0')
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] No VIF found with MAC fa:16:3e:4e:b4:be, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.network.neutron [req-b65710d6-fa84-4c6b-849e-05086002366f req-9535bc62-eb02-4475-be6b-e5fcaab27f7c service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Updated VIF entry in instance network info cache for port a50854ad-f025-4e0d-b13c-4786568261b1. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG nova.network.neutron [req-b65710d6-fa84-4c6b-849e-05086002366f req-9535bc62-eb02-4475-be6b-e5fcaab27f7c service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Updating instance_info_cache with network_info: [{"id": "a50854ad-f025-4e0d-b13c-4786568261b1", "address": "fa:16:3e:4e:b4:be", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa50854ad-f0", "ovs_interfaceid": "a50854ad-f025-4e0d-b13c-4786568261b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b65710d6-fa84-4c6b-849e-05086002366f req-9535bc62-eb02-4475-be6b-e5fcaab27f7c service nova] Releasing lock "refresh_cache-adef852b-f515-4cfd-807e-586809ff6aa6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:31:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:53 user nova-compute[73188]: DEBUG nova.compute.manager [req-520f66fb-24f6-4f11-88d8-fe214647045f req-5b9ec66b-4e28-4976-b54a-6df9328034bb service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Received event network-vif-plugged-a50854ad-f025-4e0d-b13c-4786568261b1 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:31:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-520f66fb-24f6-4f11-88d8-fe214647045f req-5b9ec66b-4e28-4976-b54a-6df9328034bb service nova] Acquiring lock "adef852b-f515-4cfd-807e-586809ff6aa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:31:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-520f66fb-24f6-4f11-88d8-fe214647045f req-5b9ec66b-4e28-4976-b54a-6df9328034bb service nova] Lock "adef852b-f515-4cfd-807e-586809ff6aa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:31:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-520f66fb-24f6-4f11-88d8-fe214647045f req-5b9ec66b-4e28-4976-b54a-6df9328034bb service nova] Lock "adef852b-f515-4cfd-807e-586809ff6aa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:31:53 user nova-compute[73188]: DEBUG nova.compute.manager [req-520f66fb-24f6-4f11-88d8-fe214647045f req-5b9ec66b-4e28-4976-b54a-6df9328034bb service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] No waiting events found dispatching network-vif-plugged-a50854ad-f025-4e0d-b13c-4786568261b1 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:31:53 user nova-compute[73188]: WARNING nova.compute.manager [req-520f66fb-24f6-4f11-88d8-fe214647045f req-5b9ec66b-4e28-4976-b54a-6df9328034bb service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Received unexpected event network-vif-plugged-a50854ad-f025-4e0d-b13c-4786568261b1 for instance with vm_state building and task_state spawning.
Aug 15 19:31:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:55 user nova-compute[73188]: DEBUG nova.compute.manager [req-c52b637b-2c51-46ec-a40a-e8d86e822192 req-e575e067-956a-4bb9-9b64-54aba48d7a78 service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Received event network-vif-plugged-a50854ad-f025-4e0d-b13c-4786568261b1 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:31:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c52b637b-2c51-46ec-a40a-e8d86e822192 req-e575e067-956a-4bb9-9b64-54aba48d7a78 service nova] Acquiring lock "adef852b-f515-4cfd-807e-586809ff6aa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:31:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c52b637b-2c51-46ec-a40a-e8d86e822192 req-e575e067-956a-4bb9-9b64-54aba48d7a78 service nova] Lock "adef852b-f515-4cfd-807e-586809ff6aa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:31:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c52b637b-2c51-46ec-a40a-e8d86e822192 req-e575e067-956a-4bb9-9b64-54aba48d7a78 service nova] Lock "adef852b-f515-4cfd-807e-586809ff6aa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:31:55 user nova-compute[73188]: DEBUG nova.compute.manager [req-c52b637b-2c51-46ec-a40a-e8d86e822192 req-e575e067-956a-4bb9-9b64-54aba48d7a78 service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] No waiting events found dispatching network-vif-plugged-a50854ad-f025-4e0d-b13c-4786568261b1 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:31:55 user nova-compute[73188]: WARNING nova.compute.manager [req-c52b637b-2c51-46ec-a40a-e8d86e822192 req-e575e067-956a-4bb9-9b64-54aba48d7a78 service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Received unexpected event network-vif-plugged-a50854ad-f025-4e0d-b13c-4786568261b1 for instance with vm_state building and task_state spawning.
Aug 15 19:31:55 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127915.3457763, adef852b-f515-4cfd-807e-586809ff6aa6 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:31:55 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] VM Resumed (Lifecycle Event)
Aug 15 19:31:55 user nova-compute[73188]: DEBUG nova.compute.manager [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:31:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:31:55 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Instance spawned successfully.
Aug 15 19:31:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:31:55 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:31:55 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:31:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:31:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:31:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:31:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:31:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:31:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:31:55 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:31:55 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692127915.3474216, adef852b-f515-4cfd-807e-586809ff6aa6 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:31:55 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] VM Started (Lifecycle Event)
Aug 15 19:31:55 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:31:55 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:31:55 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:31:55 user nova-compute[73188]: INFO nova.compute.manager [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Took 5.75 seconds to spawn the instance on the hypervisor.
Aug 15 19:31:55 user nova-compute[73188]: DEBUG nova.compute.manager [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:31:55 user nova-compute[73188]: INFO nova.compute.manager [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Took 6.67 seconds to build instance.
Aug 15 19:31:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-802d31c2-cebf-4c3d-b1a4-fd414e78722d tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "adef852b-f515-4cfd-807e-586809ff6aa6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.777s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:31:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:31:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-42facfba-1556-4f5b-aa6c-083cf305b25b req-ce3adae2-3041-4efb-aad9-04483b21cc66 service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Received event network-changed-34c74787-4e7e-4c3a-b084-7ccf460a65f8 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:31:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-42facfba-1556-4f5b-aa6c-083cf305b25b req-ce3adae2-3041-4efb-aad9-04483b21cc66 service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Refreshing instance network info cache due to event network-changed-34c74787-4e7e-4c3a-b084-7ccf460a65f8. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:31:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-42facfba-1556-4f5b-aa6c-083cf305b25b req-ce3adae2-3041-4efb-aad9-04483b21cc66 service nova] Acquiring lock "refresh_cache-c696f77d-eb36-426f-a86d-26bfca9a1918" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:31:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-42facfba-1556-4f5b-aa6c-083cf305b25b req-ce3adae2-3041-4efb-aad9-04483b21cc66 service nova] Acquired lock "refresh_cache-c696f77d-eb36-426f-a86d-26bfca9a1918" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:31:58 user nova-compute[73188]: DEBUG nova.network.neutron [req-42facfba-1556-4f5b-aa6c-083cf305b25b req-ce3adae2-3041-4efb-aad9-04483b21cc66 service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Refreshing network info cache for port 34c74787-4e7e-4c3a-b084-7ccf460a65f8 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG nova.network.neutron [req-42facfba-1556-4f5b-aa6c-083cf305b25b req-ce3adae2-3041-4efb-aad9-04483b21cc66 service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Updated VIF entry in instance network info cache for port 34c74787-4e7e-4c3a-b084-7ccf460a65f8. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG nova.network.neutron [req-42facfba-1556-4f5b-aa6c-083cf305b25b req-ce3adae2-3041-4efb-aad9-04483b21cc66 service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Updating instance_info_cache with network_info: [{"id": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "address": "fa:16:3e:48:2b:43", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c74787-4e", "ovs_interfaceid": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "c696f77d-eb36-426f-a86d-26bfca9a1918" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "c696f77d-eb36-426f-a86d-26bfca9a1918" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-42facfba-1556-4f5b-aa6c-083cf305b25b req-ce3adae2-3041-4efb-aad9-04483b21cc66 service nova] Releasing lock "refresh_cache-c696f77d-eb36-426f-a86d-26bfca9a1918" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG nova.objects.instance [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lazy-loading 'flavor' on Instance uuid c696f77d-eb36-426f-a86d-26bfca9a1918 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "c696f77d-eb36-426f-a86d-26bfca9a1918" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "c696f77d-eb36-426f-a86d-26bfca9a1918" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "c696f77d-eb36-426f-a86d-26bfca9a1918" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:31:59 user nova-compute[73188]: INFO nova.compute.manager [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Attaching volume 4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 to /dev/vdb
Aug 15 19:31:59 user nova-compute[73188]: DEBUG os_brick.utils [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[118a857c-4a32-49a2-8828-e39d0edb460b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4549f670-35ba-4716-bbda-1df54063d84e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c3eb6d-8471-4277-bc51-5ceca2c64d97]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d8d709-1dd6-468e-897f-c9beb593659d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:31:59 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:31:59 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[751cd8e0-f592-4639-9712-e0596c8ad614]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG os_brick.utils [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:31:59 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Updating existing volume attachment record: f7d171bd-c311-40f0-b65b-7ff905176e05 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:32:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TPnxefSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:32:08 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:32:08 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:32:08 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59f9a46-5a07-433b-85fd-f55c8a02d110]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:32:08 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecf1282-d32e-4c41-8460-693ed302f4a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9] added
Aug 15 19:32:08 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[687bff6c-53e7-496c-90d1-9a264cbe495b]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9462a4db-c33f-4e03-975c-4dfbf18cb2cc]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TPnxefSH {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TPnxefSH" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f01f7e1-9981-479b-99dd-71b2ff7af55c]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TPnxefSH'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[404d832b-1ca0-4763-bcc4-741b02e763ea]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bac8ba8-1c20-4401-abdb-ea644512ab7a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 19:32:08 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 19:32:08 user nova-compute[73188]:  {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:32:08 user nova-compute[73188]: WARNING os_brick.initiator.connectors.iscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 19:32:08 user nova-compute[73188]: 
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b64c068-a9dd-4f49-93fc-dd027d6ce66b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9, portal: 172.16.0.220,3260]
Aug 15 19:32:08 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9, portal: 172.16.0.220,3260] successful.
Aug 15 19:32:08 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52b1cb0-c79b-4ddb-b70a-91c7bc04e4a7]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ccc5d8-d576-4c64-b900-bc1814d26b73]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 (non-flash)
Aug 15 19:32:08 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 (non-flash)
Aug 15 19:32:08 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbfc5e9-58c5-4487-938f-f6f8e888b9ee]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:32:08 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TPnxefSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:32:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:32:09 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23533366430333966', 'path': '/dev/sdb'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:32:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533366430333966', 'path': '/dev/sdb'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:32:09 user nova-compute[73188]: DEBUG nova.objects.instance [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lazy-loading 'flavor' on Instance uuid c696f77d-eb36-426f-a86d-26bfca9a1918 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:32:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:32:10 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:32:10 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:32:10 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:32:10 user nova-compute[73188]:   <serial>4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9</serial>
Aug 15 19:32:10 user nova-compute[73188]: </disk>
Aug 15 19:32:10 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:32:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:32:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:32:10 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] No VIF found with MAC fa:16:3e:48:2b:43, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:32:10 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-cbad4b09-05d1-4aef-b23f-531b803257f6 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "c696f77d-eb36-426f-a86d-26bfca9a1918" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.221s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:32:11 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "c696f77d-eb36-426f-a86d-26bfca9a1918" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "c696f77d-eb36-426f-a86d-26bfca9a1918" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:32:13 user nova-compute[73188]: INFO nova.compute.manager [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Detaching volume 4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9
Aug 15 19:32:13 user nova-compute[73188]: INFO nova.virt.block_device [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Attempting to driver detach volume 4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 from mountpoint /dev/vdb
Aug 15 19:32:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Attempting to detach device vdb from instance c696f77d-eb36-426f-a86d-26bfca9a1918 from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:32:13 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:32:13 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:32:13 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:32:13 user nova-compute[73188]:   <serial>4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9</serial>
Aug 15 19:32:13 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:32:13 user nova-compute[73188]: </disk>
Aug 15 19:32:13 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:32:13 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Successfully detached device vdb from instance c696f77d-eb36-426f-a86d-26bfca9a1918 from the persistent domain config.
Aug 15 19:32:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c696f77d-eb36-426f-a86d-26bfca9a1918 from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:32:13 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:32:13 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:32:13 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:32:13 user nova-compute[73188]:   <serial>4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9</serial>
Aug 15 19:32:13 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:32:13 user nova-compute[73188]: </disk>
Aug 15 19:32:13 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692127933.7381039, c696f77d-eb36-426f-a86d-26bfca9a1918 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c696f77d-eb36-426f-a86d-26bfca9a1918 {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:32:13 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Successfully detached device vdb from instance c696f77d-eb36-426f-a86d-26bfca9a1918 from the live domain config.
Aug 15 19:32:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TPnxefSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:32:13 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:32:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a88b46-3f37-48c9-94a4-503622721b0f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b2b7ef-0e1f-478b-8040-10b6c545683a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 (non-flash)
Aug 15 19:32:13 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 (non-flash)
Aug 15 19:32:13 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e47e5510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9'): ({'sdb'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Removing single pathed devices sdb {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2292ad82-8435-4822-bf74-f5add38c658e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d1379e-0313-41a4-896c-3069e5e26275]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Flushing IO for device /dev/sdb {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bbb0e4-5c88-4328-83ec-b6967d609792]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[05009e94-6528-4bbd-8d77-5baecde8f2e1]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f7da77-456e-4c4f-999d-e01141b51c3b]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[200895fe-f2a7-43f3-8ab4-9064130a2bdb]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9, portal: 172.16.0.220,3260]
Aug 15 19:32:13 user nova-compute[73188]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9, portal: 172.16.0.220,3260] successful.
Aug 15 19:32:13 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:32:13 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ea9a5b9-8f4f-41b4-9b92-e15d0eaf5be9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9270b7db-c35f-4d38-8ab0-aa8218986f04]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:32:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:32:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:32:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] <== disconnect_volume: return (269ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:32:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:32:14 user nova-compute[73188]: DEBUG nova.objects.instance [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lazy-loading 'flavor' on Instance uuid c696f77d-eb36-426f-a86d-26bfca9a1918 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:32:14 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_power_states {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:32:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ddb4a4c6-2cd0-4a86-8de3-324c4ed4a94c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "c696f77d-eb36-426f-a86d-26bfca9a1918" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.674s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:32:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid 18846be1-6828-4182-9285-12a40ecd41b1 {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:32:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid c696f77d-eb36-426f-a86d-26bfca9a1918 {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:32:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid adef852b-f515-4cfd-807e-586809ff6aa6 {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:32:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "18846be1-6828-4182-9285-12a40ecd41b1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:32:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "18846be1-6828-4182-9285-12a40ecd41b1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:32:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "c696f77d-eb36-426f-a86d-26bfca9a1918" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:32:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "c696f77d-eb36-426f-a86d-26bfca9a1918" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:32:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "adef852b-f515-4cfd-807e-586809ff6aa6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:32:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "adef852b-f515-4cfd-807e-586809ff6aa6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:32:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "18846be1-6828-4182-9285-12a40ecd41b1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:32:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "c696f77d-eb36-426f-a86d-26bfca9a1918" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:32:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "adef852b-f515-4cfd-807e-586809ff6aa6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:32:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:26 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:32:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:32 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:32:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "18846be1-6828-4182-9285-12a40ecd41b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:32:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "18846be1-6828-4182-9285-12a40ecd41b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:32:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "18846be1-6828-4182-9285-12a40ecd41b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:32:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "18846be1-6828-4182-9285-12a40ecd41b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:32:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "18846be1-6828-4182-9285-12a40ecd41b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:32:32 user nova-compute[73188]: INFO nova.compute.manager [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Terminating instance
Aug 15 19:32:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG nova.compute.manager [req-4a1be436-fdbe-4bd9-bea3-1c5f95e639a1 req-c5252138-ec39-4b70-9af2-cb6b2ec9483b service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Received event network-vif-unplugged-0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4a1be436-fdbe-4bd9-bea3-1c5f95e639a1 req-c5252138-ec39-4b70-9af2-cb6b2ec9483b service nova] Acquiring lock "18846be1-6828-4182-9285-12a40ecd41b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4a1be436-fdbe-4bd9-bea3-1c5f95e639a1 req-c5252138-ec39-4b70-9af2-cb6b2ec9483b service nova] Lock "18846be1-6828-4182-9285-12a40ecd41b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4a1be436-fdbe-4bd9-bea3-1c5f95e639a1 req-c5252138-ec39-4b70-9af2-cb6b2ec9483b service nova] Lock "18846be1-6828-4182-9285-12a40ecd41b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG nova.compute.manager [req-4a1be436-fdbe-4bd9-bea3-1c5f95e639a1 req-c5252138-ec39-4b70-9af2-cb6b2ec9483b service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] No waiting events found dispatching network-vif-unplugged-0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG nova.compute.manager [req-4a1be436-fdbe-4bd9-bea3-1c5f95e639a1 req-c5252138-ec39-4b70-9af2-cb6b2ec9483b service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Received event network-vif-unplugged-0338047a-ec92-4e13-8b39-95d1feedd2ba for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:32:33 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Instance destroyed successfully.
Aug 15 19:32:33 user nova-compute[73188]: DEBUG nova.objects.instance [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'resources' on Instance uuid 18846be1-6828-4182-9285-12a40ecd41b1 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T19:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-134988234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-134988234',id=39,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzhzrPYTstDFJPRT2CNxzjEcWo8QkZkkQu0rijNzdeU9mLcgs9nv11HKnQZj+hbSx336GiMjlVjxornF/lx6nVpFTcoPy+i149zVtWOmKxbXBVb/jnZeNzmGFLeJ6tPJA==',key_name='tempest-keypair-353430524',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:30:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='409362f6976b454ba96b7580b35db949',ramdisk_id='',reservation_id='r-3p2mm8lv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1675372664',owner_user_name='tempest-AttachVolumeShelveTestJSON-1675372664-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:30:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7df4b06e72a452ca1dd4643694ce570',uuid=18846be1-6828-4182-9285-12a40ecd41b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0338047a-ec", "ovs_interfaceid": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converting VIF {"id": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "address": "fa:16:3e:0f:0a:75", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0338047a-ec", "ovs_interfaceid": "0338047a-ec92-4e13-8b39-95d1feedd2ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:0a:75,bridge_name='br-int',has_traffic_filtering=True,id=0338047a-ec92-4e13-8b39-95d1feedd2ba,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0338047a-ec') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG os_vif [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:0a:75,bridge_name='br-int',has_traffic_filtering=True,id=0338047a-ec92-4e13-8b39-95d1feedd2ba,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0338047a-ec') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0338047a-ec, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:32:33 user nova-compute[73188]: INFO os_vif [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:0a:75,bridge_name='br-int',has_traffic_filtering=True,id=0338047a-ec92-4e13-8b39-95d1feedd2ba,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0338047a-ec')
Aug 15 19:32:33 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Deleting instance files /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1_del
Aug 15 19:32:33 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Deletion of /opt/stack/data/nova/instances/18846be1-6828-4182-9285-12a40ecd41b1_del complete
Aug 15 19:32:33 user nova-compute[73188]: INFO nova.compute.manager [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 15 19:32:33 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-c696f77d-eb36-426f-a86d-26bfca9a1918" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-c696f77d-eb36-426f-a86d-26bfca9a1918" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:32:33 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:32:34 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Updating instance_info_cache with network_info: [{"id": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "address": "fa:16:3e:48:2b:43", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c74787-4e", "ovs_interfaceid": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:32:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-c696f77d-eb36-426f-a86d-26bfca9a1918" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:32:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:32:34 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:32:34 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:32:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-f943ea6c-7a79-4b7a-bf6f-ae272709a663 req-c843ae11-9a8c-4abf-8728-bd7ba641834e service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Received event network-vif-plugged-0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:32:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f943ea6c-7a79-4b7a-bf6f-ae272709a663 req-c843ae11-9a8c-4abf-8728-bd7ba641834e service nova] Acquiring lock "18846be1-6828-4182-9285-12a40ecd41b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:32:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f943ea6c-7a79-4b7a-bf6f-ae272709a663 req-c843ae11-9a8c-4abf-8728-bd7ba641834e service nova] Lock "18846be1-6828-4182-9285-12a40ecd41b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:32:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f943ea6c-7a79-4b7a-bf6f-ae272709a663 req-c843ae11-9a8c-4abf-8728-bd7ba641834e service nova] Lock "18846be1-6828-4182-9285-12a40ecd41b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:32:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-f943ea6c-7a79-4b7a-bf6f-ae272709a663 req-c843ae11-9a8c-4abf-8728-bd7ba641834e service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] No waiting events found dispatching network-vif-plugged-0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:32:35 user nova-compute[73188]: WARNING nova.compute.manager [req-f943ea6c-7a79-4b7a-bf6f-ae272709a663 req-c843ae11-9a8c-4abf-8728-bd7ba641834e service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Received unexpected event network-vif-plugged-0338047a-ec92-4e13-8b39-95d1feedd2ba for instance with vm_state active and task_state deleting.
Aug 15 19:32:35 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:32:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-d296a549-8e58-46a8-bc19-398440e7ad2d req-52d80c09-f9e1-427a-a6fd-18a74f2898c2 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Received event network-vif-deleted-0338047a-ec92-4e13-8b39-95d1feedd2ba {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:32:35 user nova-compute[73188]: INFO nova.compute.manager [req-d296a549-8e58-46a8-bc19-398440e7ad2d req-52d80c09-f9e1-427a-a6fd-18a74f2898c2 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Neutron deleted interface 0338047a-ec92-4e13-8b39-95d1feedd2ba; detaching it from the instance and deleting it from the info cache
Aug 15 19:32:35 user nova-compute[73188]: DEBUG nova.network.neutron [req-d296a549-8e58-46a8-bc19-398440e7ad2d req-52d80c09-f9e1-427a-a6fd-18a74f2898c2 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:32:35 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Took 1.72 seconds to deallocate network for instance.
Aug 15 19:32:35 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:32:35 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:32:35 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:32:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-d296a549-8e58-46a8-bc19-398440e7ad2d req-52d80c09-f9e1-427a-a6fd-18a74f2898c2 service nova] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Detach interface failed, port_id=0338047a-ec92-4e13-8b39-95d1feedd2ba, reason: Instance 18846be1-6828-4182-9285-12a40ecd41b1 could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:32:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:32:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:32:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:32:35 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:32:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:32:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:32:35 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:35 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:32:35 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:32:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:32:35 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Deleted allocations for instance 18846be1-6828-4182-9285-12a40ecd41b1
Aug 15 19:32:35 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:35 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ce53dbbd-2aed-4cd5-ba0d-1b161004a24d tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "18846be1-6828-4182-9285-12a40ecd41b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.999s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:32:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:32:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:32:36 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:32:36 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:32:36 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8426MB free_disk=25.292232513427734GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:32:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:32:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:32:37 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance c696f77d-eb36-426f-a86d-26bfca9a1918 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:32:37 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance adef852b-f515-4cfd-807e-586809ff6aa6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:32:37 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:32:37 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:32:37 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:32:37 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:32:37 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:32:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:32:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:41 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:32:41 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:32:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:48 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692127953.7236943, 18846be1-6828-4182-9285-12a40ecd41b1 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:32:48 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] VM Stopped (Lifecycle Event)
Aug 15 19:32:48 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b9ca742a-8f79-4f21-a6c3-0e0b0a3dde26 None None] [instance: 18846be1-6828-4182-9285-12a40ecd41b1] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:32:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:32:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:33:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquiring lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:03 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:33:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:03 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:33:03 user nova-compute[73188]: INFO nova.compute.claims [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Claim successful on node user
Aug 15 19:33:04 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.281s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:33:04 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:33:04 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:33:04 user nova-compute[73188]: INFO nova.virt.block_device [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Booting with volume 1c52c974-f228-478e-8933-e1769a2d67a3 at /dev/vda
Aug 15 19:33:04 user nova-compute[73188]: DEBUG nova.policy [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd432668099f24666a003c56ec5ca4001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e83dc2ac5e4beb9043d1539bba6ddb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG os_brick.utils [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20087d1-9b17-4115-ba58-9794a4e1ef9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d0c4f6-1a5d-48e7-a876-624c47fb1a4f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e71507a-f2a3-48c0-993e-66ebabe9cd09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0b2529-fe02-47e1-a8ac-1ca9e105b852]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:33:04 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:33:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[454fda71-6cc2-42c7-a6ca-19bfbe51f3c7]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG os_brick.utils [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:33:04 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Updating existing volume attachment record: ff58cb78-0b4a-4e13-80c2-45c43c5ba166 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:33:05 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Successfully created port: 14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:33:06 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Successfully updated port: 14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:33:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquiring lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:33:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquired lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:33:06 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:33:06 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:33:06 user nova-compute[73188]: DEBUG nova.compute.manager [req-0b206da2-0633-4264-b7ce-dc5f53901050 req-ac640140-3935-4fc7-b6bf-80a277b17201 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Received event network-changed-14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:33:06 user nova-compute[73188]: DEBUG nova.compute.manager [req-0b206da2-0633-4264-b7ce-dc5f53901050 req-ac640140-3935-4fc7-b6bf-80a277b17201 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Refreshing instance network info cache due to event network-changed-14f35d48-3eee-47e2-84b7-d5805df1d826. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:33:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0b206da2-0633-4264-b7ce-dc5f53901050 req-ac640140-3935-4fc7-b6bf-80a277b17201 service nova] Acquiring lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:33:06 user nova-compute[73188]: DEBUG nova.network.neutron [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Updating instance_info_cache with network_info: [{"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f35d48-3e", "ovs_interfaceid": "14f35d48-3eee-47e2-84b7-d5805df1d826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:33:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Releasing lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:33:06 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Instance network_info: |[{"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f35d48-3e", "ovs_interfaceid": "14f35d48-3eee-47e2-84b7-d5805df1d826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:33:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0b206da2-0633-4264-b7ce-dc5f53901050 req-ac640140-3935-4fc7-b6bf-80a277b17201 service nova] Acquired lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:33:06 user nova-compute[73188]: DEBUG nova.network.neutron [req-0b206da2-0633-4264-b7ce-dc5f53901050 req-ac640140-3935-4fc7-b6bf-80a277b17201 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Refreshing network info cache for port 14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:33:06 user nova-compute[73188]: DEBUG nova.network.neutron [req-0b206da2-0633-4264-b7ce-dc5f53901050 req-ac640140-3935-4fc7-b6bf-80a277b17201 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Updated VIF entry in instance network info cache for port 14f35d48-3eee-47e2-84b7-d5805df1d826. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:33:06 user nova-compute[73188]: DEBUG nova.network.neutron [req-0b206da2-0633-4264-b7ce-dc5f53901050 req-ac640140-3935-4fc7-b6bf-80a277b17201 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Updating instance_info_cache with network_info: [{"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f35d48-3e", "ovs_interfaceid": "14f35d48-3eee-47e2-84b7-d5805df1d826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:33:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-0b206da2-0633-4264-b7ce-dc5f53901050 req-ac640140-3935-4fc7-b6bf-80a277b17201 service nova] Releasing lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:33:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:11 user nova-compute[73188]: DEBUG nova.compute.manager [None req-d79ca14e-d463-4a1e-87b4-0f3b87e51c85 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:33:11 user nova-compute[73188]: INFO nova.compute.manager [None req-d79ca14e-d463-4a1e-87b4-0f3b87e51c85 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] instance snapshotting
Aug 15 19:33:11 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-d79ca14e-d463-4a1e-87b4-0f3b87e51c85 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Beginning live snapshot process
Aug 15 19:33:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-d79ca14e-d463-4a1e-87b4-0f3b87e51c85 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json -f qcow2 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-d79ca14e-d463-4a1e-87b4-0f3b87e51c85 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json -f qcow2" returned: 0 in 0.223s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-d79ca14e-d463-4a1e-87b4-0f3b87e51c85 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json -f qcow2 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-d79ca14e-d463-4a1e-87b4-0f3b87e51c85 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json -f qcow2" returned: 0 in 0.217s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-d79ca14e-d463-4a1e-87b4-0f3b87e51c85 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-d79ca14e-d463-4a1e-87b4-0f3b87e51c85 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.260s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-d79ca14e-d463-4a1e-87b4-0f3b87e51c85 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp226sfiuk/208e0679e61e4b7fbcd674bce2fc05fa.delta 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-d79ca14e-d463-4a1e-87b4-0f3b87e51c85 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp226sfiuk/208e0679e61e4b7fbcd674bce2fc05fa.delta 1073741824" returned: 0 in 0.059s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:12 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-d79ca14e-d463-4a1e-87b4-0f3b87e51c85 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 19:33:13 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-d79ca14e-d463-4a1e-87b4-0f3b87e51c85 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73188) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 19:33:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:33:14 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Creating image(s)
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Did not create local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Ensure instance console log exists: /opt/stack/data/nova/instances/6e48fce8-e4d4-4e30-a67e-5d81036b14cc/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Start _get_guest_xml network_info=[{"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f35d48-3e", "ovs_interfaceid": "14f35d48-3eee-47e2-84b7-d5805df1d826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jEJQyGcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6e48fce8-e4d4-4e30-a67e-5d81036b14cc', 'attached_at': '', 'detached_at': '', 'volume_id': '1c52c974-f228-478e-8933-e1769a2d67a3', 'serial': '1c52c974-f228-478e-8933-e1769a2d67a3'}, 'attachment_id': 'ff58cb78-0b4a-4e13-80c2-45c43c5ba166', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-d79ca14e-d463-4a1e-87b4-0f3b87e51c85 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73188) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 19:33:14 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-d79ca14e-d463-4a1e-87b4-0f3b87e51c85 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 19:33:14 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:33:14 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jEJQyGcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:33:14 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:33:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:33:14 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:33:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:33:14 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3214fe-861e-4274-afa2-85d2c8f3d50c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:33:14 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG nova.privsep.utils [None req-d79ca14e-d463-4a1e-87b4-0f3b87e51c85 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73188) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-d79ca14e-d463-4a1e-87b4-0f3b87e51c85 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp226sfiuk/208e0679e61e4b7fbcd674bce2fc05fa.delta /opt/stack/data/nova/instances/snapshots/tmp226sfiuk/208e0679e61e4b7fbcd674bce2fc05fa {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3b79e4-44df-4c7e-b2e2-f15ac63cc188]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3] added
Aug 15 19:33:14 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adbcbc1-c4a7-4b3c-9cb2-34b162d08239]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6f381b-a331-41e6-8617-a316b6a80139]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jEJQyGcB {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jEJQyGcB" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[573287f8-26fa-4828-9c9b-09cd62ca865e]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jEJQyGcB'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc756b0-29ed-4542-953a-4d69b27ac76e]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.079s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c9c239-04c3-477d-8015-0bfc6fa90659]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 19:33:14 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 19:33:14 user nova-compute[73188]:  {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:33:14 user nova-compute[73188]: WARNING os_brick.initiator.connectors.iscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 19:33:14 user nova-compute[73188]: 
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:14 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-d79ca14e-d463-4a1e-87b4-0f3b87e51c85 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp226sfiuk/208e0679e61e4b7fbcd674bce2fc05fa.delta /opt/stack/data/nova/instances/snapshots/tmp226sfiuk/208e0679e61e4b7fbcd674bce2fc05fa" returned: 0 in 0.565s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:14 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-d79ca14e-d463-4a1e-87b4-0f3b87e51c85 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Snapshot extracted, beginning image upload
Aug 15 19:33:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --login" returned: 0 in 1.048s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1152d9-74ba-4700-9cd2-a21bd6b2dfe0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3, portal: 172.16.0.220,3260]
Aug 15 19:33:15 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3, portal: 172.16.0.220,3260] successful.
Aug 15 19:33:15 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:33:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[625b1488-a33e-4a34-be9a-d4c29b7d85d4]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:33:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[096b84db-ad52-43ba-960c-b2b30a27efa5]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 (non-flash)
Aug 15 19:33:15 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:33:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 (non-flash)
Aug 15 19:33:15 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:33:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.393s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:33:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:33:15 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:33:15 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:33:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:15 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:15 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc63755-046f-4b88-a43c-dd85675acba3]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:15 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:33:15 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jEJQyGcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:33:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.431s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:33:16 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] <== connect_volume: return (2433ms) {'type': 'block', 'scsi_wwn': '26436326339623365', 'path': '/dev/sdb'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:33:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436326339623365', 'path': '/dev/sdb'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:33:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2091190492',display_name='tempest-TestShelveInstance-server-2091190492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2091190492',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPz6u2nYKHQFAzYTyRfEeG06JbJBrTKBAcp90LkXrGpbDb7LTDjsVtedLmtluIbnn4t0KMbFAZIEu7pwAqVfeTIXG4MwAsMd5VwhFHLOWX5ycW/llYPoLXd8JAdz8j5jNA==',key_name='tempest-TestShelveInstance-1880994155',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6e83dc2ac5e4beb9043d1539bba6ddb',ramdisk_id='',reservation_id='r-a5dttlzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-704396217',owner_user_name='tempest-TestShelveInstance-704396217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:33:04Z,user_data=None,user_id='d432668099f24666a003c56ec5ca4001',uuid=6e48fce8-e4d4-4e30-a67e-5d81036b14cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f35d48-3e", "ovs_interfaceid": "14f35d48-3eee-47e2-84b7-d5805df1d826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:33:16 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Converting VIF {"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f35d48-3e", "ovs_interfaceid": "14f35d48-3eee-47e2-84b7-d5805df1d826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:33:16 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:4e:1a,bridge_name='br-int',has_traffic_filtering=True,id=14f35d48-3eee-47e2-84b7-d5805df1d826,network=Network(943da617-81f7-4b12-8278-0ce36f9f1d20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f35d48-3e') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:33:16 user nova-compute[73188]: DEBUG nova.objects.instance [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e48fce8-e4d4-4e30-a67e-5d81036b14cc {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:33:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:33:16 user nova-compute[73188]:   <uuid>6e48fce8-e4d4-4e30-a67e-5d81036b14cc</uuid>
Aug 15 19:33:16 user nova-compute[73188]:   <name>instance-0000002d</name>
Aug 15 19:33:16 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:33:16 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:33:16 user nova-compute[73188]:   <metadata>
Aug 15 19:33:16 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:33:16 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:33:16 user nova-compute[73188]:       <nova:name>tempest-TestShelveInstance-server-2091190492</nova:name>
Aug 15 19:33:16 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:33:14</nova:creationTime>
Aug 15 19:33:16 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:33:16 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:33:16 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:33:16 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:33:16 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:33:16 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:33:16 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:33:16 user nova-compute[73188]:       <nova:owner>
Aug 15 19:33:16 user nova-compute[73188]:         <nova:user uuid="d432668099f24666a003c56ec5ca4001">tempest-TestShelveInstance-704396217-project-member</nova:user>
Aug 15 19:33:16 user nova-compute[73188]:         <nova:project uuid="b6e83dc2ac5e4beb9043d1539bba6ddb">tempest-TestShelveInstance-704396217</nova:project>
Aug 15 19:33:16 user nova-compute[73188]:       </nova:owner>
Aug 15 19:33:16 user nova-compute[73188]:       <nova:ports>
Aug 15 19:33:16 user nova-compute[73188]:         <nova:port uuid="14f35d48-3eee-47e2-84b7-d5805df1d826">
Aug 15 19:33:16 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 19:33:16 user nova-compute[73188]:         </nova:port>
Aug 15 19:33:16 user nova-compute[73188]:       </nova:ports>
Aug 15 19:33:16 user nova-compute[73188]:     </nova:instance>
Aug 15 19:33:16 user nova-compute[73188]:   </metadata>
Aug 15 19:33:16 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:33:16 user nova-compute[73188]:     <system>
Aug 15 19:33:16 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:33:16 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:33:16 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:33:16 user nova-compute[73188]:       <entry name="serial">6e48fce8-e4d4-4e30-a67e-5d81036b14cc</entry>
Aug 15 19:33:16 user nova-compute[73188]:       <entry name="uuid">6e48fce8-e4d4-4e30-a67e-5d81036b14cc</entry>
Aug 15 19:33:16 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:33:16 user nova-compute[73188]:     </system>
Aug 15 19:33:16 user nova-compute[73188]:   </sysinfo>
Aug 15 19:33:16 user nova-compute[73188]:   <os>
Aug 15 19:33:16 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:33:16 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:33:16 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:33:16 user nova-compute[73188]:   </os>
Aug 15 19:33:16 user nova-compute[73188]:   <features>
Aug 15 19:33:16 user nova-compute[73188]:     <acpi/>
Aug 15 19:33:16 user nova-compute[73188]:     <apic/>
Aug 15 19:33:16 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:33:16 user nova-compute[73188]:   </features>
Aug 15 19:33:16 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:33:16 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:33:16 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:33:16 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:33:16 user nova-compute[73188]:   </clock>
Aug 15 19:33:16 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:33:16 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:33:16 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:33:16 user nova-compute[73188]:   </cpu>
Aug 15 19:33:16 user nova-compute[73188]:   <devices>
Aug 15 19:33:16 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:33:16 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:33:16 user nova-compute[73188]:       <source dev="/dev/sdb"/>
Aug 15 19:33:16 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:33:16 user nova-compute[73188]:       <serial>1c52c974-f228-478e-8933-e1769a2d67a3</serial>
Aug 15 19:33:16 user nova-compute[73188]:     </disk>
Aug 15 19:33:16 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:33:16 user nova-compute[73188]:       <mac address="fa:16:3e:17:4e:1a"/>
Aug 15 19:33:16 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:33:16 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:33:16 user nova-compute[73188]:       <target dev="tap14f35d48-3e"/>
Aug 15 19:33:16 user nova-compute[73188]:     </interface>
Aug 15 19:33:16 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:33:16 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/6e48fce8-e4d4-4e30-a67e-5d81036b14cc/console.log" append="off"/>
Aug 15 19:33:16 user nova-compute[73188]:     </serial>
Aug 15 19:33:16 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:33:16 user nova-compute[73188]:     <video>
Aug 15 19:33:16 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:33:16 user nova-compute[73188]:     </video>
Aug 15 19:33:16 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:33:16 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:33:16 user nova-compute[73188]:     </rng>
Aug 15 19:33:16 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:33:16 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:33:16 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:33:16 user nova-compute[73188]:     </memballoon>
Aug 15 19:33:16 user nova-compute[73188]:   </devices>
Aug 15 19:33:16 user nova-compute[73188]: </domain>
Aug 15 19:33:16 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:33:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2091190492',display_name='tempest-TestShelveInstance-server-2091190492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2091190492',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPz6u2nYKHQFAzYTyRfEeG06JbJBrTKBAcp90LkXrGpbDb7LTDjsVtedLmtluIbnn4t0KMbFAZIEu7pwAqVfeTIXG4MwAsMd5VwhFHLOWX5ycW/llYPoLXd8JAdz8j5jNA==',key_name='tempest-TestShelveInstance-1880994155',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6e83dc2ac5e4beb9043d1539bba6ddb',ramdisk_id='',reservation_id='r-a5dttlzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-704396217',owner_user_name='tempest-TestShelveInstance-704396217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:33:04Z,user_data=None,user_id='d432668099f24666a003c56ec5ca4001',uuid=6e48fce8-e4d4-4e30-a67e-5d81036b14cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f35d48-3e", "ovs_interfaceid": "14f35d48-3eee-47e2-84b7-d5805df1d826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:33:16 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Converting VIF {"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f35d48-3e", "ovs_interfaceid": "14f35d48-3eee-47e2-84b7-d5805df1d826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:33:16 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:4e:1a,bridge_name='br-int',has_traffic_filtering=True,id=14f35d48-3eee-47e2-84b7-d5805df1d826,network=Network(943da617-81f7-4b12-8278-0ce36f9f1d20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f35d48-3e') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:33:16 user nova-compute[73188]: DEBUG os_vif [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:4e:1a,bridge_name='br-int',has_traffic_filtering=True,id=14f35d48-3eee-47e2-84b7-d5805df1d826,network=Network(943da617-81f7-4b12-8278-0ce36f9f1d20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f35d48-3e') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:33:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:33:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:33:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14f35d48-3e, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:33:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap14f35d48-3e, col_values=(('external_ids', {'iface-id': '14f35d48-3eee-47e2-84b7-d5805df1d826', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:4e:1a', 'vm-uuid': '6e48fce8-e4d4-4e30-a67e-5d81036b14cc'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:33:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:33:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:16 user nova-compute[73188]: INFO os_vif [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:4e:1a,bridge_name='br-int',has_traffic_filtering=True,id=14f35d48-3eee-47e2-84b7-d5805df1d826,network=Network(943da617-81f7-4b12-8278-0ce36f9f1d20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f35d48-3e')
Aug 15 19:33:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:33:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] No VIF found with MAC fa:16:3e:17:4e:1a, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:33:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:17 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-d79ca14e-d463-4a1e-87b4-0f3b87e51c85 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Snapshot image upload complete
Aug 15 19:33:17 user nova-compute[73188]: INFO nova.compute.manager [None req-d79ca14e-d463-4a1e-87b4-0f3b87e51c85 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Took 5.50 seconds to snapshot the instance on the hypervisor.
Aug 15 19:33:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:18 user nova-compute[73188]: DEBUG nova.compute.manager [req-9cc585d7-77aa-40ec-9086-4354dcb8681a req-d3cc00c2-a026-4683-abbd-3f484a518823 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Received event network-vif-plugged-14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:33:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9cc585d7-77aa-40ec-9086-4354dcb8681a req-d3cc00c2-a026-4683-abbd-3f484a518823 service nova] Acquiring lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9cc585d7-77aa-40ec-9086-4354dcb8681a req-d3cc00c2-a026-4683-abbd-3f484a518823 service nova] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-9cc585d7-77aa-40ec-9086-4354dcb8681a req-d3cc00c2-a026-4683-abbd-3f484a518823 service nova] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:18 user nova-compute[73188]: DEBUG nova.compute.manager [req-9cc585d7-77aa-40ec-9086-4354dcb8681a req-d3cc00c2-a026-4683-abbd-3f484a518823 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] No waiting events found dispatching network-vif-plugged-14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:33:18 user nova-compute[73188]: WARNING nova.compute.manager [req-9cc585d7-77aa-40ec-9086-4354dcb8681a req-d3cc00c2-a026-4683-abbd-3f484a518823 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Received unexpected event network-vif-plugged-14f35d48-3eee-47e2-84b7-d5805df1d826 for instance with vm_state building and task_state spawning.
Aug 15 19:33:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:19 user nova-compute[73188]: DEBUG nova.compute.manager [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:33:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:19 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:33:19 user nova-compute[73188]: INFO nova.compute.claims [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Claim successful on node user
Aug 15 19:33:19 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:33:19 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:33:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.261s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:19 user nova-compute[73188]: DEBUG nova.compute.manager [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:33:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:33:20 user nova-compute[73188]: DEBUG nova.network.neutron [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:33:20 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:33:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:33:20 user nova-compute[73188]: DEBUG nova.policy [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae2fd38dc21248609f17533079193d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffec07b2185b4bd4a14793f9885a43d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:33:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:33:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:33:20 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Creating image(s)
Aug 15 19:33:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "/opt/stack/data/nova/instances/2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "/opt/stack/data/nova/instances/2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "93ca97421fd098913012c3c919b10b322a7860f5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "93ca97421fd098913012c3c919b10b322a7860f5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:20 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692128000.2126393, 6e48fce8-e4d4-4e30-a67e-5d81036b14cc => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:33:20 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] VM Resumed (Lifecycle Event)
Aug 15 19:33:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:33:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:33:20 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Instance spawned successfully.
Aug 15 19:33:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:33:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:33:20 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:33:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:33:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:33:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:33:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:33:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:33:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:33:20 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:33:20 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692128000.2138216, 6e48fce8-e4d4-4e30-a67e-5d81036b14cc => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:33:20 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] VM Started (Lifecycle Event)
Aug 15 19:33:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93ca97421fd098913012c3c919b10b322a7860f5.part --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:21 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:33:21 user nova-compute[73188]: INFO nova.compute.manager [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Took 7.21 seconds to spawn the instance on the hypervisor.
Aug 15 19:33:21 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:33:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-3e87821a-29c6-4215-ad9c-2b02940f0f71 req-8d500797-50cd-49d6-bc41-2ec845bb7c61 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Received event network-vif-plugged-14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:33:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3e87821a-29c6-4215-ad9c-2b02940f0f71 req-8d500797-50cd-49d6-bc41-2ec845bb7c61 service nova] Acquiring lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3e87821a-29c6-4215-ad9c-2b02940f0f71 req-8d500797-50cd-49d6-bc41-2ec845bb7c61 service nova] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3e87821a-29c6-4215-ad9c-2b02940f0f71 req-8d500797-50cd-49d6-bc41-2ec845bb7c61 service nova] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-3e87821a-29c6-4215-ad9c-2b02940f0f71 req-8d500797-50cd-49d6-bc41-2ec845bb7c61 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] No waiting events found dispatching network-vif-plugged-14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:33:21 user nova-compute[73188]: WARNING nova.compute.manager [req-3e87821a-29c6-4215-ad9c-2b02940f0f71 req-8d500797-50cd-49d6-bc41-2ec845bb7c61 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Received unexpected event network-vif-plugged-14f35d48-3eee-47e2-84b7-d5805df1d826 for instance with vm_state building and task_state spawning.
Aug 15 19:33:21 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:33:21 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:33:21 user nova-compute[73188]: INFO nova.compute.manager [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Took 17.51 seconds to build instance.
Aug 15 19:33:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93ca97421fd098913012c3c919b10b322a7860f5.part --force-share --output=json" returned: 0 in 0.209s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:21 user nova-compute[73188]: DEBUG nova.virt.images [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] 552a0088-c6d2-4131-b4b9-d9d08f18e66a was qcow2, converting to raw {{(pid=73188) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 19:33:21 user nova-compute[73188]: DEBUG nova.privsep.utils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73188) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 19:33:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/93ca97421fd098913012c3c919b10b322a7860f5.part /opt/stack/data/nova/instances/_base/93ca97421fd098913012c3c919b10b322a7860f5.converted {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ada85e97-b588-4f18-98ad-09249945d16d tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.682s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:21 user nova-compute[73188]: DEBUG nova.network.neutron [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Successfully created port: 45104cfc-4a0b-4de5-bdd2-406a908a4de4 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:33:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/93ca97421fd098913012c3c919b10b322a7860f5.part /opt/stack/data/nova/instances/_base/93ca97421fd098913012c3c919b10b322a7860f5.converted" returned: 0 in 0.962s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93ca97421fd098913012c3c919b10b322a7860f5.converted --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93ca97421fd098913012c3c919b10b322a7860f5.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "93ca97421fd098913012c3c919b10b322a7860f5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.445s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93ca97421fd098913012c3c919b10b322a7860f5 --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:22 user nova-compute[73188]: DEBUG nova.network.neutron [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Successfully updated port: 45104cfc-4a0b-4de5-bdd2-406a908a4de4 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:33:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "refresh_cache-2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:33:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquired lock "refresh_cache-2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:33:22 user nova-compute[73188]: DEBUG nova.network.neutron [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:33:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-1f562bb6-e2f1-4df3-9d70-2101f2366399 req-04328b0c-e1e3-4035-9867-ac48b594daa5 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Received event network-changed-45104cfc-4a0b-4de5-bdd2-406a908a4de4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:33:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-1f562bb6-e2f1-4df3-9d70-2101f2366399 req-04328b0c-e1e3-4035-9867-ac48b594daa5 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Refreshing instance network info cache due to event network-changed-45104cfc-4a0b-4de5-bdd2-406a908a4de4. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:33:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1f562bb6-e2f1-4df3-9d70-2101f2366399 req-04328b0c-e1e3-4035-9867-ac48b594daa5 service nova] Acquiring lock "refresh_cache-2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:33:22 user nova-compute[73188]: DEBUG nova.network.neutron [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:33:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93ca97421fd098913012c3c919b10b322a7860f5 --force-share --output=json" returned: 0 in 0.198s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "93ca97421fd098913012c3c919b10b322a7860f5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "93ca97421fd098913012c3c919b10b322a7860f5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93ca97421fd098913012c3c919b10b322a7860f5 --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93ca97421fd098913012c3c919b10b322a7860f5 --force-share --output=json" returned: 0 in 0.204s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93ca97421fd098913012c3c919b10b322a7860f5,backing_fmt=raw /opt/stack/data/nova/instances/2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93ca97421fd098913012c3c919b10b322a7860f5,backing_fmt=raw /opt/stack/data/nova/instances/2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d/disk 1073741824" returned: 0 in 0.054s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "93ca97421fd098913012c3c919b10b322a7860f5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93ca97421fd098913012c3c919b10b322a7860f5 --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.network.neutron [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Updating instance_info_cache with network_info: [{"id": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "address": "fa:16:3e:65:2d:cb", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45104cfc-4a", "ovs_interfaceid": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Releasing lock "refresh_cache-2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.compute.manager [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Instance network_info: |[{"id": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "address": "fa:16:3e:65:2d:cb", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45104cfc-4a", "ovs_interfaceid": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1f562bb6-e2f1-4df3-9d70-2101f2366399 req-04328b0c-e1e3-4035-9867-ac48b594daa5 service nova] Acquired lock "refresh_cache-2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.network.neutron [req-1f562bb6-e2f1-4df3-9d70-2101f2366399 req-04328b0c-e1e3-4035-9867-ac48b594daa5 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Refreshing network info cache for port 45104cfc-4a0b-4de5-bdd2-406a908a4de4 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93ca97421fd098913012c3c919b10b322a7860f5 --force-share --output=json" returned: 0 in 0.209s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.objects.instance [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lazy-loading 'migration_context' on Instance uuid 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Ensure instance console log exists: /opt/stack/data/nova/instances/2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Start _get_guest_xml network_info=[{"id": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "address": "fa:16:3e:65:2d:cb", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45104cfc-4a", "ovs_interfaceid": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b87c440c1619e7cabefa5ec465a15157',container_format='bare',created_at=2023-08-15T19:33:12Z,direct_url=<?>,disk_format='qcow2',id=552a0088-c6d2-4131-b4b9-d9d08f18e66a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2127473580',owner='ffec07b2185b4bd4a14793f9885a43d0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T19:33:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': '552a0088-c6d2-4131-b4b9-d9d08f18e66a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:33:23 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:33:23 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b87c440c1619e7cabefa5ec465a15157',container_format='bare',created_at=2023-08-15T19:33:12Z,direct_url=<?>,disk_format='qcow2',id=552a0088-c6d2-4131-b4b9-d9d08f18e66a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2127473580',owner='ffec07b2185b4bd4a14793f9885a43d0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T19:33:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:33:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-216469633',display_name='tempest-TestStampPattern-server-216469633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-216469633',id=46,image_ref='552a0088-c6d2-4131-b4b9-d9d08f18e66a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPttPXTMMfrjFLW7G+VtG1rMa5FI1ksBOcYrsCtyrYTreKkrGoeDmah2iW0MvYJZ2Kgf5QUOX0XjOu9+OQOllEXo6T6FtGW/D6IrYtS7SxmNxxryUDEUap8dr1QEagH2lQ==',key_name='tempest-TestStampPattern-390215866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ffec07b2185b4bd4a14793f9885a43d0',ramdisk_id='',reservation_id='r-hdb2wrz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c696f77d-eb36-426f-a86d-26bfca9a1918',image_min_disk='1',image_min_ram='0',image_owner_id='ffec07b2185b4bd4a14793f9885a43d0',image_owner_project_name='tempest-TestStampPattern-1547019054',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1547019054-project-member',image_user_id='ae2fd38dc21248609f17533079193d2d',network_allocated='True',owner_project_name='tempest-TestStampPattern-1547019054',owner_user_name='tempest-TestStampPattern-1547019054-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:33:20Z,user_data=None,user_id='ae2fd38dc21248609f17533079193d2d',uuid=2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "address": "fa:16:3e:65:2d:cb", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45104cfc-4a", "ovs_interfaceid": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Converting VIF {"id": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "address": "fa:16:3e:65:2d:cb", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45104cfc-4a", "ovs_interfaceid": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:2d:cb,bridge_name='br-int',has_traffic_filtering=True,id=45104cfc-4a0b-4de5-bdd2-406a908a4de4,network=Network(e3f0d46e-35ab-4b09-ac9d-ee8728aa820a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45104cfc-4a') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.objects.instance [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:33:23 user nova-compute[73188]:   <uuid>2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d</uuid>
Aug 15 19:33:23 user nova-compute[73188]:   <name>instance-0000002e</name>
Aug 15 19:33:23 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:33:23 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:33:23 user nova-compute[73188]:   <metadata>
Aug 15 19:33:23 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:33:23 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:33:23 user nova-compute[73188]:       <nova:name>tempest-TestStampPattern-server-216469633</nova:name>
Aug 15 19:33:23 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:33:23</nova:creationTime>
Aug 15 19:33:23 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:33:23 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:33:23 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:33:23 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:33:23 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:33:23 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:33:23 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:33:23 user nova-compute[73188]:       <nova:owner>
Aug 15 19:33:23 user nova-compute[73188]:         <nova:user uuid="ae2fd38dc21248609f17533079193d2d">tempest-TestStampPattern-1547019054-project-member</nova:user>
Aug 15 19:33:23 user nova-compute[73188]:         <nova:project uuid="ffec07b2185b4bd4a14793f9885a43d0">tempest-TestStampPattern-1547019054</nova:project>
Aug 15 19:33:23 user nova-compute[73188]:       </nova:owner>
Aug 15 19:33:23 user nova-compute[73188]:       <nova:root type="image" uuid="552a0088-c6d2-4131-b4b9-d9d08f18e66a"/>
Aug 15 19:33:23 user nova-compute[73188]:       <nova:ports>
Aug 15 19:33:23 user nova-compute[73188]:         <nova:port uuid="45104cfc-4a0b-4de5-bdd2-406a908a4de4">
Aug 15 19:33:23 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 19:33:23 user nova-compute[73188]:         </nova:port>
Aug 15 19:33:23 user nova-compute[73188]:       </nova:ports>
Aug 15 19:33:23 user nova-compute[73188]:     </nova:instance>
Aug 15 19:33:23 user nova-compute[73188]:   </metadata>
Aug 15 19:33:23 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:33:23 user nova-compute[73188]:     <system>
Aug 15 19:33:23 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:33:23 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:33:23 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:33:23 user nova-compute[73188]:       <entry name="serial">2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d</entry>
Aug 15 19:33:23 user nova-compute[73188]:       <entry name="uuid">2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d</entry>
Aug 15 19:33:23 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:33:23 user nova-compute[73188]:     </system>
Aug 15 19:33:23 user nova-compute[73188]:   </sysinfo>
Aug 15 19:33:23 user nova-compute[73188]:   <os>
Aug 15 19:33:23 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:33:23 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:33:23 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:33:23 user nova-compute[73188]:   </os>
Aug 15 19:33:23 user nova-compute[73188]:   <features>
Aug 15 19:33:23 user nova-compute[73188]:     <acpi/>
Aug 15 19:33:23 user nova-compute[73188]:     <apic/>
Aug 15 19:33:23 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:33:23 user nova-compute[73188]:   </features>
Aug 15 19:33:23 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:33:23 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:33:23 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:33:23 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:33:23 user nova-compute[73188]:   </clock>
Aug 15 19:33:23 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:33:23 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:33:23 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:33:23 user nova-compute[73188]:   </cpu>
Aug 15 19:33:23 user nova-compute[73188]:   <devices>
Aug 15 19:33:23 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:33:23 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:33:23 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d/disk"/>
Aug 15 19:33:23 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:33:23 user nova-compute[73188]:     </disk>
Aug 15 19:33:23 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:33:23 user nova-compute[73188]:       <mac address="fa:16:3e:65:2d:cb"/>
Aug 15 19:33:23 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:33:23 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:33:23 user nova-compute[73188]:       <target dev="tap45104cfc-4a"/>
Aug 15 19:33:23 user nova-compute[73188]:     </interface>
Aug 15 19:33:23 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:33:23 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d/console.log" append="off"/>
Aug 15 19:33:23 user nova-compute[73188]:     </serial>
Aug 15 19:33:23 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:33:23 user nova-compute[73188]:     <video>
Aug 15 19:33:23 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:33:23 user nova-compute[73188]:     </video>
Aug 15 19:33:23 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:33:23 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:33:23 user nova-compute[73188]:     </rng>
Aug 15 19:33:23 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:33:23 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:33:23 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:33:23 user nova-compute[73188]:     </memballoon>
Aug 15 19:33:23 user nova-compute[73188]:   </devices>
Aug 15 19:33:23 user nova-compute[73188]: </domain>
Aug 15 19:33:23 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:33:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-216469633',display_name='tempest-TestStampPattern-server-216469633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-216469633',id=46,image_ref='552a0088-c6d2-4131-b4b9-d9d08f18e66a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPttPXTMMfrjFLW7G+VtG1rMa5FI1ksBOcYrsCtyrYTreKkrGoeDmah2iW0MvYJZ2Kgf5QUOX0XjOu9+OQOllEXo6T6FtGW/D6IrYtS7SxmNxxryUDEUap8dr1QEagH2lQ==',key_name='tempest-TestStampPattern-390215866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ffec07b2185b4bd4a14793f9885a43d0',ramdisk_id='',reservation_id='r-hdb2wrz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c696f77d-eb36-426f-a86d-26bfca9a1918',image_min_disk='1',image_min_ram='0',image_owner_id='ffec07b2185b4bd4a14793f9885a43d0',image_owner_project_name='tempest-TestStampPattern-1547019054',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1547019054-project-member',image_user_id='ae2fd38dc21248609f17533079193d2d',network_allocated='True',owner_project_name='tempest-TestStampPattern-1547019054',owner_user_name='tempest-TestStampPattern-1547019054-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:33:20Z,user_data=None,user_id='ae2fd38dc21248609f17533079193d2d',uuid=2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "address": "fa:16:3e:65:2d:cb", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45104cfc-4a", "ovs_interfaceid": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Converting VIF {"id": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "address": "fa:16:3e:65:2d:cb", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45104cfc-4a", "ovs_interfaceid": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:2d:cb,bridge_name='br-int',has_traffic_filtering=True,id=45104cfc-4a0b-4de5-bdd2-406a908a4de4,network=Network(e3f0d46e-35ab-4b09-ac9d-ee8728aa820a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45104cfc-4a') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG os_vif [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:2d:cb,bridge_name='br-int',has_traffic_filtering=True,id=45104cfc-4a0b-4de5-bdd2-406a908a4de4,network=Network(e3f0d46e-35ab-4b09-ac9d-ee8728aa820a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45104cfc-4a') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45104cfc-4a, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap45104cfc-4a, col_values=(('external_ids', {'iface-id': '45104cfc-4a0b-4de5-bdd2-406a908a4de4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:2d:cb', 'vm-uuid': '2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:23 user nova-compute[73188]: INFO os_vif [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:2d:cb,bridge_name='br-int',has_traffic_filtering=True,id=45104cfc-4a0b-4de5-bdd2-406a908a4de4,network=Network(e3f0d46e-35ab-4b09-ac9d-ee8728aa820a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45104cfc-4a')
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] No VIF found with MAC fa:16:3e:65:2d:cb, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.network.neutron [req-1f562bb6-e2f1-4df3-9d70-2101f2366399 req-04328b0c-e1e3-4035-9867-ac48b594daa5 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Updated VIF entry in instance network info cache for port 45104cfc-4a0b-4de5-bdd2-406a908a4de4. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG nova.network.neutron [req-1f562bb6-e2f1-4df3-9d70-2101f2366399 req-04328b0c-e1e3-4035-9867-ac48b594daa5 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Updating instance_info_cache with network_info: [{"id": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "address": "fa:16:3e:65:2d:cb", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45104cfc-4a", "ovs_interfaceid": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:33:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1f562bb6-e2f1-4df3-9d70-2101f2366399 req-04328b0c-e1e3-4035-9867-ac48b594daa5 service nova] Releasing lock "refresh_cache-2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:33:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:25 user nova-compute[73188]: DEBUG nova.compute.manager [req-18d4a630-6be4-4d59-83d8-99f55e0a3322 req-c8ff78db-0553-414c-b743-04d13bac36d0 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Received event network-vif-plugged-45104cfc-4a0b-4de5-bdd2-406a908a4de4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:33:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-18d4a630-6be4-4d59-83d8-99f55e0a3322 req-c8ff78db-0553-414c-b743-04d13bac36d0 service nova] Acquiring lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-18d4a630-6be4-4d59-83d8-99f55e0a3322 req-c8ff78db-0553-414c-b743-04d13bac36d0 service nova] Lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-18d4a630-6be4-4d59-83d8-99f55e0a3322 req-c8ff78db-0553-414c-b743-04d13bac36d0 service nova] Lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:25 user nova-compute[73188]: DEBUG nova.compute.manager [req-18d4a630-6be4-4d59-83d8-99f55e0a3322 req-c8ff78db-0553-414c-b743-04d13bac36d0 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] No waiting events found dispatching network-vif-plugged-45104cfc-4a0b-4de5-bdd2-406a908a4de4 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:33:25 user nova-compute[73188]: WARNING nova.compute.manager [req-18d4a630-6be4-4d59-83d8-99f55e0a3322 req-c8ff78db-0553-414c-b743-04d13bac36d0 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Received unexpected event network-vif-plugged-45104cfc-4a0b-4de5-bdd2-406a908a4de4 for instance with vm_state building and task_state spawning.
Aug 15 19:33:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:27 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692128007.206488, 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:33:27 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] VM Resumed (Lifecycle Event)
Aug 15 19:33:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:33:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:33:27 user nova-compute[73188]: DEBUG nova.compute.manager [req-4e2e8ff2-3905-4479-acde-919fd0027422 req-2acef009-23ed-4bd4-ac6f-5fd05779cd12 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Received event network-vif-plugged-45104cfc-4a0b-4de5-bdd2-406a908a4de4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:33:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4e2e8ff2-3905-4479-acde-919fd0027422 req-2acef009-23ed-4bd4-ac6f-5fd05779cd12 service nova] Acquiring lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4e2e8ff2-3905-4479-acde-919fd0027422 req-2acef009-23ed-4bd4-ac6f-5fd05779cd12 service nova] Lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4e2e8ff2-3905-4479-acde-919fd0027422 req-2acef009-23ed-4bd4-ac6f-5fd05779cd12 service nova] Lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:27 user nova-compute[73188]: DEBUG nova.compute.manager [req-4e2e8ff2-3905-4479-acde-919fd0027422 req-2acef009-23ed-4bd4-ac6f-5fd05779cd12 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] No waiting events found dispatching network-vif-plugged-45104cfc-4a0b-4de5-bdd2-406a908a4de4 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:33:27 user nova-compute[73188]: WARNING nova.compute.manager [req-4e2e8ff2-3905-4479-acde-919fd0027422 req-2acef009-23ed-4bd4-ac6f-5fd05779cd12 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Received unexpected event network-vif-plugged-45104cfc-4a0b-4de5-bdd2-406a908a4de4 for instance with vm_state building and task_state spawning.
Aug 15 19:33:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:33:27 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Instance spawned successfully.
Aug 15 19:33:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:33:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:33:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:33:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:33:27 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:33:27 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692128007.206753, 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:33:27 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] VM Started (Lifecycle Event)
Aug 15 19:33:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:33:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:33:27 user nova-compute[73188]: INFO nova.compute.manager [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Took 7.18 seconds to spawn the instance on the hypervisor.
Aug 15 19:33:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:33:27 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:33:27 user nova-compute[73188]: INFO nova.compute.manager [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Took 8.07 seconds to build instance.
Aug 15 19:33:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-4d67f47d-986d-441c-b667-ca50ffdcc70c tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.205s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "1c992ecd-ac21-44e7-937c-b19028cc95c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:33:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:33:28 user nova-compute[73188]: INFO nova.compute.claims [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Claim successful on node user
Aug 15 19:33:28 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:33:28 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:33:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:28 user nova-compute[73188]: DEBUG nova.compute.manager [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:33:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:28 user nova-compute[73188]: DEBUG nova.compute.manager [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:33:28 user nova-compute[73188]: DEBUG nova.network.neutron [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:33:28 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:33:28 user nova-compute[73188]: DEBUG nova.compute.manager [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:33:28 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:33:28 user nova-compute[73188]: DEBUG nova.policy [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7df4b06e72a452ca1dd4643694ce570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409362f6976b454ba96b7580b35db949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:33:28 user nova-compute[73188]: DEBUG nova.compute.manager [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:33:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:33:28 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Creating image(s)
Aug 15 19:33:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "/opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "/opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.210s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:28 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.218s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk 1073741824" returned: 0 in 0.053s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.216s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:29 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:33:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:29 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Cannot resize image /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:33:29 user nova-compute[73188]: DEBUG nova.objects.instance [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'migration_context' on Instance uuid 1c992ecd-ac21-44e7-937c-b19028cc95c2 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:33:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:33:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Ensure instance console log exists: /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:33:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:29 user nova-compute[73188]: DEBUG nova.network.neutron [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Successfully created port: 17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.network.neutron [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Successfully updated port: 17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquired lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.network.neutron [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.compute.manager [req-4230456f-b974-4f54-878b-435732ef3ec4 req-558ecd78-b453-4cf4-b5ab-cad8c219d928 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Received event network-changed-17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.compute.manager [req-4230456f-b974-4f54-878b-435732ef3ec4 req-558ecd78-b453-4cf4-b5ab-cad8c219d928 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Refreshing instance network info cache due to event network-changed-17fa5237-0a8d-4f42-956d-d4a9732b4539. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4230456f-b974-4f54-878b-435732ef3ec4 req-558ecd78-b453-4cf4-b5ab-cad8c219d928 service nova] Acquiring lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.network.neutron [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.network.neutron [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Updating instance_info_cache with network_info: [{"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fa5237-0a", "ovs_interfaceid": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Releasing lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.compute.manager [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Instance network_info: |[{"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fa5237-0a", "ovs_interfaceid": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4230456f-b974-4f54-878b-435732ef3ec4 req-558ecd78-b453-4cf4-b5ab-cad8c219d928 service nova] Acquired lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.network.neutron [req-4230456f-b974-4f54-878b-435732ef3ec4 req-558ecd78-b453-4cf4-b5ab-cad8c219d928 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Refreshing network info cache for port 17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Start _get_guest_xml network_info=[{"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fa5237-0a", "ovs_interfaceid": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:33:30 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:33:30 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:33:30 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:33:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-899178377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-899178377',id=47,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJWfFiblUIxO45fvcHFyaFxnFyqoFEPiOpvAeB5891ntCBT24TtXi1NaeFYPpa1oVaW8yMFBytF1mLakrHIeM0NduhCTsFyJXwHHx4r86jNa94MH9PX63//JN20aalewA==',key_name='tempest-keypair-1267490924',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='409362f6976b454ba96b7580b35db949',ramdisk_id='',reservation_id='r-0uo6aeyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1675372664',owner_user_name='tempest-AttachVolumeShelveTestJSON-1675372664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:33:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7df4b06e72a452ca1dd4643694ce570',uuid=1c992ecd-ac21-44e7-937c-b19028cc95c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fa5237-0a", "ovs_interfaceid": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:33:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converting VIF {"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fa5237-0a", "ovs_interfaceid": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:33:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:d4:70,bridge_name='br-int',has_traffic_filtering=True,id=17fa5237-0a8d-4f42-956d-d4a9732b4539,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fa5237-0a') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:33:31 user nova-compute[73188]: DEBUG nova.objects.instance [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c992ecd-ac21-44e7-937c-b19028cc95c2 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:33:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:33:31 user nova-compute[73188]:   <uuid>1c992ecd-ac21-44e7-937c-b19028cc95c2</uuid>
Aug 15 19:33:31 user nova-compute[73188]:   <name>instance-0000002f</name>
Aug 15 19:33:31 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:33:31 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:33:31 user nova-compute[73188]:   <metadata>
Aug 15 19:33:31 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:33:31 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:33:31 user nova-compute[73188]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-899178377</nova:name>
Aug 15 19:33:31 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:33:30</nova:creationTime>
Aug 15 19:33:31 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:33:31 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:33:31 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:33:31 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:33:31 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:33:31 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:33:31 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:33:31 user nova-compute[73188]:       <nova:owner>
Aug 15 19:33:31 user nova-compute[73188]:         <nova:user uuid="e7df4b06e72a452ca1dd4643694ce570">tempest-AttachVolumeShelveTestJSON-1675372664-project-member</nova:user>
Aug 15 19:33:31 user nova-compute[73188]:         <nova:project uuid="409362f6976b454ba96b7580b35db949">tempest-AttachVolumeShelveTestJSON-1675372664</nova:project>
Aug 15 19:33:31 user nova-compute[73188]:       </nova:owner>
Aug 15 19:33:31 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:33:31 user nova-compute[73188]:       <nova:ports>
Aug 15 19:33:31 user nova-compute[73188]:         <nova:port uuid="17fa5237-0a8d-4f42-956d-d4a9732b4539">
Aug 15 19:33:31 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 19:33:31 user nova-compute[73188]:         </nova:port>
Aug 15 19:33:31 user nova-compute[73188]:       </nova:ports>
Aug 15 19:33:31 user nova-compute[73188]:     </nova:instance>
Aug 15 19:33:31 user nova-compute[73188]:   </metadata>
Aug 15 19:33:31 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:33:31 user nova-compute[73188]:     <system>
Aug 15 19:33:31 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:33:31 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:33:31 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:33:31 user nova-compute[73188]:       <entry name="serial">1c992ecd-ac21-44e7-937c-b19028cc95c2</entry>
Aug 15 19:33:31 user nova-compute[73188]:       <entry name="uuid">1c992ecd-ac21-44e7-937c-b19028cc95c2</entry>
Aug 15 19:33:31 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:33:31 user nova-compute[73188]:     </system>
Aug 15 19:33:31 user nova-compute[73188]:   </sysinfo>
Aug 15 19:33:31 user nova-compute[73188]:   <os>
Aug 15 19:33:31 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:33:31 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:33:31 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:33:31 user nova-compute[73188]:   </os>
Aug 15 19:33:31 user nova-compute[73188]:   <features>
Aug 15 19:33:31 user nova-compute[73188]:     <acpi/>
Aug 15 19:33:31 user nova-compute[73188]:     <apic/>
Aug 15 19:33:31 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:33:31 user nova-compute[73188]:   </features>
Aug 15 19:33:31 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:33:31 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:33:31 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:33:31 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:33:31 user nova-compute[73188]:   </clock>
Aug 15 19:33:31 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:33:31 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:33:31 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:33:31 user nova-compute[73188]:   </cpu>
Aug 15 19:33:31 user nova-compute[73188]:   <devices>
Aug 15 19:33:31 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:33:31 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:33:31 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk"/>
Aug 15 19:33:31 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:33:31 user nova-compute[73188]:     </disk>
Aug 15 19:33:31 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:33:31 user nova-compute[73188]:       <mac address="fa:16:3e:7f:d4:70"/>
Aug 15 19:33:31 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:33:31 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:33:31 user nova-compute[73188]:       <target dev="tap17fa5237-0a"/>
Aug 15 19:33:31 user nova-compute[73188]:     </interface>
Aug 15 19:33:31 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:33:31 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/console.log" append="off"/>
Aug 15 19:33:31 user nova-compute[73188]:     </serial>
Aug 15 19:33:31 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:33:31 user nova-compute[73188]:     <video>
Aug 15 19:33:31 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:33:31 user nova-compute[73188]:     </video>
Aug 15 19:33:31 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:33:31 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:33:31 user nova-compute[73188]:     </rng>
Aug 15 19:33:31 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:33:31 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:33:31 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:33:31 user nova-compute[73188]:     </memballoon>
Aug 15 19:33:31 user nova-compute[73188]:   </devices>
Aug 15 19:33:31 user nova-compute[73188]: </domain>
Aug 15 19:33:31 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:33:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-899178377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-899178377',id=47,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJWfFiblUIxO45fvcHFyaFxnFyqoFEPiOpvAeB5891ntCBT24TtXi1NaeFYPpa1oVaW8yMFBytF1mLakrHIeM0NduhCTsFyJXwHHx4r86jNa94MH9PX63//JN20aalewA==',key_name='tempest-keypair-1267490924',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='409362f6976b454ba96b7580b35db949',ramdisk_id='',reservation_id='r-0uo6aeyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1675372664',owner_user_name='tempest-AttachVolumeShelveTestJSON-1675372664-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:33:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7df4b06e72a452ca1dd4643694ce570',uuid=1c992ecd-ac21-44e7-937c-b19028cc95c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fa5237-0a", "ovs_interfaceid": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:33:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converting VIF {"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fa5237-0a", "ovs_interfaceid": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:33:31 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:d4:70,bridge_name='br-int',has_traffic_filtering=True,id=17fa5237-0a8d-4f42-956d-d4a9732b4539,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fa5237-0a') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:33:31 user nova-compute[73188]: DEBUG os_vif [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:d4:70,bridge_name='br-int',has_traffic_filtering=True,id=17fa5237-0a8d-4f42-956d-d4a9732b4539,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fa5237-0a') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:33:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:33:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:33:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17fa5237-0a, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:33:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap17fa5237-0a, col_values=(('external_ids', {'iface-id': '17fa5237-0a8d-4f42-956d-d4a9732b4539', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:d4:70', 'vm-uuid': '1c992ecd-ac21-44e7-937c-b19028cc95c2'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:33:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:33:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:31 user nova-compute[73188]: INFO os_vif [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:d4:70,bridge_name='br-int',has_traffic_filtering=True,id=17fa5237-0a8d-4f42-956d-d4a9732b4539,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fa5237-0a')
Aug 15 19:33:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:33:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] No VIF found with MAC fa:16:3e:7f:d4:70, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:33:31 user nova-compute[73188]: DEBUG nova.network.neutron [req-4230456f-b974-4f54-878b-435732ef3ec4 req-558ecd78-b453-4cf4-b5ab-cad8c219d928 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Updated VIF entry in instance network info cache for port 17fa5237-0a8d-4f42-956d-d4a9732b4539. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:33:31 user nova-compute[73188]: DEBUG nova.network.neutron [req-4230456f-b974-4f54-878b-435732ef3ec4 req-558ecd78-b453-4cf4-b5ab-cad8c219d928 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Updating instance_info_cache with network_info: [{"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fa5237-0a", "ovs_interfaceid": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:33:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-4230456f-b974-4f54-878b-435732ef3ec4 req-558ecd78-b453-4cf4-b5ab-cad8c219d928 service nova] Releasing lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:33:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:32 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:33:32 user nova-compute[73188]: DEBUG nova.compute.manager [req-97fd5cfe-6cb6-4334-b6de-e708de336727 req-84ecf085-2853-47ac-8291-ff620dc34736 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Received event network-vif-plugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:33:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-97fd5cfe-6cb6-4334-b6de-e708de336727 req-84ecf085-2853-47ac-8291-ff620dc34736 service nova] Acquiring lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-97fd5cfe-6cb6-4334-b6de-e708de336727 req-84ecf085-2853-47ac-8291-ff620dc34736 service nova] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-97fd5cfe-6cb6-4334-b6de-e708de336727 req-84ecf085-2853-47ac-8291-ff620dc34736 service nova] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:32 user nova-compute[73188]: DEBUG nova.compute.manager [req-97fd5cfe-6cb6-4334-b6de-e708de336727 req-84ecf085-2853-47ac-8291-ff620dc34736 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] No waiting events found dispatching network-vif-plugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:33:32 user nova-compute[73188]: WARNING nova.compute.manager [req-97fd5cfe-6cb6-4334-b6de-e708de336727 req-84ecf085-2853-47ac-8291-ff620dc34736 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Received unexpected event network-vif-plugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 for instance with vm_state building and task_state spawning.
Aug 15 19:33:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:33 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:33:34 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:33:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:33:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:33:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Skipping network cache update for instance because it is Building. {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 19:33:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-c696f77d-eb36-426f-a86d-26bfca9a1918" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:33:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-c696f77d-eb36-426f-a86d-26bfca9a1918" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:33:34 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:33:34 user nova-compute[73188]: DEBUG nova.objects.instance [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lazy-loading 'info_cache' on Instance uuid c696f77d-eb36-426f-a86d-26bfca9a1918 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:33:34 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692128014.9492302, 1c992ecd-ac21-44e7-937c-b19028cc95c2 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:33:34 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] VM Resumed (Lifecycle Event)
Aug 15 19:33:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:33:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:33:34 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Instance spawned successfully.
Aug 15 19:33:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:33:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:33:34 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:33:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:33:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:33:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:33:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:33:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:33:34 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:33:35 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:33:35 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692128014.9523177, 1c992ecd-ac21-44e7-937c-b19028cc95c2 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:33:35 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] VM Started (Lifecycle Event)
Aug 15 19:33:35 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:33:35 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:33:35 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:33:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-c7725b67-26f0-4598-964a-a62786678cb1 req-f9b3abae-5e21-4991-9f16-1b509f5eadae service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Received event network-vif-plugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:33:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c7725b67-26f0-4598-964a-a62786678cb1 req-f9b3abae-5e21-4991-9f16-1b509f5eadae service nova] Acquiring lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c7725b67-26f0-4598-964a-a62786678cb1 req-f9b3abae-5e21-4991-9f16-1b509f5eadae service nova] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c7725b67-26f0-4598-964a-a62786678cb1 req-f9b3abae-5e21-4991-9f16-1b509f5eadae service nova] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:35 user nova-compute[73188]: DEBUG nova.compute.manager [req-c7725b67-26f0-4598-964a-a62786678cb1 req-f9b3abae-5e21-4991-9f16-1b509f5eadae service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] No waiting events found dispatching network-vif-plugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:33:35 user nova-compute[73188]: WARNING nova.compute.manager [req-c7725b67-26f0-4598-964a-a62786678cb1 req-f9b3abae-5e21-4991-9f16-1b509f5eadae service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Received unexpected event network-vif-plugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 for instance with vm_state building and task_state spawning.
Aug 15 19:33:35 user nova-compute[73188]: INFO nova.compute.manager [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Took 6.68 seconds to spawn the instance on the hypervisor.
Aug 15 19:33:35 user nova-compute[73188]: DEBUG nova.compute.manager [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:33:35 user nova-compute[73188]: INFO nova.compute.manager [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Took 7.48 seconds to build instance.
Aug 15 19:33:35 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Updating instance_info_cache with network_info: [{"id": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "address": "fa:16:3e:48:2b:43", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c74787-4e", "ovs_interfaceid": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:33:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-c696f77d-eb36-426f-a86d-26bfca9a1918" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:33:35 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:33:35 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:33:35 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-42f18a73-40d0-4c8c-aa24-6019409bc8f5 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.616s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:35 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:33:35 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:33:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:36 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:33:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:36 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:33:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:36 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:37 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:33:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:38 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:33:38 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:33:38 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8147MB free_disk=25.134613037109375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:33:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:38 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance c696f77d-eb36-426f-a86d-26bfca9a1918 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:33:38 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance adef852b-f515-4cfd-807e-586809ff6aa6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:33:38 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 6e48fce8-e4d4-4e30-a67e-5d81036b14cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:33:38 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:33:38 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 1c992ecd-ac21-44e7-937c-b19028cc95c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:33:38 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:33:38 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:33:39 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:33:39 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:33:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:33:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.309s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:39 user nova-compute[73188]: DEBUG nova.compute.manager [req-90e3c8e5-addd-443f-92a2-b2c486f5fd70 req-3b4e3e80-0252-492a-83ba-a7eb1ad8eb4d service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Received event network-changed-a50854ad-f025-4e0d-b13c-4786568261b1 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:33:39 user nova-compute[73188]: DEBUG nova.compute.manager [req-90e3c8e5-addd-443f-92a2-b2c486f5fd70 req-3b4e3e80-0252-492a-83ba-a7eb1ad8eb4d service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Refreshing instance network info cache due to event network-changed-a50854ad-f025-4e0d-b13c-4786568261b1. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:33:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-90e3c8e5-addd-443f-92a2-b2c486f5fd70 req-3b4e3e80-0252-492a-83ba-a7eb1ad8eb4d service nova] Acquiring lock "refresh_cache-adef852b-f515-4cfd-807e-586809ff6aa6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:33:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-90e3c8e5-addd-443f-92a2-b2c486f5fd70 req-3b4e3e80-0252-492a-83ba-a7eb1ad8eb4d service nova] Acquired lock "refresh_cache-adef852b-f515-4cfd-807e-586809ff6aa6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:33:39 user nova-compute[73188]: DEBUG nova.network.neutron [req-90e3c8e5-addd-443f-92a2-b2c486f5fd70 req-3b4e3e80-0252-492a-83ba-a7eb1ad8eb4d service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Refreshing network info cache for port a50854ad-f025-4e0d-b13c-4786568261b1 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:33:40 user nova-compute[73188]: DEBUG nova.network.neutron [req-90e3c8e5-addd-443f-92a2-b2c486f5fd70 req-3b4e3e80-0252-492a-83ba-a7eb1ad8eb4d service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Updated VIF entry in instance network info cache for port a50854ad-f025-4e0d-b13c-4786568261b1. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:33:40 user nova-compute[73188]: DEBUG nova.network.neutron [req-90e3c8e5-addd-443f-92a2-b2c486f5fd70 req-3b4e3e80-0252-492a-83ba-a7eb1ad8eb4d service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Updating instance_info_cache with network_info: [{"id": "a50854ad-f025-4e0d-b13c-4786568261b1", "address": "fa:16:3e:4e:b4:be", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa50854ad-f0", "ovs_interfaceid": "a50854ad-f025-4e0d-b13c-4786568261b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:33:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-90e3c8e5-addd-443f-92a2-b2c486f5fd70 req-3b4e3e80-0252-492a-83ba-a7eb1ad8eb4d service nova] Releasing lock "refresh_cache-adef852b-f515-4cfd-807e-586809ff6aa6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:33:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:41 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:33:41 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:33:41 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:33:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "adef852b-f515-4cfd-807e-586809ff6aa6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "adef852b-f515-4cfd-807e-586809ff6aa6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:43 user nova-compute[73188]: DEBUG nova.objects.instance [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lazy-loading 'flavor' on Instance uuid adef852b-f515-4cfd-807e-586809ff6aa6 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:33:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "adef852b-f515-4cfd-807e-586809ff6aa6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "adef852b-f515-4cfd-807e-586809ff6aa6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "adef852b-f515-4cfd-807e-586809ff6aa6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:44 user nova-compute[73188]: INFO nova.compute.manager [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Attaching volume 90990e6b-f644-4234-874c-77f2b060a595 to /dev/vdb
Aug 15 19:33:44 user nova-compute[73188]: DEBUG os_brick.utils [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:33:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:44 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[be099fd4-1728-46fe-a474-d6ee2d95b173]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:44 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34bd44b-5441-4d51-971a-2c8682c0aa3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:44 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d95084b-1410-47e8-a6b1-d5ded732ceee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:44 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[972db15a-621b-45fd-b850-5deb0a9b8d56]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:33:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:33:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:33:44 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:33:44 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9d5bcb-0083-48eb-a3ad-32c320dcec24]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:33:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:33:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:33:44 user nova-compute[73188]: DEBUG os_brick.utils [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:33:44 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Updating existing volume attachment record: 7c3a3e04-fda9-4974-a72a-d12bd28ed513 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:33:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBbENfoq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:33:52 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:33:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:33:52 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:33:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:33:52 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:33:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8186f119-0870-4604-9ac8-c4be59280a0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:33:52 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[87796823-1b9d-4857-8bd3-0dd77bf69b6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595] added
Aug 15 19:33:52 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a2e76e-fca8-4b18-b6dc-c43db007d4a7]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d28e05-d2c0-497e-a15a-14b925b21da2]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gBbENfoq {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gBbENfoq" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cfe13e-4dc1-4a39-8055-857a1004b661]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gBbENfoq'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ece52e-37e0-4c49-9190-7da6db4ab4a2]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1754b787-4a32-493f-8634-1816ccf644ec]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 (non-flash)
Aug 15 19:33:52 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 (non-flash)
Aug 15 19:33:52 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:33:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e18e9dd-3b54-450b-9fc7-ddbfe5f4b5a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595, portal: 172.16.0.220,3260]
Aug 15 19:33:53 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595, portal: 172.16.0.220,3260] successful.
Aug 15 19:33:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:33:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e072aa5-bd54-4786-b14e-afd899c67e0f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:33:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[da02ac59-7661-47fb-abb2-aa94716e8905]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 (non-flash)
Aug 15 19:33:53 user nova-compute[73188]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 (non-flash)
Aug 15 19:33:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:33:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 (non-flash)
Aug 15 19:33:53 user nova-compute[73188]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 (non-flash)
Aug 15 19:33:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:33:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:33:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:33:53 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:33:53 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:33:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[743cfd93-c61a-4ef6-b991-f60fa50eb117]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:33:53 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:33:54 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:33:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBbENfoq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:33:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:33:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26564666331396165', 'path': '/dev/sdc'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:33:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564666331396165', 'path': '/dev/sdc'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:33:54 user nova-compute[73188]: DEBUG nova.objects.instance [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lazy-loading 'flavor' on Instance uuid adef852b-f515-4cfd-807e-586809ff6aa6 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:33:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:33:54 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:33:54 user nova-compute[73188]:   <source dev="/dev/sdc"/>
Aug 15 19:33:54 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:33:54 user nova-compute[73188]:   <serial>90990e6b-f644-4234-874c-77f2b060a595</serial>
Aug 15 19:33:54 user nova-compute[73188]: </disk>
Aug 15 19:33:54 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:33:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:33:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:33:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] No VIF found with MAC fa:16:3e:4e:b4:be, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:33:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-e6f6e0e7-b3f2-4b51-8d7a-ae29dfeceaf3 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "adef852b-f515-4cfd-807e-586809ff6aa6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.547s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:33:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "e81e522c-e329-4c67-b96b-1ad5a515686d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "e81e522c-e329-4c67-b96b-1ad5a515686d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:57 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:33:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:57 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:33:57 user nova-compute[73188]: INFO nova.compute.claims [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Claim successful on node user
Aug 15 19:33:58 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:33:58 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:33:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.306s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:33:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:33:58 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:33:58 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:33:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:33:58 user nova-compute[73188]: DEBUG nova.policy [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e526de0e03140bea2d410f535f75bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5bc7d940cd1410a878ac89e24a4c4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:33:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:33:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:33:58 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Creating image(s)
Aug 15 19:33:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "/opt/stack/data/nova/instances/e81e522c-e329-4c67-b96b-1ad5a515686d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "/opt/stack/data/nova/instances/e81e522c-e329-4c67-b96b-1ad5a515686d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "/opt/stack/data/nova/instances/e81e522c-e329-4c67-b96b-1ad5a515686d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.184s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.186s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/e81e522c-e329-4c67-b96b-1ad5a515686d/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/e81e522c-e329-4c67-b96b-1ad5a515686d/disk 1073741824" returned: 0 in 0.050s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:59 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Successfully created port: d87505ad-01b4-404b-afff-1db7097a58c3 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:33:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.179s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:59 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e81e522c-e329-4c67-b96b-1ad5a515686d/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:33:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e522c-e329-4c67-b96b-1ad5a515686d/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:33:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e522c-e329-4c67-b96b-1ad5a515686d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:33:59 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Cannot resize image /opt/stack/data/nova/instances/e81e522c-e329-4c67-b96b-1ad5a515686d/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:33:59 user nova-compute[73188]: DEBUG nova.objects.instance [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lazy-loading 'migration_context' on Instance uuid e81e522c-e329-4c67-b96b-1ad5a515686d {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:33:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:33:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Ensure instance console log exists: /opt/stack/data/nova/instances/e81e522c-e329-4c67-b96b-1ad5a515686d/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:33:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:33:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:33:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:33:59 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Successfully updated port: d87505ad-01b4-404b-afff-1db7097a58c3 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:33:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "refresh_cache-e81e522c-e329-4c67-b96b-1ad5a515686d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:33:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquired lock "refresh_cache-e81e522c-e329-4c67-b96b-1ad5a515686d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:33:59 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:33:59 user nova-compute[73188]: DEBUG nova.compute.manager [req-3141321b-fe47-4a6a-aff3-872a8df39694 req-ce0629ec-04d0-4fd8-8696-024cf6bde7c4 service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Received event network-changed-d87505ad-01b4-404b-afff-1db7097a58c3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:33:59 user nova-compute[73188]: DEBUG nova.compute.manager [req-3141321b-fe47-4a6a-aff3-872a8df39694 req-ce0629ec-04d0-4fd8-8696-024cf6bde7c4 service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Refreshing instance network info cache due to event network-changed-d87505ad-01b4-404b-afff-1db7097a58c3. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:33:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3141321b-fe47-4a6a-aff3-872a8df39694 req-ce0629ec-04d0-4fd8-8696-024cf6bde7c4 service nova] Acquiring lock "refresh_cache-e81e522c-e329-4c67-b96b-1ad5a515686d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:33:59 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Updating instance_info_cache with network_info: [{"id": "d87505ad-01b4-404b-afff-1db7097a58c3", "address": "fa:16:3e:b8:a9:1a", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87505ad-01", "ovs_interfaceid": "d87505ad-01b4-404b-afff-1db7097a58c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Releasing lock "refresh_cache-e81e522c-e329-4c67-b96b-1ad5a515686d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Instance network_info: |[{"id": "d87505ad-01b4-404b-afff-1db7097a58c3", "address": "fa:16:3e:b8:a9:1a", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87505ad-01", "ovs_interfaceid": "d87505ad-01b4-404b-afff-1db7097a58c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3141321b-fe47-4a6a-aff3-872a8df39694 req-ce0629ec-04d0-4fd8-8696-024cf6bde7c4 service nova] Acquired lock "refresh_cache-e81e522c-e329-4c67-b96b-1ad5a515686d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.network.neutron [req-3141321b-fe47-4a6a-aff3-872a8df39694 req-ce0629ec-04d0-4fd8-8696-024cf6bde7c4 service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Refreshing network info cache for port d87505ad-01b4-404b-afff-1db7097a58c3 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Start _get_guest_xml network_info=[{"id": "d87505ad-01b4-404b-afff-1db7097a58c3", "address": "fa:16:3e:b8:a9:1a", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87505ad-01", "ovs_interfaceid": "d87505ad-01b4-404b-afff-1db7097a58c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:34:00 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:34:00 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:33:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1173996320',display_name='tempest-AttachVolumeNegativeTest-server-1173996320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1173996320',id=48,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUb1PMtD8oTswjzXXWyseZMqvpzqj6wMMgoNRSc9VU2dV+axhVYzH4rN4hXacsoPXwzmLSD5zPEPZmSKbkWYNp1CTreFOlpWRSnjIvSJ4vV2hj0pRdXNEBwJL5oi2+5Gg==',key_name='tempest-keypair-1511258357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5bc7d940cd1410a878ac89e24a4c4bc',ramdisk_id='',reservation_id='r-raeu1ake',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1373631227',owner_user_name='tempest-AttachVolumeNegativeTest-1373631227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:33:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e526de0e03140bea2d410f535f75bb7',uuid=e81e522c-e329-4c67-b96b-1ad5a515686d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d87505ad-01b4-404b-afff-1db7097a58c3", "address": "fa:16:3e:b8:a9:1a", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87505ad-01", "ovs_interfaceid": "d87505ad-01b4-404b-afff-1db7097a58c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converting VIF {"id": "d87505ad-01b4-404b-afff-1db7097a58c3", "address": "fa:16:3e:b8:a9:1a", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87505ad-01", "ovs_interfaceid": "d87505ad-01b4-404b-afff-1db7097a58c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a9:1a,bridge_name='br-int',has_traffic_filtering=True,id=d87505ad-01b4-404b-afff-1db7097a58c3,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87505ad-01') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.objects.instance [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lazy-loading 'pci_devices' on Instance uuid e81e522c-e329-4c67-b96b-1ad5a515686d {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:34:00 user nova-compute[73188]:   <uuid>e81e522c-e329-4c67-b96b-1ad5a515686d</uuid>
Aug 15 19:34:00 user nova-compute[73188]:   <name>instance-00000030</name>
Aug 15 19:34:00 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:34:00 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:34:00 user nova-compute[73188]:   <metadata>
Aug 15 19:34:00 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:34:00 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:34:00 user nova-compute[73188]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1173996320</nova:name>
Aug 15 19:34:00 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:34:00</nova:creationTime>
Aug 15 19:34:00 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:34:00 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:34:00 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:34:00 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:34:00 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:34:00 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:34:00 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:34:00 user nova-compute[73188]:       <nova:owner>
Aug 15 19:34:00 user nova-compute[73188]:         <nova:user uuid="0e526de0e03140bea2d410f535f75bb7">tempest-AttachVolumeNegativeTest-1373631227-project-member</nova:user>
Aug 15 19:34:00 user nova-compute[73188]:         <nova:project uuid="f5bc7d940cd1410a878ac89e24a4c4bc">tempest-AttachVolumeNegativeTest-1373631227</nova:project>
Aug 15 19:34:00 user nova-compute[73188]:       </nova:owner>
Aug 15 19:34:00 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:34:00 user nova-compute[73188]:       <nova:ports>
Aug 15 19:34:00 user nova-compute[73188]:         <nova:port uuid="d87505ad-01b4-404b-afff-1db7097a58c3">
Aug 15 19:34:00 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 19:34:00 user nova-compute[73188]:         </nova:port>
Aug 15 19:34:00 user nova-compute[73188]:       </nova:ports>
Aug 15 19:34:00 user nova-compute[73188]:     </nova:instance>
Aug 15 19:34:00 user nova-compute[73188]:   </metadata>
Aug 15 19:34:00 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:34:00 user nova-compute[73188]:     <system>
Aug 15 19:34:00 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:34:00 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:34:00 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:34:00 user nova-compute[73188]:       <entry name="serial">e81e522c-e329-4c67-b96b-1ad5a515686d</entry>
Aug 15 19:34:00 user nova-compute[73188]:       <entry name="uuid">e81e522c-e329-4c67-b96b-1ad5a515686d</entry>
Aug 15 19:34:00 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:34:00 user nova-compute[73188]:     </system>
Aug 15 19:34:00 user nova-compute[73188]:   </sysinfo>
Aug 15 19:34:00 user nova-compute[73188]:   <os>
Aug 15 19:34:00 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:34:00 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:34:00 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:34:00 user nova-compute[73188]:   </os>
Aug 15 19:34:00 user nova-compute[73188]:   <features>
Aug 15 19:34:00 user nova-compute[73188]:     <acpi/>
Aug 15 19:34:00 user nova-compute[73188]:     <apic/>
Aug 15 19:34:00 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:34:00 user nova-compute[73188]:   </features>
Aug 15 19:34:00 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:34:00 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:34:00 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:34:00 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:34:00 user nova-compute[73188]:   </clock>
Aug 15 19:34:00 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:34:00 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:34:00 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:34:00 user nova-compute[73188]:   </cpu>
Aug 15 19:34:00 user nova-compute[73188]:   <devices>
Aug 15 19:34:00 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:34:00 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:34:00 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/e81e522c-e329-4c67-b96b-1ad5a515686d/disk"/>
Aug 15 19:34:00 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:34:00 user nova-compute[73188]:     </disk>
Aug 15 19:34:00 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:34:00 user nova-compute[73188]:       <mac address="fa:16:3e:b8:a9:1a"/>
Aug 15 19:34:00 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:34:00 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:34:00 user nova-compute[73188]:       <target dev="tapd87505ad-01"/>
Aug 15 19:34:00 user nova-compute[73188]:     </interface>
Aug 15 19:34:00 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:34:00 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/e81e522c-e329-4c67-b96b-1ad5a515686d/console.log" append="off"/>
Aug 15 19:34:00 user nova-compute[73188]:     </serial>
Aug 15 19:34:00 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:34:00 user nova-compute[73188]:     <video>
Aug 15 19:34:00 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:34:00 user nova-compute[73188]:     </video>
Aug 15 19:34:00 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:34:00 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:34:00 user nova-compute[73188]:     </rng>
Aug 15 19:34:00 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:34:00 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:34:00 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:34:00 user nova-compute[73188]:     </memballoon>
Aug 15 19:34:00 user nova-compute[73188]:   </devices>
Aug 15 19:34:00 user nova-compute[73188]: </domain>
Aug 15 19:34:00 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:33:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1173996320',display_name='tempest-AttachVolumeNegativeTest-server-1173996320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1173996320',id=48,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUb1PMtD8oTswjzXXWyseZMqvpzqj6wMMgoNRSc9VU2dV+axhVYzH4rN4hXacsoPXwzmLSD5zPEPZmSKbkWYNp1CTreFOlpWRSnjIvSJ4vV2hj0pRdXNEBwJL5oi2+5Gg==',key_name='tempest-keypair-1511258357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5bc7d940cd1410a878ac89e24a4c4bc',ramdisk_id='',reservation_id='r-raeu1ake',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1373631227',owner_user_name='tempest-AttachVolumeNegativeTest-1373631227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:33:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e526de0e03140bea2d410f535f75bb7',uuid=e81e522c-e329-4c67-b96b-1ad5a515686d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d87505ad-01b4-404b-afff-1db7097a58c3", "address": "fa:16:3e:b8:a9:1a", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87505ad-01", "ovs_interfaceid": "d87505ad-01b4-404b-afff-1db7097a58c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converting VIF {"id": "d87505ad-01b4-404b-afff-1db7097a58c3", "address": "fa:16:3e:b8:a9:1a", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87505ad-01", "ovs_interfaceid": "d87505ad-01b4-404b-afff-1db7097a58c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a9:1a,bridge_name='br-int',has_traffic_filtering=True,id=d87505ad-01b4-404b-afff-1db7097a58c3,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87505ad-01') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG os_vif [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a9:1a,bridge_name='br-int',has_traffic_filtering=True,id=d87505ad-01b4-404b-afff-1db7097a58c3,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87505ad-01') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd87505ad-01, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd87505ad-01, col_values=(('external_ids', {'iface-id': 'd87505ad-01b4-404b-afff-1db7097a58c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:a9:1a', 'vm-uuid': 'e81e522c-e329-4c67-b96b-1ad5a515686d'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:00 user nova-compute[73188]: INFO os_vif [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a9:1a,bridge_name='br-int',has_traffic_filtering=True,id=d87505ad-01b4-404b-afff-1db7097a58c3,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87505ad-01')
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] No VIF found with MAC fa:16:3e:b8:a9:1a, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.network.neutron [req-3141321b-fe47-4a6a-aff3-872a8df39694 req-ce0629ec-04d0-4fd8-8696-024cf6bde7c4 service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Updated VIF entry in instance network info cache for port d87505ad-01b4-404b-afff-1db7097a58c3. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG nova.network.neutron [req-3141321b-fe47-4a6a-aff3-872a8df39694 req-ce0629ec-04d0-4fd8-8696-024cf6bde7c4 service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Updating instance_info_cache with network_info: [{"id": "d87505ad-01b4-404b-afff-1db7097a58c3", "address": "fa:16:3e:b8:a9:1a", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87505ad-01", "ovs_interfaceid": "d87505ad-01b4-404b-afff-1db7097a58c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:34:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-3141321b-fe47-4a6a-aff3-872a8df39694 req-ce0629ec-04d0-4fd8-8696-024cf6bde7c4 service nova] Releasing lock "refresh_cache-e81e522c-e329-4c67-b96b-1ad5a515686d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:34:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:01 user nova-compute[73188]: DEBUG nova.compute.manager [req-348c1817-cac8-456c-b0c2-5540627518d4 req-22b61fef-ad09-4e00-8ec5-1cf33d93658e service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Received event network-vif-plugged-d87505ad-01b4-404b-afff-1db7097a58c3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:34:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-348c1817-cac8-456c-b0c2-5540627518d4 req-22b61fef-ad09-4e00-8ec5-1cf33d93658e service nova] Acquiring lock "e81e522c-e329-4c67-b96b-1ad5a515686d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:34:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-348c1817-cac8-456c-b0c2-5540627518d4 req-22b61fef-ad09-4e00-8ec5-1cf33d93658e service nova] Lock "e81e522c-e329-4c67-b96b-1ad5a515686d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:34:01 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-348c1817-cac8-456c-b0c2-5540627518d4 req-22b61fef-ad09-4e00-8ec5-1cf33d93658e service nova] Lock "e81e522c-e329-4c67-b96b-1ad5a515686d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:34:01 user nova-compute[73188]: DEBUG nova.compute.manager [req-348c1817-cac8-456c-b0c2-5540627518d4 req-22b61fef-ad09-4e00-8ec5-1cf33d93658e service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] No waiting events found dispatching network-vif-plugged-d87505ad-01b4-404b-afff-1db7097a58c3 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:34:01 user nova-compute[73188]: WARNING nova.compute.manager [req-348c1817-cac8-456c-b0c2-5540627518d4 req-22b61fef-ad09-4e00-8ec5-1cf33d93658e service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Received unexpected event network-vif-plugged-d87505ad-01b4-404b-afff-1db7097a58c3 for instance with vm_state building and task_state spawning.
Aug 15 19:34:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:03 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692128043.6926122, e81e522c-e329-4c67-b96b-1ad5a515686d => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:34:03 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] VM Resumed (Lifecycle Event)
Aug 15 19:34:03 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:34:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:34:03 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Instance spawned successfully.
Aug 15 19:34:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:34:03 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:34:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:34:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:34:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:34:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:34:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:34:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:34:03 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:34:03 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:34:03 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692128043.6939998, e81e522c-e329-4c67-b96b-1ad5a515686d => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:34:03 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] VM Started (Lifecycle Event)
Aug 15 19:34:03 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:34:03 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:34:03 user nova-compute[73188]: INFO nova.compute.manager [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Took 5.31 seconds to spawn the instance on the hypervisor.
Aug 15 19:34:03 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:34:03 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:34:03 user nova-compute[73188]: DEBUG nova.compute.manager [req-175a71d4-43a8-45e3-b46d-f6a6628d8131 req-1140e23a-be71-4e64-aad6-b0f32a781a22 service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Received event network-vif-plugged-d87505ad-01b4-404b-afff-1db7097a58c3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:34:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-175a71d4-43a8-45e3-b46d-f6a6628d8131 req-1140e23a-be71-4e64-aad6-b0f32a781a22 service nova] Acquiring lock "e81e522c-e329-4c67-b96b-1ad5a515686d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:34:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-175a71d4-43a8-45e3-b46d-f6a6628d8131 req-1140e23a-be71-4e64-aad6-b0f32a781a22 service nova] Lock "e81e522c-e329-4c67-b96b-1ad5a515686d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:34:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-175a71d4-43a8-45e3-b46d-f6a6628d8131 req-1140e23a-be71-4e64-aad6-b0f32a781a22 service nova] Lock "e81e522c-e329-4c67-b96b-1ad5a515686d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:34:03 user nova-compute[73188]: DEBUG nova.compute.manager [req-175a71d4-43a8-45e3-b46d-f6a6628d8131 req-1140e23a-be71-4e64-aad6-b0f32a781a22 service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] No waiting events found dispatching network-vif-plugged-d87505ad-01b4-404b-afff-1db7097a58c3 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:34:03 user nova-compute[73188]: WARNING nova.compute.manager [req-175a71d4-43a8-45e3-b46d-f6a6628d8131 req-1140e23a-be71-4e64-aad6-b0f32a781a22 service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Received unexpected event network-vif-plugged-d87505ad-01b4-404b-afff-1db7097a58c3 for instance with vm_state building and task_state spawning.
Aug 15 19:34:03 user nova-compute[73188]: INFO nova.compute.manager [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Took 5.97 seconds to build instance.
Aug 15 19:34:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e373dc6-5119-45fd-a074-c9c4772a882c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "e81e522c-e329-4c67-b96b-1ad5a515686d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.064s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:34:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:29 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:34:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:32 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:34:34 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:34:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:35 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:34:35 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:34:36 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:34:36 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:34:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-adef852b-f515-4cfd-807e-586809ff6aa6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:34:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-adef852b-f515-4cfd-807e-586809ff6aa6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:34:36 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:34:37 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Updating instance_info_cache with network_info: [{"id": "a50854ad-f025-4e0d-b13c-4786568261b1", "address": "fa:16:3e:4e:b4:be", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa50854ad-f0", "ovs_interfaceid": "a50854ad-f025-4e0d-b13c-4786568261b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:34:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-adef852b-f515-4cfd-807e-586809ff6aa6" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:34:37 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:34:37 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:34:37 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:34:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:34:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:34:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:34:37 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:34:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:34:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:34:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:34:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:34:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:34:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:34:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:34:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:34:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:34:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:34:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:34:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:34:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:34:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:34:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:34:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:34:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:34:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:34:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e522c-e329-4c67-b96b-1ad5a515686d/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:34:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e522c-e329-4c67-b96b-1ad5a515686d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:34:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e522c-e329-4c67-b96b-1ad5a515686d/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:34:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e522c-e329-4c67-b96b-1ad5a515686d/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:34:39 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:34:39 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:34:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=7994MB free_disk=25.067726135253906GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:34:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:34:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:34:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance c696f77d-eb36-426f-a86d-26bfca9a1918 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:34:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance adef852b-f515-4cfd-807e-586809ff6aa6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:34:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 6e48fce8-e4d4-4e30-a67e-5d81036b14cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:34:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:34:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 1c992ecd-ac21-44e7-937c-b19028cc95c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:34:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e81e522c-e329-4c67-b96b-1ad5a515686d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:34:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:34:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:34:40 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:34:40 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:34:40 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:34:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.358s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:34:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:34:44 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:34:44 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:34:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:34:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:34:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:55 user nova-compute[73188]: DEBUG nova.compute.manager [req-1016a939-d3e2-4d8c-a4ad-ec7fcf2ed034 req-24e09928-216b-4f20-9f24-faafd1a08262 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Received event network-changed-14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:34:55 user nova-compute[73188]: DEBUG nova.compute.manager [req-1016a939-d3e2-4d8c-a4ad-ec7fcf2ed034 req-24e09928-216b-4f20-9f24-faafd1a08262 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Refreshing instance network info cache due to event network-changed-14f35d48-3eee-47e2-84b7-d5805df1d826. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:34:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1016a939-d3e2-4d8c-a4ad-ec7fcf2ed034 req-24e09928-216b-4f20-9f24-faafd1a08262 service nova] Acquiring lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:34:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1016a939-d3e2-4d8c-a4ad-ec7fcf2ed034 req-24e09928-216b-4f20-9f24-faafd1a08262 service nova] Acquired lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:34:55 user nova-compute[73188]: DEBUG nova.network.neutron [req-1016a939-d3e2-4d8c-a4ad-ec7fcf2ed034 req-24e09928-216b-4f20-9f24-faafd1a08262 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Refreshing network info cache for port 14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:34:56 user nova-compute[73188]: DEBUG nova.network.neutron [req-1016a939-d3e2-4d8c-a4ad-ec7fcf2ed034 req-24e09928-216b-4f20-9f24-faafd1a08262 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Updated VIF entry in instance network info cache for port 14f35d48-3eee-47e2-84b7-d5805df1d826. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:34:56 user nova-compute[73188]: DEBUG nova.network.neutron [req-1016a939-d3e2-4d8c-a4ad-ec7fcf2ed034 req-24e09928-216b-4f20-9f24-faafd1a08262 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Updating instance_info_cache with network_info: [{"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f35d48-3e", "ovs_interfaceid": "14f35d48-3eee-47e2-84b7-d5805df1d826", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:34:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquiring lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:34:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:34:56 user nova-compute[73188]: INFO nova.compute.manager [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Shelve offloading
Aug 15 19:34:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-1016a939-d3e2-4d8c-a4ad-ec7fcf2ed034 req-24e09928-216b-4f20-9f24-faafd1a08262 service nova] Releasing lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:34:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:56 user nova-compute[73188]: DEBUG nova.compute.manager [req-87163f03-4106-45f5-8d06-5f5f8bfd09cc req-daa7702e-46c3-42f8-a60b-a87668ceebcb service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Received event network-vif-unplugged-14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:34:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-87163f03-4106-45f5-8d06-5f5f8bfd09cc req-daa7702e-46c3-42f8-a60b-a87668ceebcb service nova] Acquiring lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:34:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-87163f03-4106-45f5-8d06-5f5f8bfd09cc req-daa7702e-46c3-42f8-a60b-a87668ceebcb service nova] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:34:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-87163f03-4106-45f5-8d06-5f5f8bfd09cc req-daa7702e-46c3-42f8-a60b-a87668ceebcb service nova] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:34:56 user nova-compute[73188]: DEBUG nova.compute.manager [req-87163f03-4106-45f5-8d06-5f5f8bfd09cc req-daa7702e-46c3-42f8-a60b-a87668ceebcb service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] No waiting events found dispatching network-vif-unplugged-14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:34:56 user nova-compute[73188]: WARNING nova.compute.manager [req-87163f03-4106-45f5-8d06-5f5f8bfd09cc req-daa7702e-46c3-42f8-a60b-a87668ceebcb service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Received unexpected event network-vif-unplugged-14f35d48-3eee-47e2-84b7-d5805df1d826 for instance with vm_state active and task_state shelving.
Aug 15 19:34:56 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Instance destroyed successfully.
Aug 15 19:34:56 user nova-compute[73188]: DEBUG nova.compute.manager [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:34:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquiring lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:34:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquired lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:34:56 user nova-compute[73188]: DEBUG nova.network.neutron [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:34:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:57 user nova-compute[73188]: DEBUG nova.network.neutron [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Updating instance_info_cache with network_info: [{"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f35d48-3e", "ovs_interfaceid": "14f35d48-3eee-47e2-84b7-d5805df1d826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:34:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Releasing lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:34:58 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Instance destroyed successfully.
Aug 15 19:34:58 user nova-compute[73188]: DEBUG nova.objects.instance [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lazy-loading 'resources' on Instance uuid 6e48fce8-e4d4-4e30-a67e-5d81036b14cc {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2091190492',display_name='tempest-TestShelveInstance-server-2091190492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2091190492',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPz6u2nYKHQFAzYTyRfEeG06JbJBrTKBAcp90LkXrGpbDb7LTDjsVtedLmtluIbnn4t0KMbFAZIEu7pwAqVfeTIXG4MwAsMd5VwhFHLOWX5ycW/llYPoLXd8JAdz8j5jNA==',key_name='tempest-TestShelveInstance-1880994155',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:33:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6e83dc2ac5e4beb9043d1539bba6ddb',ramdisk_id='',reservation_id='r-a5dttlzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-704396217',owner_user_name='tempest-TestShelveInstance-704396217-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:33:21Z,user_data=None,user_id='d432668099f24666a003c56ec5ca4001',uuid=6e48fce8-e4d4-4e30-a67e-5d81036b14cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f35d48-3e", "ovs_interfaceid": "14f35d48-3eee-47e2-84b7-d5805df1d826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Converting VIF {"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f35d48-3e", "ovs_interfaceid": "14f35d48-3eee-47e2-84b7-d5805df1d826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:4e:1a,bridge_name='br-int',has_traffic_filtering=True,id=14f35d48-3eee-47e2-84b7-d5805df1d826,network=Network(943da617-81f7-4b12-8278-0ce36f9f1d20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f35d48-3e') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG os_vif [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:4e:1a,bridge_name='br-int',has_traffic_filtering=True,id=14f35d48-3eee-47e2-84b7-d5805df1d826,network=Network(943da617-81f7-4b12-8278-0ce36f9f1d20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f35d48-3e') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14f35d48-3e, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:34:58 user nova-compute[73188]: INFO os_vif [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:4e:1a,bridge_name='br-int',has_traffic_filtering=True,id=14f35d48-3eee-47e2-84b7-d5805df1d826,network=Network(943da617-81f7-4b12-8278-0ce36f9f1d20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f35d48-3e')
Aug 15 19:34:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jEJQyGcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:34:58 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:34:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cad97b-2b2f-4670-9fc4-16b52d96d2ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[835cc619-07b4-4ec2-9a0a-2baac73930b7]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 (non-flash)
Aug 15 19:34:58 user nova-compute[73188]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 (non-flash)
Aug 15 19:34:58 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 (non-flash)
Aug 15 19:34:58 user nova-compute[73188]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 (non-flash)
Aug 15 19:34:58 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2808783ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3'): ({'sdb'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Removing single pathed devices sdb {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ace66e1-8d3b-4254-b781-f3195f4d65bd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e60685-ee52-4c46-9cca-576ceeb47fdb]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Flushing IO for device /dev/sdb {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3a5542-674a-4eca-b83b-81fc989bf6ec]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c47f1c-b74b-42ae-a151-ab0c54b53410]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d44767-dbab-4a82-a387-a18bb1c26cad]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[79eb5ade-3b79-4b73-bcb0-9cc7580652bd]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3, portal: 172.16.0.220,3260]
Aug 15 19:34:58 user nova-compute[73188]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3, portal: 172.16.0.220,3260] successful.
Aug 15 19:34:58 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30bd146-a0bd-4acb-83ce-3d1880f4c7b5]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] <== disconnect_volume: return (266ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:34:58 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Deleting instance files /opt/stack/data/nova/instances/6e48fce8-e4d4-4e30-a67e-5d81036b14cc_del
Aug 15 19:34:58 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Deletion of /opt/stack/data/nova/instances/6e48fce8-e4d4-4e30-a67e-5d81036b14cc_del complete
Aug 15 19:34:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-e8d5d578-6b00-4985-a6ee-e46c7a62b251 req-4d6c49e2-14d9-49e2-8213-fa3b6b3bf179 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Received event network-vif-plugged-14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e8d5d578-6b00-4985-a6ee-e46c7a62b251 req-4d6c49e2-14d9-49e2-8213-fa3b6b3bf179 service nova] Acquiring lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e8d5d578-6b00-4985-a6ee-e46c7a62b251 req-4d6c49e2-14d9-49e2-8213-fa3b6b3bf179 service nova] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e8d5d578-6b00-4985-a6ee-e46c7a62b251 req-4d6c49e2-14d9-49e2-8213-fa3b6b3bf179 service nova] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-e8d5d578-6b00-4985-a6ee-e46c7a62b251 req-4d6c49e2-14d9-49e2-8213-fa3b6b3bf179 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] No waiting events found dispatching network-vif-plugged-14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:34:58 user nova-compute[73188]: WARNING nova.compute.manager [req-e8d5d578-6b00-4985-a6ee-e46c7a62b251 req-4d6c49e2-14d9-49e2-8213-fa3b6b3bf179 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Received unexpected event network-vif-plugged-14f35d48-3eee-47e2-84b7-d5805df1d826 for instance with vm_state active and task_state shelving.
Aug 15 19:34:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-e8d5d578-6b00-4985-a6ee-e46c7a62b251 req-4d6c49e2-14d9-49e2-8213-fa3b6b3bf179 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Received event network-changed-14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-e8d5d578-6b00-4985-a6ee-e46c7a62b251 req-4d6c49e2-14d9-49e2-8213-fa3b6b3bf179 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Refreshing instance network info cache due to event network-changed-14f35d48-3eee-47e2-84b7-d5805df1d826. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e8d5d578-6b00-4985-a6ee-e46c7a62b251 req-4d6c49e2-14d9-49e2-8213-fa3b6b3bf179 service nova] Acquiring lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e8d5d578-6b00-4985-a6ee-e46c7a62b251 req-4d6c49e2-14d9-49e2-8213-fa3b6b3bf179 service nova] Acquired lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:34:58 user nova-compute[73188]: DEBUG nova.network.neutron [req-e8d5d578-6b00-4985-a6ee-e46c7a62b251 req-4d6c49e2-14d9-49e2-8213-fa3b6b3bf179 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Refreshing network info cache for port 14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:34:59 user nova-compute[73188]: DEBUG nova.network.neutron [req-e8d5d578-6b00-4985-a6ee-e46c7a62b251 req-4d6c49e2-14d9-49e2-8213-fa3b6b3bf179 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Updated VIF entry in instance network info cache for port 14f35d48-3eee-47e2-84b7-d5805df1d826. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:34:59 user nova-compute[73188]: DEBUG nova.network.neutron [req-e8d5d578-6b00-4985-a6ee-e46c7a62b251 req-4d6c49e2-14d9-49e2-8213-fa3b6b3bf179 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Updating instance_info_cache with network_info: [{"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": null, "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap14f35d48-3e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:34:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e8d5d578-6b00-4985-a6ee-e46c7a62b251 req-4d6c49e2-14d9-49e2-8213-fa3b6b3bf179 service nova] Releasing lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:34:59 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Deleted allocations for instance 6e48fce8-e4d4-4e30-a67e-5d81036b14cc
Aug 15 19:34:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:34:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:34:59 user nova-compute[73188]: DEBUG nova.objects.instance [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lazy-loading 'numa_topology' on Instance uuid 6e48fce8-e4d4-4e30-a67e-5d81036b14cc {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:34:59 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:34:59 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:34:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:34:59 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-f609a771-f68e-416c-b1fa-80f38291d5e7 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.551s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:35:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-f0ef671e-34eb-4597-b786-665003de2f2e req-094ab3c8-b596-4dd8-a89e-c6fc9cd43d99 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Received event network-changed-45104cfc-4a0b-4de5-bdd2-406a908a4de4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:35:11 user nova-compute[73188]: DEBUG nova.compute.manager [req-f0ef671e-34eb-4597-b786-665003de2f2e req-094ab3c8-b596-4dd8-a89e-c6fc9cd43d99 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Refreshing instance network info cache due to event network-changed-45104cfc-4a0b-4de5-bdd2-406a908a4de4. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:35:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f0ef671e-34eb-4597-b786-665003de2f2e req-094ab3c8-b596-4dd8-a89e-c6fc9cd43d99 service nova] Acquiring lock "refresh_cache-2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:35:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f0ef671e-34eb-4597-b786-665003de2f2e req-094ab3c8-b596-4dd8-a89e-c6fc9cd43d99 service nova] Acquired lock "refresh_cache-2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:35:11 user nova-compute[73188]: DEBUG nova.network.neutron [req-f0ef671e-34eb-4597-b786-665003de2f2e req-094ab3c8-b596-4dd8-a89e-c6fc9cd43d99 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Refreshing network info cache for port 45104cfc-4a0b-4de5-bdd2-406a908a4de4 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:35:11 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692128096.9661047, 6e48fce8-e4d4-4e30-a67e-5d81036b14cc => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:35:11 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] VM Stopped (Lifecycle Event)
Aug 15 19:35:11 user nova-compute[73188]: DEBUG nova.network.neutron [req-f0ef671e-34eb-4597-b786-665003de2f2e req-094ab3c8-b596-4dd8-a89e-c6fc9cd43d99 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Updated VIF entry in instance network info cache for port 45104cfc-4a0b-4de5-bdd2-406a908a4de4. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:35:11 user nova-compute[73188]: DEBUG nova.network.neutron [req-f0ef671e-34eb-4597-b786-665003de2f2e req-094ab3c8-b596-4dd8-a89e-c6fc9cd43d99 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Updating instance_info_cache with network_info: [{"id": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "address": "fa:16:3e:65:2d:cb", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45104cfc-4a", "ovs_interfaceid": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:35:11 user nova-compute[73188]: DEBUG nova.compute.manager [None req-267c4d89-cf1d-4cc1-8dbc-091280ace16e None None] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:35:11 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f0ef671e-34eb-4597-b786-665003de2f2e req-094ab3c8-b596-4dd8-a89e-c6fc9cd43d99 service nova] Releasing lock "refresh_cache-2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG nova.objects.instance [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lazy-loading 'flavor' on Instance uuid 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:35:12 user nova-compute[73188]: INFO nova.compute.manager [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Attaching volume 64331ef0-d83d-4e11-bfb2-758b2e233e7a to /dev/vdb
Aug 15 19:35:12 user nova-compute[73188]: DEBUG os_brick.utils [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d021dfcf-3ce2-4f6c-8958-f42696ea5915]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e9833c-423a-4f7a-a3c3-2f4d4e405f8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf9b1ad-e9bd-4161-a961-987e27369371]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dcb010-c1f9-420d-878a-f15828f4b92e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:35:12 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:35:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f99127-643b-43f1-8399-b941f62af6a6]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG os_brick.utils [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:35:12 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Updating existing volume attachment record: 5ac355ea-6034-4dba-8173-ae36a7f4865e {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:35:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:18 user nova-compute[73188]: DEBUG nova.compute.manager [req-7f67b274-489d-42ee-844d-a1a9fe5e8b85 req-95bedb28-07da-46da-9bdd-d7a65862b0c9 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Received event network-changed-17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:35:18 user nova-compute[73188]: DEBUG nova.compute.manager [req-7f67b274-489d-42ee-844d-a1a9fe5e8b85 req-95bedb28-07da-46da-9bdd-d7a65862b0c9 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Refreshing instance network info cache due to event network-changed-17fa5237-0a8d-4f42-956d-d4a9732b4539. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:35:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7f67b274-489d-42ee-844d-a1a9fe5e8b85 req-95bedb28-07da-46da-9bdd-d7a65862b0c9 service nova] Acquiring lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:35:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7f67b274-489d-42ee-844d-a1a9fe5e8b85 req-95bedb28-07da-46da-9bdd-d7a65862b0c9 service nova] Acquired lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:35:18 user nova-compute[73188]: DEBUG nova.network.neutron [req-7f67b274-489d-42ee-844d-a1a9fe5e8b85 req-95bedb28-07da-46da-9bdd-d7a65862b0c9 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Refreshing network info cache for port 17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:35:19 user nova-compute[73188]: DEBUG nova.network.neutron [req-7f67b274-489d-42ee-844d-a1a9fe5e8b85 req-95bedb28-07da-46da-9bdd-d7a65862b0c9 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Updated VIF entry in instance network info cache for port 17fa5237-0a8d-4f42-956d-d4a9732b4539. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:35:19 user nova-compute[73188]: DEBUG nova.network.neutron [req-7f67b274-489d-42ee-844d-a1a9fe5e8b85 req-95bedb28-07da-46da-9bdd-d7a65862b0c9 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Updating instance_info_cache with network_info: [{"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fa5237-0a", "ovs_interfaceid": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:35:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7f67b274-489d-42ee-844d-a1a9fe5e8b85 req-95bedb28-07da-46da-9bdd-d7a65862b0c9 service nova] Releasing lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YZOxSCWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:35:21 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:35:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:35:21 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:35:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:35:21 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1ecae8-bad5-4810-a313-9cf032cbe161]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:35:21 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[010748e4-5a55-496a-a253-bedf041fae2d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a] added
Aug 15 19:35:21 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[07abfb7d-a4b1-4919-8957-44ca5f451e33]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce33d48-ef17-4eec-8791-45c17c62a8b0]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YZOxSCWJ {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YZOxSCWJ" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[226a9710-2b6f-47e9-af49-0611f87a7538]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YZOxSCWJ'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d13c17d-3379-4a9f-a300-7b347eb61c4d]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c0e8e4-51e8-4a8b-a83a-e1c05f98e9a6]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 (non-flash)
Aug 15 19:35:21 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 (non-flash)
Aug 15 19:35:21 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b159e9d-0ab8-484f-809a-7bddfc280088]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a, portal: 172.16.0.220,3260]
Aug 15 19:35:21 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a, portal: 172.16.0.220,3260] successful.
Aug 15 19:35:21 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5453db-659d-4563-b7c5-88c1be1c659d]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5daf2a-7eef-40b9-8bdf-2de501ee597d]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 (non-flash)
Aug 15 19:35:21 user nova-compute[73188]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a (non-flash)
Aug 15 19:35:21 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 (non-flash)
Aug 15 19:35:21 user nova-compute[73188]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a (non-flash)
Aug 15 19:35:21 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1765dc7a-9c26-4f2c-9422-5e8c71a740fc]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:21 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:35:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:22 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:35:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YZOxSCWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:35:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:35:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23432323930353735', 'path': '/dev/sdb'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:35:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432323930353735', 'path': '/dev/sdb'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:35:22 user nova-compute[73188]: DEBUG nova.objects.instance [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lazy-loading 'flavor' on Instance uuid 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:35:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:35:22 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:35:22 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:35:22 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:35:22 user nova-compute[73188]:   <serial>64331ef0-d83d-4e11-bfb2-758b2e233e7a</serial>
Aug 15 19:35:22 user nova-compute[73188]: </disk>
Aug 15 19:35:22 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:35:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:35:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:35:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] No VIF found with MAC fa:16:3e:65:2d:cb, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:35:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5ed63c57-c0c3-43c2-88b8-fd6e0935d5e5 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.728s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:35:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "1c992ecd-ac21-44e7-937c-b19028cc95c2" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:35:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:35:23 user nova-compute[73188]: INFO nova.compute.manager [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Shelving
Aug 15 19:35:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:23 user nova-compute[73188]: DEBUG nova.compute.manager [req-a12bd042-2ddd-4cca-ae41-455902818abe req-091c6bc0-295a-429e-b773-4fe4eec54fc1 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Received event network-vif-unplugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:35:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a12bd042-2ddd-4cca-ae41-455902818abe req-091c6bc0-295a-429e-b773-4fe4eec54fc1 service nova] Acquiring lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:35:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a12bd042-2ddd-4cca-ae41-455902818abe req-091c6bc0-295a-429e-b773-4fe4eec54fc1 service nova] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:35:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-a12bd042-2ddd-4cca-ae41-455902818abe req-091c6bc0-295a-429e-b773-4fe4eec54fc1 service nova] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:35:23 user nova-compute[73188]: DEBUG nova.compute.manager [req-a12bd042-2ddd-4cca-ae41-455902818abe req-091c6bc0-295a-429e-b773-4fe4eec54fc1 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] No waiting events found dispatching network-vif-unplugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:35:23 user nova-compute[73188]: WARNING nova.compute.manager [req-a12bd042-2ddd-4cca-ae41-455902818abe req-091c6bc0-295a-429e-b773-4fe4eec54fc1 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Received unexpected event network-vif-unplugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 for instance with vm_state active and task_state shelving.
Aug 15 19:35:24 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Instance destroyed successfully.
Aug 15 19:35:24 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Beginning cold snapshot process
Aug 15 19:35:24 user nova-compute[73188]: DEBUG nova.privsep.utils [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73188) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 19:35:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk /opt/stack/data/nova/instances/snapshots/tmp4s7vk3ur/1c6adc907cb84b5f8e3b37a0f0f47bc7 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:24 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk /opt/stack/data/nova/instances/snapshots/tmp4s7vk3ur/1c6adc907cb84b5f8e3b37a0f0f47bc7" returned: 0 in 0.309s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:24 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Snapshot extracted, beginning image upload
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:35:25 user nova-compute[73188]: INFO nova.compute.manager [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Detaching volume 64331ef0-d83d-4e11-bfb2-758b2e233e7a
Aug 15 19:35:25 user nova-compute[73188]: INFO nova.virt.block_device [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Attempting to driver detach volume 64331ef0-d83d-4e11-bfb2-758b2e233e7a from mountpoint /dev/vdb
Aug 15 19:35:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Attempting to detach device vdb from instance 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:35:25 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:35:25 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:35:25 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:35:25 user nova-compute[73188]:   <serial>64331ef0-d83d-4e11-bfb2-758b2e233e7a</serial>
Aug 15 19:35:25 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:35:25 user nova-compute[73188]: </disk>
Aug 15 19:35:25 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:35:25 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Successfully detached device vdb from instance 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d from the persistent domain config.
Aug 15 19:35:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:35:25 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:35:25 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:35:25 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:35:25 user nova-compute[73188]:   <serial>64331ef0-d83d-4e11-bfb2-758b2e233e7a</serial>
Aug 15 19:35:25 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:35:25 user nova-compute[73188]: </disk>
Aug 15 19:35:25 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692128125.738554, 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:35:25 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Successfully detached device vdb from instance 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d from the live domain config.
Aug 15 19:35:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YZOxSCWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:35:25 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:35:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9720910e-5a7a-44d7-bb5a-6998a8181e6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG nova.compute.manager [req-77bf912b-d7a5-4019-9fba-22355e9c4d96 req-a530fb3d-1013-4d3b-ac52-48786f1d8e96 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Received event network-vif-plugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-77bf912b-d7a5-4019-9fba-22355e9c4d96 req-a530fb3d-1013-4d3b-ac52-48786f1d8e96 service nova] Acquiring lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-77bf912b-d7a5-4019-9fba-22355e9c4d96 req-a530fb3d-1013-4d3b-ac52-48786f1d8e96 service nova] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-77bf912b-d7a5-4019-9fba-22355e9c4d96 req-a530fb3d-1013-4d3b-ac52-48786f1d8e96 service nova] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG nova.compute.manager [req-77bf912b-d7a5-4019-9fba-22355e9c4d96 req-a530fb3d-1013-4d3b-ac52-48786f1d8e96 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] No waiting events found dispatching network-vif-plugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:35:25 user nova-compute[73188]: WARNING nova.compute.manager [req-77bf912b-d7a5-4019-9fba-22355e9c4d96 req-a530fb3d-1013-4d3b-ac52-48786f1d8e96 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Received unexpected event network-vif-plugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3611aef6-09b2-4b0c-a80f-1a0597239cbd]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 (non-flash)
Aug 15 19:35:25 user nova-compute[73188]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a (non-flash)
Aug 15 19:35:25 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 (non-flash)
Aug 15 19:35:25 user nova-compute[73188]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a (non-flash)
Aug 15 19:35:25 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281014f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a'): ({'sdb'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Removing single pathed devices sdb {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb310ba-5e97-41b2-9065-e02404416c6e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81d012c-903a-460c-8600-0594f0438d34]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Flushing IO for device /dev/sdb {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[63aaf403-146b-443c-a99e-e64f682172b9]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f84fd6-9cda-4aff-9464-a26b8b2fe0ca]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[63caddd8-4a24-46e6-9b08-9ab85e107992]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:35:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:26 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52c1a07-aedf-4e09-96fd-fdcdab935150]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a, portal: 172.16.0.220,3260]
Aug 15 19:35:26 user nova-compute[73188]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a, portal: 172.16.0.220,3260] successful.
Aug 15 19:35:26 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:35:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64331ef0-d83d-4e11-bfb2-758b2e233e7a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:26 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bedbbe-b5ed-4f96-ad81-adcdc18b1188]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:35:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:35:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:35:26 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] <== disconnect_volume: return (279ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:35:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:35:26 user nova-compute[73188]: DEBUG nova.objects.instance [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lazy-loading 'flavor' on Instance uuid 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:35:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-14ebeaa1-5c80-4b58-9198-da0c78058625 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.632s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:35:26 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Snapshot image upload complete
Aug 15 19:35:26 user nova-compute[73188]: DEBUG nova.compute.manager [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:35:27 user nova-compute[73188]: INFO nova.compute.manager [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Shelve offloading
Aug 15 19:35:27 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Instance destroyed successfully.
Aug 15 19:35:27 user nova-compute[73188]: DEBUG nova.compute.manager [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:35:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:35:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquired lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:35:27 user nova-compute[73188]: DEBUG nova.network.neutron [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:35:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:27 user nova-compute[73188]: DEBUG nova.network.neutron [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Updating instance_info_cache with network_info: [{"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fa5237-0a", "ovs_interfaceid": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:35:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Releasing lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:35:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:28 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Instance destroyed successfully.
Aug 15 19:35:28 user nova-compute[73188]: DEBUG nova.objects.instance [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'resources' on Instance uuid 1c992ecd-ac21-44e7-937c-b19028cc95c2 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:35:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-899178377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-899178377',id=47,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJWfFiblUIxO45fvcHFyaFxnFyqoFEPiOpvAeB5891ntCBT24TtXi1NaeFYPpa1oVaW8yMFBytF1mLakrHIeM0NduhCTsFyJXwHHx4r86jNa94MH9PX63//JN20aalewA==',key_name='tempest-keypair-1267490924',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:33:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='409362f6976b454ba96b7580b35db949',ramdisk_id='',reservation_id='r-0uo6aeyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1675372664',owner_user_name='tempest-AttachVolumeShelveTestJSON-1675372664-project-member',shelved_at='2023-08-15T19:35:26.990340',shelved_host='user',shelved_image_id='25ef85cd-a1a4-40fa-93a1-6ed8dac91054'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:35:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7df4b06e72a452ca1dd4643694ce570',uuid=1c992ecd-ac21-44e7-937c-b19028cc95c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fa5237-0a", "ovs_interfaceid": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:35:28 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converting VIF {"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fa5237-0a", "ovs_interfaceid": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:35:28 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:d4:70,bridge_name='br-int',has_traffic_filtering=True,id=17fa5237-0a8d-4f42-956d-d4a9732b4539,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fa5237-0a') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:35:28 user nova-compute[73188]: DEBUG os_vif [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:d4:70,bridge_name='br-int',has_traffic_filtering=True,id=17fa5237-0a8d-4f42-956d-d4a9732b4539,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fa5237-0a') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:35:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17fa5237-0a, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:35:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:35:28 user nova-compute[73188]: INFO os_vif [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:d4:70,bridge_name='br-int',has_traffic_filtering=True,id=17fa5237-0a8d-4f42-956d-d4a9732b4539,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fa5237-0a')
Aug 15 19:35:28 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Deleting instance files /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2_del
Aug 15 19:35:28 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Deletion of /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2_del complete
Aug 15 19:35:28 user nova-compute[73188]: DEBUG nova.compute.manager [req-d3cea540-a3d9-4b23-a8eb-6422c17bf7fc req-25887134-3fff-4eb1-b2db-f49ea4caa75d service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Received event network-changed-17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:35:28 user nova-compute[73188]: DEBUG nova.compute.manager [req-d3cea540-a3d9-4b23-a8eb-6422c17bf7fc req-25887134-3fff-4eb1-b2db-f49ea4caa75d service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Refreshing instance network info cache due to event network-changed-17fa5237-0a8d-4f42-956d-d4a9732b4539. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:35:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d3cea540-a3d9-4b23-a8eb-6422c17bf7fc req-25887134-3fff-4eb1-b2db-f49ea4caa75d service nova] Acquiring lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:35:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d3cea540-a3d9-4b23-a8eb-6422c17bf7fc req-25887134-3fff-4eb1-b2db-f49ea4caa75d service nova] Acquired lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:35:28 user nova-compute[73188]: DEBUG nova.network.neutron [req-d3cea540-a3d9-4b23-a8eb-6422c17bf7fc req-25887134-3fff-4eb1-b2db-f49ea4caa75d service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Refreshing network info cache for port 17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:35:28 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Deleted allocations for instance 1c992ecd-ac21-44e7-937c-b19028cc95c2
Aug 15 19:35:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:35:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:35:28 user nova-compute[73188]: DEBUG nova.objects.instance [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'numa_topology' on Instance uuid 1c992ecd-ac21-44e7-937c-b19028cc95c2 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:35:28 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:35:28 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:35:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:35:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-572f25a7-13df-4fe2-bb46-90159f45151e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.600s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:35:29 user nova-compute[73188]: DEBUG nova.network.neutron [req-d3cea540-a3d9-4b23-a8eb-6422c17bf7fc req-25887134-3fff-4eb1-b2db-f49ea4caa75d service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Updated VIF entry in instance network info cache for port 17fa5237-0a8d-4f42-956d-d4a9732b4539. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:35:29 user nova-compute[73188]: DEBUG nova.network.neutron [req-d3cea540-a3d9-4b23-a8eb-6422c17bf7fc req-25887134-3fff-4eb1-b2db-f49ea4caa75d service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Updating instance_info_cache with network_info: [{"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap17fa5237-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:35:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-d3cea540-a3d9-4b23-a8eb-6422c17bf7fc req-25887134-3fff-4eb1-b2db-f49ea4caa75d service nova] Releasing lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:35:30 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:35:33 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:35:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:35 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:35:35 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:35:35 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:35:36 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:35:36 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:35:36 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Skipping network cache update for instance because it has been migrated to another host. {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 15 19:35:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:35:36 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:35:36 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:35:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:37 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Updating instance_info_cache with network_info: [{"id": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "address": "fa:16:3e:65:2d:cb", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45104cfc-4a", "ovs_interfaceid": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:35:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:35:37 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:35:37 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:35:37 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:35:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:35:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:35:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:35:37 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:35:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:35:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e522c-e329-4c67-b96b-1ad5a515686d/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e522c-e329-4c67-b96b-1ad5a515686d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e522c-e329-4c67-b96b-1ad5a515686d/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:35:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e522c-e329-4c67-b96b-1ad5a515686d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:35:39 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692128124.2075408, 1c992ecd-ac21-44e7-937c-b19028cc95c2 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:35:39 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] VM Stopped (Lifecycle Event)
Aug 15 19:35:39 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:35:39 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:35:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8316MB free_disk=25.04491424560547GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:35:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:35:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:35:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ce69ea7e-17ce-4cc1-9d2f-82fdf41df343 None None] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:35:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance c696f77d-eb36-426f-a86d-26bfca9a1918 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:35:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance adef852b-f515-4cfd-807e-586809ff6aa6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:35:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:35:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance e81e522c-e329-4c67-b96b-1ad5a515686d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:35:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:35:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:35:39 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:35:39 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:35:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:35:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:35:42 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:35:42 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:35:43 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:35:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:49 user nova-compute[73188]: DEBUG nova.compute.manager [req-75927b27-397c-48c6-baea-474505658e17 req-3ed7fc83-72f8-4136-9fe1-ae47d996e900 service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Received event network-changed-d87505ad-01b4-404b-afff-1db7097a58c3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:35:49 user nova-compute[73188]: DEBUG nova.compute.manager [req-75927b27-397c-48c6-baea-474505658e17 req-3ed7fc83-72f8-4136-9fe1-ae47d996e900 service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Refreshing instance network info cache due to event network-changed-d87505ad-01b4-404b-afff-1db7097a58c3. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:35:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-75927b27-397c-48c6-baea-474505658e17 req-3ed7fc83-72f8-4136-9fe1-ae47d996e900 service nova] Acquiring lock "refresh_cache-e81e522c-e329-4c67-b96b-1ad5a515686d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:35:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-75927b27-397c-48c6-baea-474505658e17 req-3ed7fc83-72f8-4136-9fe1-ae47d996e900 service nova] Acquired lock "refresh_cache-e81e522c-e329-4c67-b96b-1ad5a515686d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:35:49 user nova-compute[73188]: DEBUG nova.network.neutron [req-75927b27-397c-48c6-baea-474505658e17 req-3ed7fc83-72f8-4136-9fe1-ae47d996e900 service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Refreshing network info cache for port d87505ad-01b4-404b-afff-1db7097a58c3 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "e81e522c-e329-4c67-b96b-1ad5a515686d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "e81e522c-e329-4c67-b96b-1ad5a515686d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "e81e522c-e329-4c67-b96b-1ad5a515686d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "e81e522c-e329-4c67-b96b-1ad5a515686d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "e81e522c-e329-4c67-b96b-1ad5a515686d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:35:50 user nova-compute[73188]: INFO nova.compute.manager [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Terminating instance
Aug 15 19:35:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG nova.network.neutron [req-75927b27-397c-48c6-baea-474505658e17 req-3ed7fc83-72f8-4136-9fe1-ae47d996e900 service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Updated VIF entry in instance network info cache for port d87505ad-01b4-404b-afff-1db7097a58c3. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG nova.network.neutron [req-75927b27-397c-48c6-baea-474505658e17 req-3ed7fc83-72f8-4136-9fe1-ae47d996e900 service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Updating instance_info_cache with network_info: [{"id": "d87505ad-01b4-404b-afff-1db7097a58c3", "address": "fa:16:3e:b8:a9:1a", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87505ad-01", "ovs_interfaceid": "d87505ad-01b4-404b-afff-1db7097a58c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-75927b27-397c-48c6-baea-474505658e17 req-3ed7fc83-72f8-4136-9fe1-ae47d996e900 service nova] Releasing lock "refresh_cache-e81e522c-e329-4c67-b96b-1ad5a515686d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-cbf48863-c000-4ad1-a08e-2a3801c4b3f6 req-dd239fd6-d587-4f93-a11f-82809bc8da02 service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Received event network-vif-unplugged-d87505ad-01b4-404b-afff-1db7097a58c3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cbf48863-c000-4ad1-a08e-2a3801c4b3f6 req-dd239fd6-d587-4f93-a11f-82809bc8da02 service nova] Acquiring lock "e81e522c-e329-4c67-b96b-1ad5a515686d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cbf48863-c000-4ad1-a08e-2a3801c4b3f6 req-dd239fd6-d587-4f93-a11f-82809bc8da02 service nova] Lock "e81e522c-e329-4c67-b96b-1ad5a515686d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cbf48863-c000-4ad1-a08e-2a3801c4b3f6 req-dd239fd6-d587-4f93-a11f-82809bc8da02 service nova] Lock "e81e522c-e329-4c67-b96b-1ad5a515686d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-cbf48863-c000-4ad1-a08e-2a3801c4b3f6 req-dd239fd6-d587-4f93-a11f-82809bc8da02 service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] No waiting events found dispatching network-vif-unplugged-d87505ad-01b4-404b-afff-1db7097a58c3 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG nova.compute.manager [req-cbf48863-c000-4ad1-a08e-2a3801c4b3f6 req-dd239fd6-d587-4f93-a11f-82809bc8da02 service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Received event network-vif-unplugged-d87505ad-01b4-404b-afff-1db7097a58c3 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:50 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Instance destroyed successfully.
Aug 15 19:35:50 user nova-compute[73188]: DEBUG nova.objects.instance [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lazy-loading 'resources' on Instance uuid e81e522c-e329-4c67-b96b-1ad5a515686d {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:33:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1173996320',display_name='tempest-AttachVolumeNegativeTest-server-1173996320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1173996320',id=48,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUb1PMtD8oTswjzXXWyseZMqvpzqj6wMMgoNRSc9VU2dV+axhVYzH4rN4hXacsoPXwzmLSD5zPEPZmSKbkWYNp1CTreFOlpWRSnjIvSJ4vV2hj0pRdXNEBwJL5oi2+5Gg==',key_name='tempest-keypair-1511258357',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:34:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5bc7d940cd1410a878ac89e24a4c4bc',ramdisk_id='',reservation_id='r-raeu1ake',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1373631227',owner_user_name='tempest-AttachVolumeNegativeTest-1373631227-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:34:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e526de0e03140bea2d410f535f75bb7',uuid=e81e522c-e329-4c67-b96b-1ad5a515686d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d87505ad-01b4-404b-afff-1db7097a58c3", "address": "fa:16:3e:b8:a9:1a", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87505ad-01", "ovs_interfaceid": "d87505ad-01b4-404b-afff-1db7097a58c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converting VIF {"id": "d87505ad-01b4-404b-afff-1db7097a58c3", "address": "fa:16:3e:b8:a9:1a", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87505ad-01", "ovs_interfaceid": "d87505ad-01b4-404b-afff-1db7097a58c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a9:1a,bridge_name='br-int',has_traffic_filtering=True,id=d87505ad-01b4-404b-afff-1db7097a58c3,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87505ad-01') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG os_vif [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a9:1a,bridge_name='br-int',has_traffic_filtering=True,id=d87505ad-01b4-404b-afff-1db7097a58c3,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87505ad-01') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd87505ad-01, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:35:50 user nova-compute[73188]: INFO os_vif [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a9:1a,bridge_name='br-int',has_traffic_filtering=True,id=d87505ad-01b4-404b-afff-1db7097a58c3,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87505ad-01')
Aug 15 19:35:50 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Deleting instance files /opt/stack/data/nova/instances/e81e522c-e329-4c67-b96b-1ad5a515686d_del
Aug 15 19:35:50 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Deletion of /opt/stack/data/nova/instances/e81e522c-e329-4c67-b96b-1ad5a515686d_del complete
Aug 15 19:35:50 user nova-compute[73188]: INFO nova.compute.manager [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 15 19:35:50 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:35:50 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:35:51 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:35:51 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Took 0.72 seconds to deallocate network for instance.
Aug 15 19:35:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:35:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:35:51 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:35:51 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:35:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:35:51 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Deleted allocations for instance e81e522c-e329-4c67-b96b-1ad5a515686d
Aug 15 19:35:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6fa7fff8-e583-42be-a5ee-32262475b5ed tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "e81e522c-e329-4c67-b96b-1ad5a515686d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.756s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:35:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:35:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-8ecca8f2-0dc7-4d8d-85f9-56869b7b5c51 req-6136a6eb-54b4-4034-a904-47cf2ce2952d service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Received event network-vif-plugged-d87505ad-01b4-404b-afff-1db7097a58c3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:35:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8ecca8f2-0dc7-4d8d-85f9-56869b7b5c51 req-6136a6eb-54b4-4034-a904-47cf2ce2952d service nova] Acquiring lock "e81e522c-e329-4c67-b96b-1ad5a515686d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:35:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8ecca8f2-0dc7-4d8d-85f9-56869b7b5c51 req-6136a6eb-54b4-4034-a904-47cf2ce2952d service nova] Lock "e81e522c-e329-4c67-b96b-1ad5a515686d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:35:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8ecca8f2-0dc7-4d8d-85f9-56869b7b5c51 req-6136a6eb-54b4-4034-a904-47cf2ce2952d service nova] Lock "e81e522c-e329-4c67-b96b-1ad5a515686d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:35:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-8ecca8f2-0dc7-4d8d-85f9-56869b7b5c51 req-6136a6eb-54b4-4034-a904-47cf2ce2952d service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] No waiting events found dispatching network-vif-plugged-d87505ad-01b4-404b-afff-1db7097a58c3 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:35:52 user nova-compute[73188]: WARNING nova.compute.manager [req-8ecca8f2-0dc7-4d8d-85f9-56869b7b5c51 req-6136a6eb-54b4-4034-a904-47cf2ce2952d service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Received unexpected event network-vif-plugged-d87505ad-01b4-404b-afff-1db7097a58c3 for instance with vm_state deleted and task_state None.
Aug 15 19:35:52 user nova-compute[73188]: DEBUG nova.compute.manager [req-8ecca8f2-0dc7-4d8d-85f9-56869b7b5c51 req-6136a6eb-54b4-4034-a904-47cf2ce2952d service nova] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Received event network-vif-deleted-d87505ad-01b4-404b-afff-1db7097a58c3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:35:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:36:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:36:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:36:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:36:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:36:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:36:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:36:05 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692128150.666688, e81e522c-e329-4c67-b96b-1ad5a515686d => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:36:05 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] VM Stopped (Lifecycle Event)
Aug 15 19:36:05 user nova-compute[73188]: DEBUG nova.compute.manager [None req-52de91c6-01b7-4d4f-ae1a-a7e51c4a8746 None None] [instance: e81e522c-e329-4c67-b96b-1ad5a515686d] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:36:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:36:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:36:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:36:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:36:15 user nova-compute[73188]: DEBUG nova.compute.manager [req-322fb14a-59db-434a-a385-1ee84f151e60 req-43647f44-a0ee-4a54-a74c-7c7ef9479e0c service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Received event network-changed-45104cfc-4a0b-4de5-bdd2-406a908a4de4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:36:15 user nova-compute[73188]: DEBUG nova.compute.manager [req-322fb14a-59db-434a-a385-1ee84f151e60 req-43647f44-a0ee-4a54-a74c-7c7ef9479e0c service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Refreshing instance network info cache due to event network-changed-45104cfc-4a0b-4de5-bdd2-406a908a4de4. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:36:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-322fb14a-59db-434a-a385-1ee84f151e60 req-43647f44-a0ee-4a54-a74c-7c7ef9479e0c service nova] Acquiring lock "refresh_cache-2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:36:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-322fb14a-59db-434a-a385-1ee84f151e60 req-43647f44-a0ee-4a54-a74c-7c7ef9479e0c service nova] Acquired lock "refresh_cache-2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:36:15 user nova-compute[73188]: DEBUG nova.network.neutron [req-322fb14a-59db-434a-a385-1ee84f151e60 req-43647f44-a0ee-4a54-a74c-7c7ef9479e0c service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Refreshing network info cache for port 45104cfc-4a0b-4de5-bdd2-406a908a4de4 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:36:16 user nova-compute[73188]: INFO nova.compute.manager [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Terminating instance
Aug 15 19:36:16 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG nova.compute.manager [req-e17425f1-3cd3-4b16-99e4-8603929fd29f req-b5382821-9ff6-45fc-9c94-3492f7e136b9 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Received event network-vif-unplugged-45104cfc-4a0b-4de5-bdd2-406a908a4de4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e17425f1-3cd3-4b16-99e4-8603929fd29f req-b5382821-9ff6-45fc-9c94-3492f7e136b9 service nova] Acquiring lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e17425f1-3cd3-4b16-99e4-8603929fd29f req-b5382821-9ff6-45fc-9c94-3492f7e136b9 service nova] Lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e17425f1-3cd3-4b16-99e4-8603929fd29f req-b5382821-9ff6-45fc-9c94-3492f7e136b9 service nova] Lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG nova.compute.manager [req-e17425f1-3cd3-4b16-99e4-8603929fd29f req-b5382821-9ff6-45fc-9c94-3492f7e136b9 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] No waiting events found dispatching network-vif-unplugged-45104cfc-4a0b-4de5-bdd2-406a908a4de4 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG nova.compute.manager [req-e17425f1-3cd3-4b16-99e4-8603929fd29f req-b5382821-9ff6-45fc-9c94-3492f7e136b9 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Received event network-vif-unplugged-45104cfc-4a0b-4de5-bdd2-406a908a4de4 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG nova.network.neutron [req-322fb14a-59db-434a-a385-1ee84f151e60 req-43647f44-a0ee-4a54-a74c-7c7ef9479e0c service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Updated VIF entry in instance network info cache for port 45104cfc-4a0b-4de5-bdd2-406a908a4de4. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG nova.network.neutron [req-322fb14a-59db-434a-a385-1ee84f151e60 req-43647f44-a0ee-4a54-a74c-7c7ef9479e0c service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Updating instance_info_cache with network_info: [{"id": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "address": "fa:16:3e:65:2d:cb", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45104cfc-4a", "ovs_interfaceid": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-322fb14a-59db-434a-a385-1ee84f151e60 req-43647f44-a0ee-4a54-a74c-7c7ef9479e0c service nova] Releasing lock "refresh_cache-2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:36:16 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Instance destroyed successfully.
Aug 15 19:36:16 user nova-compute[73188]: DEBUG nova.objects.instance [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lazy-loading 'resources' on Instance uuid 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:33:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-216469633',display_name='tempest-TestStampPattern-server-216469633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-216469633',id=46,image_ref='552a0088-c6d2-4131-b4b9-d9d08f18e66a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPttPXTMMfrjFLW7G+VtG1rMa5FI1ksBOcYrsCtyrYTreKkrGoeDmah2iW0MvYJZ2Kgf5QUOX0XjOu9+OQOllEXo6T6FtGW/D6IrYtS7SxmNxxryUDEUap8dr1QEagH2lQ==',key_name='tempest-TestStampPattern-390215866',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:33:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ffec07b2185b4bd4a14793f9885a43d0',ramdisk_id='',reservation_id='r-hdb2wrz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c696f77d-eb36-426f-a86d-26bfca9a1918',image_min_disk='1',image_min_ram='0',image_owner_id='ffec07b2185b4bd4a14793f9885a43d0',image_owner_project_name='tempest-TestStampPattern-1547019054',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1547019054-project-member',image_user_id='ae2fd38dc21248609f17533079193d2d',owner_project_name='tempest-TestStampPattern-1547019054',owner_user_name='tempest-TestStampPattern-1547019054-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:33:28Z,user_data=None,user_id='ae2fd38dc21248609f17533079193d2d',uuid=2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "address": "fa:16:3e:65:2d:cb", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45104cfc-4a", "ovs_interfaceid": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Converting VIF {"id": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "address": "fa:16:3e:65:2d:cb", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45104cfc-4a", "ovs_interfaceid": "45104cfc-4a0b-4de5-bdd2-406a908a4de4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:2d:cb,bridge_name='br-int',has_traffic_filtering=True,id=45104cfc-4a0b-4de5-bdd2-406a908a4de4,network=Network(e3f0d46e-35ab-4b09-ac9d-ee8728aa820a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45104cfc-4a') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG os_vif [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:2d:cb,bridge_name='br-int',has_traffic_filtering=True,id=45104cfc-4a0b-4de5-bdd2-406a908a4de4,network=Network(e3f0d46e-35ab-4b09-ac9d-ee8728aa820a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45104cfc-4a') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45104cfc-4a, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:36:16 user nova-compute[73188]: INFO os_vif [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:2d:cb,bridge_name='br-int',has_traffic_filtering=True,id=45104cfc-4a0b-4de5-bdd2-406a908a4de4,network=Network(e3f0d46e-35ab-4b09-ac9d-ee8728aa820a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45104cfc-4a')
Aug 15 19:36:16 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Deleting instance files /opt/stack/data/nova/instances/2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d_del
Aug 15 19:36:16 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Deletion of /opt/stack/data/nova/instances/2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d_del complete
Aug 15 19:36:16 user nova-compute[73188]: INFO nova.compute.manager [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 15 19:36:16 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:36:16 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:36:17 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:36:17 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Took 0.49 seconds to deallocate network for instance.
Aug 15 19:36:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:36:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:36:17 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:36:17 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:36:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:36:17 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Deleted allocations for instance 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d
Aug 15 19:36:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ec544b2b-d33f-4916-bd6f-5aad41efcee1 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.700s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:36:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-1dd8bd62-428b-4271-ae11-3b5db30e161e req-d4083af2-3eaf-473e-bb8b-c3e4ac964428 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Received event network-vif-deleted-45104cfc-4a0b-4de5-bdd2-406a908a4de4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:36:18 user nova-compute[73188]: DEBUG nova.compute.manager [req-8833f6d2-e7fb-4383-ae84-8608af6e2ae6 req-34cadd4f-46c3-4cf0-956a-d1b298937199 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Received event network-vif-plugged-45104cfc-4a0b-4de5-bdd2-406a908a4de4 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:36:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8833f6d2-e7fb-4383-ae84-8608af6e2ae6 req-34cadd4f-46c3-4cf0-956a-d1b298937199 service nova] Acquiring lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:36:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8833f6d2-e7fb-4383-ae84-8608af6e2ae6 req-34cadd4f-46c3-4cf0-956a-d1b298937199 service nova] Lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:36:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8833f6d2-e7fb-4383-ae84-8608af6e2ae6 req-34cadd4f-46c3-4cf0-956a-d1b298937199 service nova] Lock "2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:36:18 user nova-compute[73188]: DEBUG nova.compute.manager [req-8833f6d2-e7fb-4383-ae84-8608af6e2ae6 req-34cadd4f-46c3-4cf0-956a-d1b298937199 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] No waiting events found dispatching network-vif-plugged-45104cfc-4a0b-4de5-bdd2-406a908a4de4 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:36:18 user nova-compute[73188]: WARNING nova.compute.manager [req-8833f6d2-e7fb-4383-ae84-8608af6e2ae6 req-34cadd4f-46c3-4cf0-956a-d1b298937199 service nova] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Received unexpected event network-vif-plugged-45104cfc-4a0b-4de5-bdd2-406a908a4de4 for instance with vm_state deleted and task_state None.
Aug 15 19:36:21 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:36:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:36:30 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:36:31 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692128176.7874491, 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:36:31 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] VM Stopped (Lifecycle Event)
Aug 15 19:36:31 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ba106efd-2def-401a-934e-093058fb7db1 None None] [instance: 2e8956f6-d43c-4b0b-86c6-9e6ffcd13b4d] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:36:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:36:34 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:36:34 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:36:35 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:36:35 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:36:36 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:36:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:36:37 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:36:37 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:36:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:36:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:36:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:36:37 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:36:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:36:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:36:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:36:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:36:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:36:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:36:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:36:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:36:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:36:38 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:36:38 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:36:38 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8513MB free_disk=25.073200225830078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:36:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:36:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:36:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance c696f77d-eb36-426f-a86d-26bfca9a1918 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:36:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance adef852b-f515-4cfd-807e-586809ff6aa6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:36:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:36:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:36:39 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing inventories for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 19:36:39 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Updating ProviderTree inventory for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 19:36:39 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Updating inventory in ProviderTree for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 19:36:39 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing aggregate associations for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5, aggregates: None {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 19:36:39 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing trait associations for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 19:36:39 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:36:39 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:36:39 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:36:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:36:40 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:36:40 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:36:40 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:36:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-c696f77d-eb36-426f-a86d-26bfca9a1918" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:36:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-c696f77d-eb36-426f-a86d-26bfca9a1918" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:36:40 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:36:40 user nova-compute[73188]: DEBUG nova.objects.instance [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lazy-loading 'info_cache' on Instance uuid c696f77d-eb36-426f-a86d-26bfca9a1918 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:36:40 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Updating instance_info_cache with network_info: [{"id": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "address": "fa:16:3e:48:2b:43", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c74787-4e", "ovs_interfaceid": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:36:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-c696f77d-eb36-426f-a86d-26bfca9a1918" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:36:40 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "adef852b-f515-4cfd-807e-586809ff6aa6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "adef852b-f515-4cfd-807e-586809ff6aa6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:36:41 user nova-compute[73188]: INFO nova.compute.manager [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Detaching volume 90990e6b-f644-4234-874c-77f2b060a595
Aug 15 19:36:41 user nova-compute[73188]: INFO nova.virt.block_device [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Attempting to driver detach volume 90990e6b-f644-4234-874c-77f2b060a595 from mountpoint /dev/vdb
Aug 15 19:36:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Attempting to detach device vdb from instance adef852b-f515-4cfd-807e-586809ff6aa6 from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:36:41 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:36:41 user nova-compute[73188]:   <source dev="/dev/sdc"/>
Aug 15 19:36:41 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:36:41 user nova-compute[73188]:   <serial>90990e6b-f644-4234-874c-77f2b060a595</serial>
Aug 15 19:36:41 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:36:41 user nova-compute[73188]: </disk>
Aug 15 19:36:41 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:36:41 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Successfully detached device vdb from instance adef852b-f515-4cfd-807e-586809ff6aa6 from the persistent domain config.
Aug 15 19:36:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance adef852b-f515-4cfd-807e-586809ff6aa6 from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:36:41 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:36:41 user nova-compute[73188]:   <source dev="/dev/sdc"/>
Aug 15 19:36:41 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:36:41 user nova-compute[73188]:   <serial>90990e6b-f644-4234-874c-77f2b060a595</serial>
Aug 15 19:36:41 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:36:41 user nova-compute[73188]: </disk>
Aug 15 19:36:41 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692128201.8770287, adef852b-f515-4cfd-807e-586809ff6aa6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance adef852b-f515-4cfd-807e-586809ff6aa6 {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:36:41 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Successfully detached device vdb from instance adef852b-f515-4cfd-807e-586809ff6aa6 from the live domain config.
Aug 15 19:36:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBbENfoq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:36:41 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:36:41 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d580c0e-47b4-4f61-ba9a-628efd712327]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bb5eac-c212-4f82-8bf0-0c3cd325a349]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 (non-flash)
Aug 15 19:36:41 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 (non-flash)
Aug 15 19:36:41 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e47f4b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595'): ({'sdc'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Removing single pathed devices sdc {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f4b81a-3a32-4298-9706-b5b714b340ee]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c680b3-0239-4cae-bfc8-3164beb882ed]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Flushing IO for device /dev/sdc {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3c2687-3fac-40ea-9ad3-ad10e42fdddf]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:36:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:36:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:36:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c4081d-385e-4930-b4d1-1a5436608968]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:36:42 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:36:42 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] SCSI volumes sdc have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:36:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:36:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:36:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:36:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa3b5bc-e4d3-4a0f-8b9b-a6aba3ae0a95]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:36:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:36:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:36:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:36:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9776778a-2102-4a38-92c1-e92e5ffdb6b6]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:36:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595, portal: 172.16.0.220,3260]
Aug 15 19:36:42 user nova-compute[73188]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595, portal: 172.16.0.220,3260] successful.
Aug 15 19:36:42 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:36:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:36:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90990e6b-f644-4234-874c-77f2b060a595 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:36:42 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b5b6a0-9177-4c3e-b856-96546e2bd920]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:36:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:36:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.243s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:36:42 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] <== disconnect_volume: return (244ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:36:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:36:42 user nova-compute[73188]: DEBUG nova.objects.instance [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lazy-loading 'flavor' on Instance uuid adef852b-f515-4cfd-807e-586809ff6aa6 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:36:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-dd1ee82d-de28-4599-bb00-9ced45a7a295 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "adef852b-f515-4cfd-807e-586809ff6aa6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.605s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:36:43 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:36:44 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:36:46 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:36:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquiring lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:36:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:36:47 user nova-compute[73188]: INFO nova.compute.manager [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Unshelving
Aug 15 19:36:47 user nova-compute[73188]: INFO nova.virt.block_device [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Booting with volume 1c52c974-f228-478e-8933-e1769a2d67a3 at /dev/vda
Aug 15 19:36:47 user nova-compute[73188]: DEBUG os_brick.utils [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:36:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:36:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:36:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3018ae3-a7bc-4d73-b519-ed06817b5e18]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:36:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:36:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:36:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbc0440-c17b-41b4-9261-5b627251d2fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:36:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:36:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:36:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cc694f-9a54-463a-bdd3-1add0b9ba04a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:36:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[59affed9-7d4f-48e3-b874-d7a620a24632]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:36:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:36:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:36:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:36:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:36:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:36:47 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:36:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8272a2-591d-4c49-914a-f6c1ef1e86a3]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:36:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:36:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:36:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:36:47 user nova-compute[73188]: DEBUG os_brick.utils [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:36:47 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Updating existing volume attachment record: 389ebdf4-f55f-4766-8cfa-5ec531963dfd {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:36:48 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:36:48 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=73188) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 19:36:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:36:56 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:36:57 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:36:57 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Cleaning up deleted instances {{(pid=73188) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 19:36:57 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] There are 0 instances to clean {{(pid=73188) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 19:37:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:37:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:37:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:37:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:37:01 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:02 user nova-compute[73188]: DEBUG nova.objects.instance [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lazy-loading 'pci_requests' on Instance uuid 6e48fce8-e4d4-4e30-a67e-5d81036b14cc {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:37:02 user nova-compute[73188]: DEBUG nova.objects.instance [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lazy-loading 'numa_topology' on Instance uuid 6e48fce8-e4d4-4e30-a67e-5d81036b14cc {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:37:02 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:37:02 user nova-compute[73188]: INFO nova.compute.claims [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Claim successful on node user
Aug 15 19:37:02 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:37:02 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:37:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.272s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:02 user nova-compute[73188]: INFO nova.network.neutron [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Updating port 14f35d48-3eee-47e2-84b7-d5805df1d826 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 19:37:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquiring lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:37:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquired lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:37:03 user nova-compute[73188]: DEBUG nova.network.neutron [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:37:03 user nova-compute[73188]: DEBUG nova.compute.manager [req-57c0cf42-09d6-4c99-905f-9ea5a0cc50aa req-ebe2899b-b4e7-4b2e-b149-bb73946a42ca service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Received event network-changed-14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:37:03 user nova-compute[73188]: DEBUG nova.compute.manager [req-57c0cf42-09d6-4c99-905f-9ea5a0cc50aa req-ebe2899b-b4e7-4b2e-b149-bb73946a42ca service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Refreshing instance network info cache due to event network-changed-14f35d48-3eee-47e2-84b7-d5805df1d826. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:37:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-57c0cf42-09d6-4c99-905f-9ea5a0cc50aa req-ebe2899b-b4e7-4b2e-b149-bb73946a42ca service nova] Acquiring lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.network.neutron [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Updating instance_info_cache with network_info: [{"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f35d48-3e", "ovs_interfaceid": "14f35d48-3eee-47e2-84b7-d5805df1d826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Releasing lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:37:04 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Creating image(s)
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Did not create local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Ensure instance console log exists: /opt/stack/data/nova/instances/6e48fce8-e4d4-4e30-a67e-5d81036b14cc/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Start _get_guest_xml network_info=[{"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f35d48-3e", "ovs_interfaceid": "14f35d48-3eee-47e2-84b7-d5805df1d826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jEJQyGcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6e48fce8-e4d4-4e30-a67e-5d81036b14cc', 'attached_at': '', 'detached_at': '', 'volume_id': '1c52c974-f228-478e-8933-e1769a2d67a3', 'serial': '1c52c974-f228-478e-8933-e1769a2d67a3'}, 'attachment_id': '389ebdf4-f55f-4766-8cfa-5ec531963dfd', 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-57c0cf42-09d6-4c99-905f-9ea5a0cc50aa req-ebe2899b-b4e7-4b2e-b149-bb73946a42ca service nova] Acquired lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.network.neutron [req-57c0cf42-09d6-4c99-905f-9ea5a0cc50aa req-ebe2899b-b4e7-4b2e-b149-bb73946a42ca service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Refreshing network info cache for port 14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:37:04 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:37:04 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.objects.instance [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6e48fce8-e4d4-4e30-a67e-5d81036b14cc {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jEJQyGcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:37:04 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:37:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:37:04 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:37:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:37:04 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e354ef66-b1c1-470b-865a-19635810a95e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:37:04 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08371b3-8af4-4fb8-a6b3-c791935bb63d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3] added
Aug 15 19:37:04 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd5745d-f241-419f-84db-c920c4216d33]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fec543-1b98-403f-bdfb-e0721d979e9f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jEJQyGcB {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jEJQyGcB" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c67ce6-0d50-49a1-8cab-a43e07a18174]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jEJQyGcB'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7384d45-e9ca-40db-9de1-4733cd68595e]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde796bc-aac8-4d29-9b1a-b5d5708dddbc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 19:37:04 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 19:37:04 user nova-compute[73188]:  {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:37:04 user nova-compute[73188]: WARNING os_brick.initiator.connectors.iscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 19:37:04 user nova-compute[73188]: 
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0d5db9-72a3-4e1f-83cd-719257bc6fc1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3, portal: 172.16.0.220,3260]
Aug 15 19:37:04 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3, portal: 172.16.0.220,3260] successful.
Aug 15 19:37:04 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[deeee8da-5f90-40eb-976c-e2b70760ebb7]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[df355c08-cea7-4bfd-8eb2-2f5ea052e5bd]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 (non-flash)
Aug 15 19:37:04 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 (non-flash)
Aug 15 19:37:04 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[87713779-2958-4d84-b1cb-0dcc3ee7c04e]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.network.neutron [req-57c0cf42-09d6-4c99-905f-9ea5a0cc50aa req-ebe2899b-b4e7-4b2e-b149-bb73946a42ca service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Updated VIF entry in instance network info cache for port 14f35d48-3eee-47e2-84b7-d5805df1d826. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG nova.network.neutron [req-57c0cf42-09d6-4c99-905f-9ea5a0cc50aa req-ebe2899b-b4e7-4b2e-b149-bb73946a42ca service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Updating instance_info_cache with network_info: [{"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f35d48-3e", "ovs_interfaceid": "14f35d48-3eee-47e2-84b7-d5805df1d826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:37:04 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-57c0cf42-09d6-4c99-905f-9ea5a0cc50aa req-ebe2899b-b4e7-4b2e-b149-bb73946a42ca service nova] Releasing lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jEJQyGcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '26436326339623365', 'path': '/dev/sdb'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436326339623365', 'path': '/dev/sdb'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T19:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2091190492',display_name='tempest-TestShelveInstance-server-2091190492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2091190492',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1880994155',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:33:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b6e83dc2ac5e4beb9043d1539bba6ddb',ramdisk_id='',reservation_id='r-a5dttlzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-704396217',owner_user_name='tempest-TestShelveInstance-704396217-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:36:48Z,user_data=None,user_id='d432668099f24666a003c56ec5ca4001',uuid=6e48fce8-e4d4-4e30-a67e-5d81036b14cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f35d48-3e", "ovs_interfaceid": "14f35d48-3eee-47e2-84b7-d5805df1d826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Converting VIF {"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f35d48-3e", "ovs_interfaceid": "14f35d48-3eee-47e2-84b7-d5805df1d826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:4e:1a,bridge_name='br-int',has_traffic_filtering=True,id=14f35d48-3eee-47e2-84b7-d5805df1d826,network=Network(943da617-81f7-4b12-8278-0ce36f9f1d20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f35d48-3e') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG nova.objects.instance [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e48fce8-e4d4-4e30-a67e-5d81036b14cc {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:37:05 user nova-compute[73188]:   <uuid>6e48fce8-e4d4-4e30-a67e-5d81036b14cc</uuid>
Aug 15 19:37:05 user nova-compute[73188]:   <name>instance-0000002d</name>
Aug 15 19:37:05 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:37:05 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:37:05 user nova-compute[73188]:   <metadata>
Aug 15 19:37:05 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:37:05 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:37:05 user nova-compute[73188]:       <nova:name>tempest-TestShelveInstance-server-2091190492</nova:name>
Aug 15 19:37:05 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:37:04</nova:creationTime>
Aug 15 19:37:05 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:37:05 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:37:05 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:37:05 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:37:05 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:37:05 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:37:05 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:37:05 user nova-compute[73188]:       <nova:owner>
Aug 15 19:37:05 user nova-compute[73188]:         <nova:user uuid="d432668099f24666a003c56ec5ca4001">tempest-TestShelveInstance-704396217-project-member</nova:user>
Aug 15 19:37:05 user nova-compute[73188]:         <nova:project uuid="b6e83dc2ac5e4beb9043d1539bba6ddb">tempest-TestShelveInstance-704396217</nova:project>
Aug 15 19:37:05 user nova-compute[73188]:       </nova:owner>
Aug 15 19:37:05 user nova-compute[73188]:       <nova:ports>
Aug 15 19:37:05 user nova-compute[73188]:         <nova:port uuid="14f35d48-3eee-47e2-84b7-d5805df1d826">
Aug 15 19:37:05 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 19:37:05 user nova-compute[73188]:         </nova:port>
Aug 15 19:37:05 user nova-compute[73188]:       </nova:ports>
Aug 15 19:37:05 user nova-compute[73188]:     </nova:instance>
Aug 15 19:37:05 user nova-compute[73188]:   </metadata>
Aug 15 19:37:05 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:37:05 user nova-compute[73188]:     <system>
Aug 15 19:37:05 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:37:05 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:37:05 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:37:05 user nova-compute[73188]:       <entry name="serial">6e48fce8-e4d4-4e30-a67e-5d81036b14cc</entry>
Aug 15 19:37:05 user nova-compute[73188]:       <entry name="uuid">6e48fce8-e4d4-4e30-a67e-5d81036b14cc</entry>
Aug 15 19:37:05 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:37:05 user nova-compute[73188]:     </system>
Aug 15 19:37:05 user nova-compute[73188]:   </sysinfo>
Aug 15 19:37:05 user nova-compute[73188]:   <os>
Aug 15 19:37:05 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:37:05 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:37:05 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:37:05 user nova-compute[73188]:   </os>
Aug 15 19:37:05 user nova-compute[73188]:   <features>
Aug 15 19:37:05 user nova-compute[73188]:     <acpi/>
Aug 15 19:37:05 user nova-compute[73188]:     <apic/>
Aug 15 19:37:05 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:37:05 user nova-compute[73188]:   </features>
Aug 15 19:37:05 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:37:05 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:37:05 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:37:05 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:37:05 user nova-compute[73188]:   </clock>
Aug 15 19:37:05 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:37:05 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:37:05 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:37:05 user nova-compute[73188]:   </cpu>
Aug 15 19:37:05 user nova-compute[73188]:   <devices>
Aug 15 19:37:05 user nova-compute[73188]:     <disk type="block" device="disk">
Aug 15 19:37:05 user nova-compute[73188]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:37:05 user nova-compute[73188]:       <source dev="/dev/sdb"/>
Aug 15 19:37:05 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:37:05 user nova-compute[73188]:       <serial>1c52c974-f228-478e-8933-e1769a2d67a3</serial>
Aug 15 19:37:05 user nova-compute[73188]:     </disk>
Aug 15 19:37:05 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:37:05 user nova-compute[73188]:       <mac address="fa:16:3e:17:4e:1a"/>
Aug 15 19:37:05 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:37:05 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:37:05 user nova-compute[73188]:       <target dev="tap14f35d48-3e"/>
Aug 15 19:37:05 user nova-compute[73188]:     </interface>
Aug 15 19:37:05 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:37:05 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/6e48fce8-e4d4-4e30-a67e-5d81036b14cc/console.log" append="off"/>
Aug 15 19:37:05 user nova-compute[73188]:     </serial>
Aug 15 19:37:05 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:37:05 user nova-compute[73188]:     <video>
Aug 15 19:37:05 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:37:05 user nova-compute[73188]:     </video>
Aug 15 19:37:05 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:37:05 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:37:05 user nova-compute[73188]:     </rng>
Aug 15 19:37:05 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:37:05 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:37:05 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:37:05 user nova-compute[73188]:     </memballoon>
Aug 15 19:37:05 user nova-compute[73188]:   </devices>
Aug 15 19:37:05 user nova-compute[73188]: </domain>
Aug 15 19:37:05 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T19:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2091190492',display_name='tempest-TestShelveInstance-server-2091190492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2091190492',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1880994155',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:33:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b6e83dc2ac5e4beb9043d1539bba6ddb',ramdisk_id='',reservation_id='r-a5dttlzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-704396217',owner_user_name='tempest-TestShelveInstance-704396217-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:36:48Z,user_data=None,user_id='d432668099f24666a003c56ec5ca4001',uuid=6e48fce8-e4d4-4e30-a67e-5d81036b14cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f35d48-3e", "ovs_interfaceid": "14f35d48-3eee-47e2-84b7-d5805df1d826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Converting VIF {"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f35d48-3e", "ovs_interfaceid": "14f35d48-3eee-47e2-84b7-d5805df1d826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:4e:1a,bridge_name='br-int',has_traffic_filtering=True,id=14f35d48-3eee-47e2-84b7-d5805df1d826,network=Network(943da617-81f7-4b12-8278-0ce36f9f1d20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f35d48-3e') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG os_vif [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:4e:1a,bridge_name='br-int',has_traffic_filtering=True,id=14f35d48-3eee-47e2-84b7-d5805df1d826,network=Network(943da617-81f7-4b12-8278-0ce36f9f1d20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f35d48-3e') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14f35d48-3e, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap14f35d48-3e, col_values=(('external_ids', {'iface-id': '14f35d48-3eee-47e2-84b7-d5805df1d826', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:4e:1a', 'vm-uuid': '6e48fce8-e4d4-4e30-a67e-5d81036b14cc'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:05 user nova-compute[73188]: INFO os_vif [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:4e:1a,bridge_name='br-int',has_traffic_filtering=True,id=14f35d48-3eee-47e2-84b7-d5805df1d826,network=Network(943da617-81f7-4b12-8278-0ce36f9f1d20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f35d48-3e')
Aug 15 19:37:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:37:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] No VIF found with MAC fa:16:3e:17:4e:1a, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:37:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-869507b7-ddab-4b5e-bc78-5920c9d8d2c8 req-d3d3ea96-656e-442c-affa-3c3b3c28cfd0 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Received event network-vif-plugged-14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:37:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-869507b7-ddab-4b5e-bc78-5920c9d8d2c8 req-d3d3ea96-656e-442c-affa-3c3b3c28cfd0 service nova] Acquiring lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-869507b7-ddab-4b5e-bc78-5920c9d8d2c8 req-d3d3ea96-656e-442c-affa-3c3b3c28cfd0 service nova] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-869507b7-ddab-4b5e-bc78-5920c9d8d2c8 req-d3d3ea96-656e-442c-affa-3c3b3c28cfd0 service nova] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-869507b7-ddab-4b5e-bc78-5920c9d8d2c8 req-d3d3ea96-656e-442c-affa-3c3b3c28cfd0 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] No waiting events found dispatching network-vif-plugged-14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:37:07 user nova-compute[73188]: WARNING nova.compute.manager [req-869507b7-ddab-4b5e-bc78-5920c9d8d2c8 req-d3d3ea96-656e-442c-affa-3c3b3c28cfd0 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Received unexpected event network-vif-plugged-14f35d48-3eee-47e2-84b7-d5805df1d826 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 19:37:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:09 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692128229.0693648, 6e48fce8-e4d4-4e30-a67e-5d81036b14cc => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:37:09 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] VM Resumed (Lifecycle Event)
Aug 15 19:37:09 user nova-compute[73188]: DEBUG nova.compute.manager [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:37:09 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:37:09 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Instance spawned successfully.
Aug 15 19:37:09 user nova-compute[73188]: DEBUG nova.compute.manager [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:37:09 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:37:09 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:37:09 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:37:09 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692128229.0750144, 6e48fce8-e4d4-4e30-a67e-5d81036b14cc => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:37:09 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] VM Started (Lifecycle Event)
Aug 15 19:37:09 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:37:09 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:37:09 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:37:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6a2cd91b-4b57-4d43-9f2b-f93018cbc046 tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.563s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-b2a57287-f91d-44aa-81a1-379fd9090c80 req-ed20681e-10a3-46d3-9c5d-b107538c53fd service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Received event network-vif-plugged-14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:37:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b2a57287-f91d-44aa-81a1-379fd9090c80 req-ed20681e-10a3-46d3-9c5d-b107538c53fd service nova] Acquiring lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b2a57287-f91d-44aa-81a1-379fd9090c80 req-ed20681e-10a3-46d3-9c5d-b107538c53fd service nova] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b2a57287-f91d-44aa-81a1-379fd9090c80 req-ed20681e-10a3-46d3-9c5d-b107538c53fd service nova] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-b2a57287-f91d-44aa-81a1-379fd9090c80 req-ed20681e-10a3-46d3-9c5d-b107538c53fd service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] No waiting events found dispatching network-vif-plugged-14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:37:09 user nova-compute[73188]: WARNING nova.compute.manager [req-b2a57287-f91d-44aa-81a1-379fd9090c80 req-ed20681e-10a3-46d3-9c5d-b107538c53fd service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Received unexpected event network-vif-plugged-14f35d48-3eee-47e2-84b7-d5805df1d826 for instance with vm_state active and task_state None.
Aug 15 19:37:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "1c992ecd-ac21-44e7-937c-b19028cc95c2" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:16 user nova-compute[73188]: INFO nova.compute.manager [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Unshelving
Aug 15 19:37:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:16 user nova-compute[73188]: DEBUG nova.objects.instance [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'pci_requests' on Instance uuid 1c992ecd-ac21-44e7-937c-b19028cc95c2 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:37:16 user nova-compute[73188]: DEBUG nova.objects.instance [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'numa_topology' on Instance uuid 1c992ecd-ac21-44e7-937c-b19028cc95c2 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:37:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:37:16 user nova-compute[73188]: INFO nova.compute.claims [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Claim successful on node user
Aug 15 19:37:16 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:37:16 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:37:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:17 user nova-compute[73188]: INFO nova.network.neutron [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Updating port 17fa5237-0a8d-4f42-956d-d4a9732b4539 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 19:37:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:37:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquired lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:37:17 user nova-compute[73188]: DEBUG nova.network.neutron [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:37:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-cdabc7fa-e473-4b0b-a0e6-4a27b3592b24 req-a1cb8e4b-a2ed-42d6-8e04-9a883899a25f service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Received event network-changed-17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:37:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-cdabc7fa-e473-4b0b-a0e6-4a27b3592b24 req-a1cb8e4b-a2ed-42d6-8e04-9a883899a25f service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Refreshing instance network info cache due to event network-changed-17fa5237-0a8d-4f42-956d-d4a9732b4539. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:37:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cdabc7fa-e473-4b0b-a0e6-4a27b3592b24 req-a1cb8e4b-a2ed-42d6-8e04-9a883899a25f service nova] Acquiring lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:37:18 user nova-compute[73188]: DEBUG nova.network.neutron [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Updating instance_info_cache with network_info: [{"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fa5237-0a", "ovs_interfaceid": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:37:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Releasing lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:37:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:37:18 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Creating image(s)
Aug 15 19:37:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "/opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "/opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:18 user nova-compute[73188]: DEBUG nova.objects.instance [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1c992ecd-ac21-44e7-937c-b19028cc95c2 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:37:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cdabc7fa-e473-4b0b-a0e6-4a27b3592b24 req-a1cb8e4b-a2ed-42d6-8e04-9a883899a25f service nova] Acquired lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:37:18 user nova-compute[73188]: DEBUG nova.network.neutron [req-cdabc7fa-e473-4b0b-a0e6-4a27b3592b24 req-a1cb8e4b-a2ed-42d6-8e04-9a883899a25f service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Refreshing network info cache for port 17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:37:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "400749c548c376c896e4f18d4379aea5f726d5ca" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "400749c548c376c896e4f18d4379aea5f726d5ca" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/400749c548c376c896e4f18d4379aea5f726d5ca.part --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/400749c548c376c896e4f18d4379aea5f726d5ca.part --force-share --output=json" returned: 0 in 0.192s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG nova.virt.images [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] 25ef85cd-a1a4-40fa-93a1-6ed8dac91054 was qcow2, converting to raw {{(pid=73188) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG nova.privsep.utils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73188) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/400749c548c376c896e4f18d4379aea5f726d5ca.part /opt/stack/data/nova/instances/_base/400749c548c376c896e4f18d4379aea5f726d5ca.converted {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG nova.compute.manager [req-185f7c6e-f1ec-42ac-95b7-95f6cee29378 req-9d6f926b-1e95-45a3-8305-01db0ed1f185 service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Received event network-changed-34c74787-4e7e-4c3a-b084-7ccf460a65f8 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG nova.compute.manager [req-185f7c6e-f1ec-42ac-95b7-95f6cee29378 req-9d6f926b-1e95-45a3-8305-01db0ed1f185 service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Refreshing instance network info cache due to event network-changed-34c74787-4e7e-4c3a-b084-7ccf460a65f8. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-185f7c6e-f1ec-42ac-95b7-95f6cee29378 req-9d6f926b-1e95-45a3-8305-01db0ed1f185 service nova] Acquiring lock "refresh_cache-c696f77d-eb36-426f-a86d-26bfca9a1918" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-185f7c6e-f1ec-42ac-95b7-95f6cee29378 req-9d6f926b-1e95-45a3-8305-01db0ed1f185 service nova] Acquired lock "refresh_cache-c696f77d-eb36-426f-a86d-26bfca9a1918" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG nova.network.neutron [req-185f7c6e-f1ec-42ac-95b7-95f6cee29378 req-9d6f926b-1e95-45a3-8305-01db0ed1f185 service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Refreshing network info cache for port 34c74787-4e7e-4c3a-b084-7ccf460a65f8 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "c696f77d-eb36-426f-a86d-26bfca9a1918" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "c696f77d-eb36-426f-a86d-26bfca9a1918" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "c696f77d-eb36-426f-a86d-26bfca9a1918-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "c696f77d-eb36-426f-a86d-26bfca9a1918-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "c696f77d-eb36-426f-a86d-26bfca9a1918-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:19 user nova-compute[73188]: INFO nova.compute.manager [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Terminating instance
Aug 15 19:37:19 user nova-compute[73188]: DEBUG nova.compute.manager [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/400749c548c376c896e4f18d4379aea5f726d5ca.part /opt/stack/data/nova/instances/_base/400749c548c376c896e4f18d4379aea5f726d5ca.converted" returned: 0 in 0.353s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/400749c548c376c896e4f18d4379aea5f726d5ca.converted --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG nova.network.neutron [req-cdabc7fa-e473-4b0b-a0e6-4a27b3592b24 req-a1cb8e4b-a2ed-42d6-8e04-9a883899a25f service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Updated VIF entry in instance network info cache for port 17fa5237-0a8d-4f42-956d-d4a9732b4539. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG nova.network.neutron [req-cdabc7fa-e473-4b0b-a0e6-4a27b3592b24 req-a1cb8e4b-a2ed-42d6-8e04-9a883899a25f service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Updating instance_info_cache with network_info: [{"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fa5237-0a", "ovs_interfaceid": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/400749c548c376c896e4f18d4379aea5f726d5ca.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "400749c548c376c896e4f18d4379aea5f726d5ca" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.704s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:19 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/400749c548c376c896e4f18d4379aea5f726d5ca --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cdabc7fa-e473-4b0b-a0e6-4a27b3592b24 req-a1cb8e4b-a2ed-42d6-8e04-9a883899a25f service nova] Releasing lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG nova.network.neutron [req-185f7c6e-f1ec-42ac-95b7-95f6cee29378 req-9d6f926b-1e95-45a3-8305-01db0ed1f185 service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Updated VIF entry in instance network info cache for port 34c74787-4e7e-4c3a-b084-7ccf460a65f8. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG nova.network.neutron [req-185f7c6e-f1ec-42ac-95b7-95f6cee29378 req-9d6f926b-1e95-45a3-8305-01db0ed1f185 service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Updating instance_info_cache with network_info: [{"id": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "address": "fa:16:3e:48:2b:43", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c74787-4e", "ovs_interfaceid": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/400749c548c376c896e4f18d4379aea5f726d5ca --force-share --output=json" returned: 0 in 0.174s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "400749c548c376c896e4f18d4379aea5f726d5ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "400749c548c376c896e4f18d4379aea5f726d5ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/400749c548c376c896e4f18d4379aea5f726d5ca --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-185f7c6e-f1ec-42ac-95b7-95f6cee29378 req-9d6f926b-1e95-45a3-8305-01db0ed1f185 service nova] Releasing lock "refresh_cache-c696f77d-eb36-426f-a86d-26bfca9a1918" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:37:20 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Instance destroyed successfully.
Aug 15 19:37:20 user nova-compute[73188]: DEBUG nova.objects.instance [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lazy-loading 'resources' on Instance uuid c696f77d-eb36-426f-a86d-26bfca9a1918 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1494379546',display_name='tempest-TestStampPattern-server-1494379546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1494379546',id=43,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPttPXTMMfrjFLW7G+VtG1rMa5FI1ksBOcYrsCtyrYTreKkrGoeDmah2iW0MvYJZ2Kgf5QUOX0XjOu9+OQOllEXo6T6FtGW/D6IrYtS7SxmNxxryUDEUap8dr1QEagH2lQ==',key_name='tempest-TestStampPattern-390215866',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:30:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ffec07b2185b4bd4a14793f9885a43d0',ramdisk_id='',reservation_id='r-i1kyd8r6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1547019054',owner_user_name='tempest-TestStampPattern-1547019054-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:33:17Z,user_data=None,user_id='ae2fd38dc21248609f17533079193d2d',uuid=c696f77d-eb36-426f-a86d-26bfca9a1918,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "address": "fa:16:3e:48:2b:43", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c74787-4e", "ovs_interfaceid": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Converting VIF {"id": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "address": "fa:16:3e:48:2b:43", "network": {"id": "e3f0d46e-35ab-4b09-ac9d-ee8728aa820a", "bridge": "br-int", "label": "tempest-TestStampPattern-1672360151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffec07b2185b4bd4a14793f9885a43d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c74787-4e", "ovs_interfaceid": "34c74787-4e7e-4c3a-b084-7ccf460a65f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:2b:43,bridge_name='br-int',has_traffic_filtering=True,id=34c74787-4e7e-4c3a-b084-7ccf460a65f8,network=Network(e3f0d46e-35ab-4b09-ac9d-ee8728aa820a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34c74787-4e') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG os_vif [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:2b:43,bridge_name='br-int',has_traffic_filtering=True,id=34c74787-4e7e-4c3a-b084-7ccf460a65f8,network=Network(e3f0d46e-35ab-4b09-ac9d-ee8728aa820a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34c74787-4e') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34c74787-4e, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/400749c548c376c896e4f18d4379aea5f726d5ca --force-share --output=json" returned: 0 in 0.203s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/400749c548c376c896e4f18d4379aea5f726d5ca,backing_fmt=raw /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:37:20 user nova-compute[73188]: INFO os_vif [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:2b:43,bridge_name='br-int',has_traffic_filtering=True,id=34c74787-4e7e-4c3a-b084-7ccf460a65f8,network=Network(e3f0d46e-35ab-4b09-ac9d-ee8728aa820a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34c74787-4e')
Aug 15 19:37:20 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Deleting instance files /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918_del
Aug 15 19:37:20 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Deletion of /opt/stack/data/nova/instances/c696f77d-eb36-426f-a86d-26bfca9a1918_del complete
Aug 15 19:37:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/400749c548c376c896e4f18d4379aea5f726d5ca,backing_fmt=raw /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk 1073741824" returned: 0 in 0.061s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "400749c548c376c896e4f18d4379aea5f726d5ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/400749c548c376c896e4f18d4379aea5f726d5ca --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:37:20 user nova-compute[73188]: INFO nova.compute.manager [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 15 19:37:20 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/400749c548c376c896e4f18d4379aea5f726d5ca --force-share --output=json" returned: 0 in 0.173s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG nova.objects.instance [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'migration_context' on Instance uuid 1c992ecd-ac21-44e7-937c-b19028cc95c2 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:37:20 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Rebasing disk image.
Aug 15 19:37:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.177s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:37:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f -F raw /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:37:21 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:37:21 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Took 0.68 seconds to deallocate network for instance.
Aug 15 19:37:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-23aa8856-11b9-4922-9987-fe3018eb5211 req-7a1f30e1-41a3-462d-a86a-852b1ccc24b8 service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Received event network-vif-deleted-34c74787-4e7e-4c3a-b084-7ccf460a65f8 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:37:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:21 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:37:21 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:37:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-63f189e3-9882-4766-bec0-fd39c3ca010a req-e3b3ceb9-2ef3-4089-91ff-3a2c9a6f674d service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Received event network-vif-unplugged-34c74787-4e7e-4c3a-b084-7ccf460a65f8 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:37:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-63f189e3-9882-4766-bec0-fd39c3ca010a req-e3b3ceb9-2ef3-4089-91ff-3a2c9a6f674d service nova] Acquiring lock "c696f77d-eb36-426f-a86d-26bfca9a1918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-63f189e3-9882-4766-bec0-fd39c3ca010a req-e3b3ceb9-2ef3-4089-91ff-3a2c9a6f674d service nova] Lock "c696f77d-eb36-426f-a86d-26bfca9a1918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-63f189e3-9882-4766-bec0-fd39c3ca010a req-e3b3ceb9-2ef3-4089-91ff-3a2c9a6f674d service nova] Lock "c696f77d-eb36-426f-a86d-26bfca9a1918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-63f189e3-9882-4766-bec0-fd39c3ca010a req-e3b3ceb9-2ef3-4089-91ff-3a2c9a6f674d service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] No waiting events found dispatching network-vif-unplugged-34c74787-4e7e-4c3a-b084-7ccf460a65f8 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:37:21 user nova-compute[73188]: WARNING nova.compute.manager [req-63f189e3-9882-4766-bec0-fd39c3ca010a req-e3b3ceb9-2ef3-4089-91ff-3a2c9a6f674d service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Received unexpected event network-vif-unplugged-34c74787-4e7e-4c3a-b084-7ccf460a65f8 for instance with vm_state deleted and task_state None.
Aug 15 19:37:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-63f189e3-9882-4766-bec0-fd39c3ca010a req-e3b3ceb9-2ef3-4089-91ff-3a2c9a6f674d service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Received event network-vif-plugged-34c74787-4e7e-4c3a-b084-7ccf460a65f8 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:37:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-63f189e3-9882-4766-bec0-fd39c3ca010a req-e3b3ceb9-2ef3-4089-91ff-3a2c9a6f674d service nova] Acquiring lock "c696f77d-eb36-426f-a86d-26bfca9a1918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-63f189e3-9882-4766-bec0-fd39c3ca010a req-e3b3ceb9-2ef3-4089-91ff-3a2c9a6f674d service nova] Lock "c696f77d-eb36-426f-a86d-26bfca9a1918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-63f189e3-9882-4766-bec0-fd39c3ca010a req-e3b3ceb9-2ef3-4089-91ff-3a2c9a6f674d service nova] Lock "c696f77d-eb36-426f-a86d-26bfca9a1918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:21 user nova-compute[73188]: DEBUG nova.compute.manager [req-63f189e3-9882-4766-bec0-fd39c3ca010a req-e3b3ceb9-2ef3-4089-91ff-3a2c9a6f674d service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] No waiting events found dispatching network-vif-plugged-34c74787-4e7e-4c3a-b084-7ccf460a65f8 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:37:21 user nova-compute[73188]: WARNING nova.compute.manager [req-63f189e3-9882-4766-bec0-fd39c3ca010a req-e3b3ceb9-2ef3-4089-91ff-3a2c9a6f674d service nova] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Received unexpected event network-vif-plugged-34c74787-4e7e-4c3a-b084-7ccf460a65f8 for instance with vm_state deleted and task_state None.
Aug 15 19:37:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:21 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Deleted allocations for instance c696f77d-eb36-426f-a86d-26bfca9a1918
Aug 15 19:37:21 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d1e65494-e40f-4168-bc42-e1e77dca1e35 tempest-TestStampPattern-1547019054 tempest-TestStampPattern-1547019054-project-member] Lock "c696f77d-eb36-426f-a86d-26bfca9a1918" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.147s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f -F raw /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk" returned: 0 in 1.956s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Ensure instance console log exists: /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Start _get_guest_xml network_info=[{"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fa5237-0a", "ovs_interfaceid": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='603917fcaebbeca16c1214339f242d3c',container_format='bare',created_at=2023-08-15T19:35:23Z,direct_url=<?>,disk_format='qcow2',id=25ef85cd-a1a4-40fa-93a1-6ed8dac91054,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-899178377-shelved',owner='409362f6976b454ba96b7580b35db949',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T19:35:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:37:22 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:37:22 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='603917fcaebbeca16c1214339f242d3c',container_format='bare',created_at=2023-08-15T19:35:23Z,direct_url=<?>,disk_format='qcow2',id=25ef85cd-a1a4-40fa-93a1-6ed8dac91054,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-899178377-shelved',owner='409362f6976b454ba96b7580b35db949',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T19:35:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.objects.instance [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1c992ecd-ac21-44e7-937c-b19028cc95c2 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T19:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-899178377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-899178377',id=47,image_ref='25ef85cd-a1a4-40fa-93a1-6ed8dac91054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1267490924',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:33:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='409362f6976b454ba96b7580b35db949',ramdisk_id='',reservation_id='r-0uo6aeyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1675372664',owner_user_name='tempest-AttachVolumeShelveTestJSON-1675372664-project-member',shelved_at='2023-08-15T19:35:26.990340',shelved_host='user',shelved_image_id='25ef85cd-a1a4-40fa-93a1-6ed8dac91054'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:37:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7df4b06e72a452ca1dd4643694ce570',uuid=1c992ecd-ac21-44e7-937c-b19028cc95c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fa5237-0a", "ovs_interfaceid": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converting VIF {"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fa5237-0a", "ovs_interfaceid": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:d4:70,bridge_name='br-int',has_traffic_filtering=True,id=17fa5237-0a8d-4f42-956d-d4a9732b4539,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fa5237-0a') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.objects.instance [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c992ecd-ac21-44e7-937c-b19028cc95c2 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:37:22 user nova-compute[73188]:   <uuid>1c992ecd-ac21-44e7-937c-b19028cc95c2</uuid>
Aug 15 19:37:22 user nova-compute[73188]:   <name>instance-0000002f</name>
Aug 15 19:37:22 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:37:22 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:37:22 user nova-compute[73188]:   <metadata>
Aug 15 19:37:22 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:37:22 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:37:22 user nova-compute[73188]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-899178377</nova:name>
Aug 15 19:37:22 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:37:22</nova:creationTime>
Aug 15 19:37:22 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:37:22 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:37:22 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:37:22 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:37:22 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:37:22 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:37:22 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:37:22 user nova-compute[73188]:       <nova:owner>
Aug 15 19:37:22 user nova-compute[73188]:         <nova:user uuid="e7df4b06e72a452ca1dd4643694ce570">tempest-AttachVolumeShelveTestJSON-1675372664-project-member</nova:user>
Aug 15 19:37:22 user nova-compute[73188]:         <nova:project uuid="409362f6976b454ba96b7580b35db949">tempest-AttachVolumeShelveTestJSON-1675372664</nova:project>
Aug 15 19:37:22 user nova-compute[73188]:       </nova:owner>
Aug 15 19:37:22 user nova-compute[73188]:       <nova:root type="image" uuid="25ef85cd-a1a4-40fa-93a1-6ed8dac91054"/>
Aug 15 19:37:22 user nova-compute[73188]:       <nova:ports>
Aug 15 19:37:22 user nova-compute[73188]:         <nova:port uuid="17fa5237-0a8d-4f42-956d-d4a9732b4539">
Aug 15 19:37:22 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 19:37:22 user nova-compute[73188]:         </nova:port>
Aug 15 19:37:22 user nova-compute[73188]:       </nova:ports>
Aug 15 19:37:22 user nova-compute[73188]:     </nova:instance>
Aug 15 19:37:22 user nova-compute[73188]:   </metadata>
Aug 15 19:37:22 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:37:22 user nova-compute[73188]:     <system>
Aug 15 19:37:22 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:37:22 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:37:22 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:37:22 user nova-compute[73188]:       <entry name="serial">1c992ecd-ac21-44e7-937c-b19028cc95c2</entry>
Aug 15 19:37:22 user nova-compute[73188]:       <entry name="uuid">1c992ecd-ac21-44e7-937c-b19028cc95c2</entry>
Aug 15 19:37:22 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:37:22 user nova-compute[73188]:     </system>
Aug 15 19:37:22 user nova-compute[73188]:   </sysinfo>
Aug 15 19:37:22 user nova-compute[73188]:   <os>
Aug 15 19:37:22 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:37:22 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:37:22 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:37:22 user nova-compute[73188]:   </os>
Aug 15 19:37:22 user nova-compute[73188]:   <features>
Aug 15 19:37:22 user nova-compute[73188]:     <acpi/>
Aug 15 19:37:22 user nova-compute[73188]:     <apic/>
Aug 15 19:37:22 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:37:22 user nova-compute[73188]:   </features>
Aug 15 19:37:22 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:37:22 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:37:22 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:37:22 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:37:22 user nova-compute[73188]:   </clock>
Aug 15 19:37:22 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:37:22 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:37:22 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:37:22 user nova-compute[73188]:   </cpu>
Aug 15 19:37:22 user nova-compute[73188]:   <devices>
Aug 15 19:37:22 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:37:22 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:37:22 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk"/>
Aug 15 19:37:22 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:37:22 user nova-compute[73188]:     </disk>
Aug 15 19:37:22 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:37:22 user nova-compute[73188]:       <mac address="fa:16:3e:7f:d4:70"/>
Aug 15 19:37:22 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:37:22 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:37:22 user nova-compute[73188]:       <target dev="tap17fa5237-0a"/>
Aug 15 19:37:22 user nova-compute[73188]:     </interface>
Aug 15 19:37:22 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:37:22 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/console.log" append="off"/>
Aug 15 19:37:22 user nova-compute[73188]:     </serial>
Aug 15 19:37:22 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:37:22 user nova-compute[73188]:     <video>
Aug 15 19:37:22 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:37:22 user nova-compute[73188]:     </video>
Aug 15 19:37:22 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:37:22 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:37:22 user nova-compute[73188]:     </rng>
Aug 15 19:37:22 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:37:22 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:37:22 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:37:22 user nova-compute[73188]:     </memballoon>
Aug 15 19:37:22 user nova-compute[73188]:   </devices>
Aug 15 19:37:22 user nova-compute[73188]: </domain>
Aug 15 19:37:22 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T19:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-899178377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-899178377',id=47,image_ref='25ef85cd-a1a4-40fa-93a1-6ed8dac91054',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1267490924',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:33:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='409362f6976b454ba96b7580b35db949',ramdisk_id='',reservation_id='r-0uo6aeyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1675372664',owner_user_name='tempest-AttachVolumeShelveTestJSON-1675372664-project-member',shelved_at='2023-08-15T19:35:26.990340',shelved_host='user',shelved_image_id='25ef85cd-a1a4-40fa-93a1-6ed8dac91054'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:37:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7df4b06e72a452ca1dd4643694ce570',uuid=1c992ecd-ac21-44e7-937c-b19028cc95c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fa5237-0a", "ovs_interfaceid": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converting VIF {"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fa5237-0a", "ovs_interfaceid": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:d4:70,bridge_name='br-int',has_traffic_filtering=True,id=17fa5237-0a8d-4f42-956d-d4a9732b4539,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fa5237-0a') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG os_vif [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:d4:70,bridge_name='br-int',has_traffic_filtering=True,id=17fa5237-0a8d-4f42-956d-d4a9732b4539,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fa5237-0a') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17fa5237-0a, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap17fa5237-0a, col_values=(('external_ids', {'iface-id': '17fa5237-0a8d-4f42-956d-d4a9732b4539', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:d4:70', 'vm-uuid': '1c992ecd-ac21-44e7-937c-b19028cc95c2'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:22 user nova-compute[73188]: INFO os_vif [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:d4:70,bridge_name='br-int',has_traffic_filtering=True,id=17fa5237-0a8d-4f42-956d-d4a9732b4539,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fa5237-0a')
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:37:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] No VIF found with MAC fa:16:3e:7f:d4:70, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:37:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:24 user nova-compute[73188]: DEBUG nova.compute.manager [req-f78b20a9-6a32-4902-a8df-daedfe2d6001 req-e2d793cf-bc75-4b8c-a473-05ac57229067 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Received event network-vif-plugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:37:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f78b20a9-6a32-4902-a8df-daedfe2d6001 req-e2d793cf-bc75-4b8c-a473-05ac57229067 service nova] Acquiring lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f78b20a9-6a32-4902-a8df-daedfe2d6001 req-e2d793cf-bc75-4b8c-a473-05ac57229067 service nova] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-f78b20a9-6a32-4902-a8df-daedfe2d6001 req-e2d793cf-bc75-4b8c-a473-05ac57229067 service nova] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:24 user nova-compute[73188]: DEBUG nova.compute.manager [req-f78b20a9-6a32-4902-a8df-daedfe2d6001 req-e2d793cf-bc75-4b8c-a473-05ac57229067 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] No waiting events found dispatching network-vif-plugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:37:24 user nova-compute[73188]: WARNING nova.compute.manager [req-f78b20a9-6a32-4902-a8df-daedfe2d6001 req-e2d793cf-bc75-4b8c-a473-05ac57229067 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Received unexpected event network-vif-plugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 19:37:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:24 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:26 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692128246.4178133, 1c992ecd-ac21-44e7-937c-b19028cc95c2 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:37:26 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] VM Resumed (Lifecycle Event)
Aug 15 19:37:26 user nova-compute[73188]: DEBUG nova.compute.manager [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:37:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:37:26 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Instance spawned successfully.
Aug 15 19:37:26 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:37:26 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:37:26 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:37:26 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692128246.419842, 1c992ecd-ac21-44e7-937c-b19028cc95c2 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:37:26 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] VM Started (Lifecycle Event)
Aug 15 19:37:26 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:37:26 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:37:26 user nova-compute[73188]: DEBUG nova.compute.manager [req-56dcec8a-6850-4b0f-ab6c-85f2ae6d4a32 req-f6442ea0-dc2d-4f37-aae4-8fab5d9a7c4e service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Received event network-vif-plugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:37:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-56dcec8a-6850-4b0f-ab6c-85f2ae6d4a32 req-f6442ea0-dc2d-4f37-aae4-8fab5d9a7c4e service nova] Acquiring lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-56dcec8a-6850-4b0f-ab6c-85f2ae6d4a32 req-f6442ea0-dc2d-4f37-aae4-8fab5d9a7c4e service nova] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-56dcec8a-6850-4b0f-ab6c-85f2ae6d4a32 req-f6442ea0-dc2d-4f37-aae4-8fab5d9a7c4e service nova] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:26 user nova-compute[73188]: DEBUG nova.compute.manager [req-56dcec8a-6850-4b0f-ab6c-85f2ae6d4a32 req-f6442ea0-dc2d-4f37-aae4-8fab5d9a7c4e service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] No waiting events found dispatching network-vif-plugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:37:26 user nova-compute[73188]: WARNING nova.compute.manager [req-56dcec8a-6850-4b0f-ab6c-85f2ae6d4a32 req-f6442ea0-dc2d-4f37-aae4-8fab5d9a7c4e service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Received unexpected event network-vif-plugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 19:37:26 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:37:26 user nova-compute[73188]: DEBUG nova.compute.manager [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:37:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-69f7782d-cf3e-4479-86a7-bf0d0f34d92e tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.121s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:31 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:37:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "adef852b-f515-4cfd-807e-586809ff6aa6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "adef852b-f515-4cfd-807e-586809ff6aa6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "adef852b-f515-4cfd-807e-586809ff6aa6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "adef852b-f515-4cfd-807e-586809ff6aa6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "adef852b-f515-4cfd-807e-586809ff6aa6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:31 user nova-compute[73188]: INFO nova.compute.manager [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Terminating instance
Aug 15 19:37:31 user nova-compute[73188]: DEBUG nova.compute.manager [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:37:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:31 user nova-compute[73188]: DEBUG nova.compute.manager [req-83ac33f0-5dda-48db-915d-0b8a5f44090f req-8e4a5815-cb7f-4f43-a1f4-7b247c7d49a7 service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Received event network-vif-unplugged-a50854ad-f025-4e0d-b13c-4786568261b1 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:37:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-83ac33f0-5dda-48db-915d-0b8a5f44090f req-8e4a5815-cb7f-4f43-a1f4-7b247c7d49a7 service nova] Acquiring lock "adef852b-f515-4cfd-807e-586809ff6aa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-83ac33f0-5dda-48db-915d-0b8a5f44090f req-8e4a5815-cb7f-4f43-a1f4-7b247c7d49a7 service nova] Lock "adef852b-f515-4cfd-807e-586809ff6aa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-83ac33f0-5dda-48db-915d-0b8a5f44090f req-8e4a5815-cb7f-4f43-a1f4-7b247c7d49a7 service nova] Lock "adef852b-f515-4cfd-807e-586809ff6aa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:31 user nova-compute[73188]: DEBUG nova.compute.manager [req-83ac33f0-5dda-48db-915d-0b8a5f44090f req-8e4a5815-cb7f-4f43-a1f4-7b247c7d49a7 service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] No waiting events found dispatching network-vif-unplugged-a50854ad-f025-4e0d-b13c-4786568261b1 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:37:31 user nova-compute[73188]: DEBUG nova.compute.manager [req-83ac33f0-5dda-48db-915d-0b8a5f44090f req-8e4a5815-cb7f-4f43-a1f4-7b247c7d49a7 service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Received event network-vif-unplugged-a50854ad-f025-4e0d-b13c-4786568261b1 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:37:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:32 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Instance destroyed successfully.
Aug 15 19:37:32 user nova-compute[73188]: DEBUG nova.objects.instance [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lazy-loading 'resources' on Instance uuid adef852b-f515-4cfd-807e-586809ff6aa6 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:37:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:31:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1956775684',display_name='tempest-AttachVolumeNegativeTest-server-1956775684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1956775684',id=44,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIogLPjr6GTN9guqPXvzAMJ94iAoMBaEuGKFjE8An2x1+EURZJ6mreP306LfpqN/pmVZspbRu+x0Q8EgyFsOVgnnQTOzlsFeM53om6hJwbm1SwWkXBOBYHVArXt1zzipnQ==',key_name='tempest-keypair-38166731',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:31:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5bc7d940cd1410a878ac89e24a4c4bc',ramdisk_id='',reservation_id='r-vwvhulmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1373631227',owner_user_name='tempest-AttachVolumeNegativeTest-1373631227-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:31:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e526de0e03140bea2d410f535f75bb7',uuid=adef852b-f515-4cfd-807e-586809ff6aa6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a50854ad-f025-4e0d-b13c-4786568261b1", "address": "fa:16:3e:4e:b4:be", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa50854ad-f0", "ovs_interfaceid": "a50854ad-f025-4e0d-b13c-4786568261b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:37:32 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converting VIF {"id": "a50854ad-f025-4e0d-b13c-4786568261b1", "address": "fa:16:3e:4e:b4:be", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa50854ad-f0", "ovs_interfaceid": "a50854ad-f025-4e0d-b13c-4786568261b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:37:32 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:b4:be,bridge_name='br-int',has_traffic_filtering=True,id=a50854ad-f025-4e0d-b13c-4786568261b1,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa50854ad-f0') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:37:32 user nova-compute[73188]: DEBUG os_vif [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:b4:be,bridge_name='br-int',has_traffic_filtering=True,id=a50854ad-f025-4e0d-b13c-4786568261b1,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa50854ad-f0') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:37:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa50854ad-f0, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:37:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:37:32 user nova-compute[73188]: INFO os_vif [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:b4:be,bridge_name='br-int',has_traffic_filtering=True,id=a50854ad-f025-4e0d-b13c-4786568261b1,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa50854ad-f0')
Aug 15 19:37:32 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Deleting instance files /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6_del
Aug 15 19:37:32 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Deletion of /opt/stack/data/nova/instances/adef852b-f515-4cfd-807e-586809ff6aa6_del complete
Aug 15 19:37:32 user nova-compute[73188]: INFO nova.compute.manager [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 15 19:37:32 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:37:32 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:37:32 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:37:33 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:37:33 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Took 0.84 seconds to deallocate network for instance.
Aug 15 19:37:33 user nova-compute[73188]: DEBUG nova.compute.manager [req-9f26df05-0d60-42fb-9e0b-4eb077d72d94 req-94963674-cc51-40b1-9702-15d9573d365f service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Received event network-vif-deleted-a50854ad-f025-4e0d-b13c-4786568261b1 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:37:33 user nova-compute[73188]: INFO nova.compute.manager [req-9f26df05-0d60-42fb-9e0b-4eb077d72d94 req-94963674-cc51-40b1-9702-15d9573d365f service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Neutron deleted interface a50854ad-f025-4e0d-b13c-4786568261b1; detaching it from the instance and deleting it from the info cache
Aug 15 19:37:33 user nova-compute[73188]: DEBUG nova.network.neutron [req-9f26df05-0d60-42fb-9e0b-4eb077d72d94 req-94963674-cc51-40b1-9702-15d9573d365f service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:37:33 user nova-compute[73188]: DEBUG nova.compute.manager [req-9f26df05-0d60-42fb-9e0b-4eb077d72d94 req-94963674-cc51-40b1-9702-15d9573d365f service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Detach interface failed, port_id=a50854ad-f025-4e0d-b13c-4786568261b1, reason: Instance adef852b-f515-4cfd-807e-586809ff6aa6 could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:37:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:33 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:37:33 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:37:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:33 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Deleted allocations for instance adef852b-f515-4cfd-807e-586809ff6aa6
Aug 15 19:37:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-995ef960-d407-47aa-996b-1c1b6321ebd0 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "adef852b-f515-4cfd-807e-586809ff6aa6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.013s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:34 user nova-compute[73188]: DEBUG nova.compute.manager [req-ae4802cc-073b-4ab8-9eb4-eb287fb59e13 req-e3b5c1ca-1e44-4969-b9a8-489f48685a03 service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Received event network-vif-plugged-a50854ad-f025-4e0d-b13c-4786568261b1 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:37:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ae4802cc-073b-4ab8-9eb4-eb287fb59e13 req-e3b5c1ca-1e44-4969-b9a8-489f48685a03 service nova] Acquiring lock "adef852b-f515-4cfd-807e-586809ff6aa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ae4802cc-073b-4ab8-9eb4-eb287fb59e13 req-e3b5c1ca-1e44-4969-b9a8-489f48685a03 service nova] Lock "adef852b-f515-4cfd-807e-586809ff6aa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:34 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ae4802cc-073b-4ab8-9eb4-eb287fb59e13 req-e3b5c1ca-1e44-4969-b9a8-489f48685a03 service nova] Lock "adef852b-f515-4cfd-807e-586809ff6aa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:34 user nova-compute[73188]: DEBUG nova.compute.manager [req-ae4802cc-073b-4ab8-9eb4-eb287fb59e13 req-e3b5c1ca-1e44-4969-b9a8-489f48685a03 service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] No waiting events found dispatching network-vif-plugged-a50854ad-f025-4e0d-b13c-4786568261b1 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:37:34 user nova-compute[73188]: WARNING nova.compute.manager [req-ae4802cc-073b-4ab8-9eb4-eb287fb59e13 req-e3b5c1ca-1e44-4969-b9a8-489f48685a03 service nova] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Received unexpected event network-vif-plugged-a50854ad-f025-4e0d-b13c-4786568261b1 for instance with vm_state deleted and task_state None.
Aug 15 19:37:34 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:37:35 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692128240.3327742, c696f77d-eb36-426f-a86d-26bfca9a1918 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:37:35 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] VM Stopped (Lifecycle Event)
Aug 15 19:37:35 user nova-compute[73188]: DEBUG nova.compute.manager [None req-2b706ca9-dfcc-4694-90f8-c84675317241 None None] [instance: c696f77d-eb36-426f-a86d-26bfca9a1918] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:37:36 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:37:36 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:37:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:37 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:37:37 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:37:37 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:37:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:37 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:37:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:37:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:37:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:37:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:37:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:37:38 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:37:38 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:37:38 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8526MB free_disk=25.198863983154297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:37:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:37:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:37:38 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 6e48fce8-e4d4-4e30-a67e-5d81036b14cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:37:38 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 1c992ecd-ac21-44e7-937c-b19028cc95c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:37:38 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:37:38 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:37:38 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:37:38 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:37:38 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:37:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:37:41 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:37:41 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:37:41 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Didn't find any instances for network info cache update. {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 19:37:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:44 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:37:45 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:37:46 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:37:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:47 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692128252.4427073, adef852b-f515-4cfd-807e-586809ff6aa6 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:37:47 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] VM Stopped (Lifecycle Event)
Aug 15 19:37:47 user nova-compute[73188]: DEBUG nova.compute.manager [None req-df357f20-1523-4753-9714-7ce258fb7a13 None None] [instance: adef852b-f515-4cfd-807e-586809ff6aa6] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:37:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:37:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:38:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:38:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:38:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:38:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:38:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "511ffce0-2c7a-478c-bc7f-9e20322dca94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:38:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "511ffce0-2c7a-478c-bc7f-9e20322dca94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:38:25 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:38:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:38:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:38:25 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:38:25 user nova-compute[73188]: INFO nova.compute.claims [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Claim successful on node user
Aug 15 19:38:26 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:38:26 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:38:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:38:26 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:38:26 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:38:26 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:38:26 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:38:26 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:38:26 user nova-compute[73188]: DEBUG nova.policy [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e526de0e03140bea2d410f535f75bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5bc7d940cd1410a878ac89e24a4c4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:38:26 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:38:26 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:38:26 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Creating image(s)
Aug 15 19:38:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "/opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:38:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "/opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:38:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "/opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:38:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:38:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.206s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:38:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:38:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:38:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:38:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:38:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:38:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk 1073741824" returned: 0 in 0.057s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:38:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:38:26 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:38:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.201s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:38:27 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Checking if we can resize image /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:38:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:38:27 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Successfully created port: ae398b95-5857-4069-8fa5-c3b3e890fea3 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:38:27 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:38:27 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Cannot resize image /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:38:27 user nova-compute[73188]: DEBUG nova.objects.instance [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lazy-loading 'migration_context' on Instance uuid 511ffce0-2c7a-478c-bc7f-9e20322dca94 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:38:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:38:27 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Ensure instance console log exists: /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:38:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:38:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:38:27 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:38:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Successfully updated port: ae398b95-5857-4069-8fa5-c3b3e890fea3 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "refresh_cache-511ffce0-2c7a-478c-bc7f-9e20322dca94" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquired lock "refresh_cache-511ffce0-2c7a-478c-bc7f-9e20322dca94" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.compute.manager [req-7b475648-f3a2-40ed-9de2-2f35e6e549fd req-2a25d6da-b129-4abf-8d6b-d3bb02a094bf service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Received event network-changed-ae398b95-5857-4069-8fa5-c3b3e890fea3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.compute.manager [req-7b475648-f3a2-40ed-9de2-2f35e6e549fd req-2a25d6da-b129-4abf-8d6b-d3bb02a094bf service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Refreshing instance network info cache due to event network-changed-ae398b95-5857-4069-8fa5-c3b3e890fea3. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7b475648-f3a2-40ed-9de2-2f35e6e549fd req-2a25d6da-b129-4abf-8d6b-d3bb02a094bf service nova] Acquiring lock "refresh_cache-511ffce0-2c7a-478c-bc7f-9e20322dca94" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.network.neutron [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Updating instance_info_cache with network_info: [{"id": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "address": "fa:16:3e:eb:5b:20", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae398b95-58", "ovs_interfaceid": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Releasing lock "refresh_cache-511ffce0-2c7a-478c-bc7f-9e20322dca94" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Instance network_info: |[{"id": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "address": "fa:16:3e:eb:5b:20", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae398b95-58", "ovs_interfaceid": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7b475648-f3a2-40ed-9de2-2f35e6e549fd req-2a25d6da-b129-4abf-8d6b-d3bb02a094bf service nova] Acquired lock "refresh_cache-511ffce0-2c7a-478c-bc7f-9e20322dca94" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.network.neutron [req-7b475648-f3a2-40ed-9de2-2f35e6e549fd req-2a25d6da-b129-4abf-8d6b-d3bb02a094bf service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Refreshing network info cache for port ae398b95-5857-4069-8fa5-c3b3e890fea3 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Start _get_guest_xml network_info=[{"id": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "address": "fa:16:3e:eb:5b:20", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae398b95-58", "ovs_interfaceid": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:38:28 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:38:28 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-933430195',display_name='tempest-AttachVolumeNegativeTest-server-933430195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-933430195',id=49,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJgETPW43fcpJiiS74xOE6dd0DKF7xJHoXrgsnOi2i/eLhyFb5NTzXPqbroEffXedojxkx0rqBradtB6bZGks8P7bA9N2Y6P3FMaGfC6QRowFeYW0M7i6Gzf42EUmsCvA==',key_name='tempest-keypair-742756043',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5bc7d940cd1410a878ac89e24a4c4bc',ramdisk_id='',reservation_id='r-tiqv6s7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1373631227',owner_user_name='tempest-AttachVolumeNegativeTest-1373631227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:38:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e526de0e03140bea2d410f535f75bb7',uuid=511ffce0-2c7a-478c-bc7f-9e20322dca94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "address": "fa:16:3e:eb:5b:20", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae398b95-58", "ovs_interfaceid": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converting VIF {"id": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "address": "fa:16:3e:eb:5b:20", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae398b95-58", "ovs_interfaceid": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:5b:20,bridge_name='br-int',has_traffic_filtering=True,id=ae398b95-5857-4069-8fa5-c3b3e890fea3,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae398b95-58') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.objects.instance [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lazy-loading 'pci_devices' on Instance uuid 511ffce0-2c7a-478c-bc7f-9e20322dca94 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:38:28 user nova-compute[73188]:   <uuid>511ffce0-2c7a-478c-bc7f-9e20322dca94</uuid>
Aug 15 19:38:28 user nova-compute[73188]:   <name>instance-00000031</name>
Aug 15 19:38:28 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:38:28 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:38:28 user nova-compute[73188]:   <metadata>
Aug 15 19:38:28 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:38:28 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:38:28 user nova-compute[73188]:       <nova:name>tempest-AttachVolumeNegativeTest-server-933430195</nova:name>
Aug 15 19:38:28 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:38:28</nova:creationTime>
Aug 15 19:38:28 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:38:28 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:38:28 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:38:28 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:38:28 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:38:28 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:38:28 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:38:28 user nova-compute[73188]:       <nova:owner>
Aug 15 19:38:28 user nova-compute[73188]:         <nova:user uuid="0e526de0e03140bea2d410f535f75bb7">tempest-AttachVolumeNegativeTest-1373631227-project-member</nova:user>
Aug 15 19:38:28 user nova-compute[73188]:         <nova:project uuid="f5bc7d940cd1410a878ac89e24a4c4bc">tempest-AttachVolumeNegativeTest-1373631227</nova:project>
Aug 15 19:38:28 user nova-compute[73188]:       </nova:owner>
Aug 15 19:38:28 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:38:28 user nova-compute[73188]:       <nova:ports>
Aug 15 19:38:28 user nova-compute[73188]:         <nova:port uuid="ae398b95-5857-4069-8fa5-c3b3e890fea3">
Aug 15 19:38:28 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 19:38:28 user nova-compute[73188]:         </nova:port>
Aug 15 19:38:28 user nova-compute[73188]:       </nova:ports>
Aug 15 19:38:28 user nova-compute[73188]:     </nova:instance>
Aug 15 19:38:28 user nova-compute[73188]:   </metadata>
Aug 15 19:38:28 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:38:28 user nova-compute[73188]:     <system>
Aug 15 19:38:28 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:38:28 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:38:28 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:38:28 user nova-compute[73188]:       <entry name="serial">511ffce0-2c7a-478c-bc7f-9e20322dca94</entry>
Aug 15 19:38:28 user nova-compute[73188]:       <entry name="uuid">511ffce0-2c7a-478c-bc7f-9e20322dca94</entry>
Aug 15 19:38:28 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:38:28 user nova-compute[73188]:     </system>
Aug 15 19:38:28 user nova-compute[73188]:   </sysinfo>
Aug 15 19:38:28 user nova-compute[73188]:   <os>
Aug 15 19:38:28 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:38:28 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:38:28 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:38:28 user nova-compute[73188]:   </os>
Aug 15 19:38:28 user nova-compute[73188]:   <features>
Aug 15 19:38:28 user nova-compute[73188]:     <acpi/>
Aug 15 19:38:28 user nova-compute[73188]:     <apic/>
Aug 15 19:38:28 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:38:28 user nova-compute[73188]:   </features>
Aug 15 19:38:28 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:38:28 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:38:28 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:38:28 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:38:28 user nova-compute[73188]:   </clock>
Aug 15 19:38:28 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:38:28 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:38:28 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:38:28 user nova-compute[73188]:   </cpu>
Aug 15 19:38:28 user nova-compute[73188]:   <devices>
Aug 15 19:38:28 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:38:28 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:38:28 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk"/>
Aug 15 19:38:28 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:38:28 user nova-compute[73188]:     </disk>
Aug 15 19:38:28 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:38:28 user nova-compute[73188]:       <mac address="fa:16:3e:eb:5b:20"/>
Aug 15 19:38:28 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:38:28 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:38:28 user nova-compute[73188]:       <target dev="tapae398b95-58"/>
Aug 15 19:38:28 user nova-compute[73188]:     </interface>
Aug 15 19:38:28 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:38:28 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/console.log" append="off"/>
Aug 15 19:38:28 user nova-compute[73188]:     </serial>
Aug 15 19:38:28 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:38:28 user nova-compute[73188]:     <video>
Aug 15 19:38:28 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:38:28 user nova-compute[73188]:     </video>
Aug 15 19:38:28 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:38:28 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:38:28 user nova-compute[73188]:     </rng>
Aug 15 19:38:28 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:38:28 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:38:28 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:38:28 user nova-compute[73188]:     </memballoon>
Aug 15 19:38:28 user nova-compute[73188]:   </devices>
Aug 15 19:38:28 user nova-compute[73188]: </domain>
Aug 15 19:38:28 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-933430195',display_name='tempest-AttachVolumeNegativeTest-server-933430195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-933430195',id=49,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJgETPW43fcpJiiS74xOE6dd0DKF7xJHoXrgsnOi2i/eLhyFb5NTzXPqbroEffXedojxkx0rqBradtB6bZGks8P7bA9N2Y6P3FMaGfC6QRowFeYW0M7i6Gzf42EUmsCvA==',key_name='tempest-keypair-742756043',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5bc7d940cd1410a878ac89e24a4c4bc',ramdisk_id='',reservation_id='r-tiqv6s7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1373631227',owner_user_name='tempest-AttachVolumeNegativeTest-1373631227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:38:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e526de0e03140bea2d410f535f75bb7',uuid=511ffce0-2c7a-478c-bc7f-9e20322dca94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "address": "fa:16:3e:eb:5b:20", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae398b95-58", "ovs_interfaceid": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converting VIF {"id": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "address": "fa:16:3e:eb:5b:20", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae398b95-58", "ovs_interfaceid": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:5b:20,bridge_name='br-int',has_traffic_filtering=True,id=ae398b95-5857-4069-8fa5-c3b3e890fea3,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae398b95-58') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG os_vif [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:5b:20,bridge_name='br-int',has_traffic_filtering=True,id=ae398b95-5857-4069-8fa5-c3b3e890fea3,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae398b95-58') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae398b95-58, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae398b95-58, col_values=(('external_ids', {'iface-id': 'ae398b95-5857-4069-8fa5-c3b3e890fea3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:5b:20', 'vm-uuid': '511ffce0-2c7a-478c-bc7f-9e20322dca94'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:28 user nova-compute[73188]: INFO os_vif [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:5b:20,bridge_name='br-int',has_traffic_filtering=True,id=ae398b95-5857-4069-8fa5-c3b3e890fea3,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae398b95-58')
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:38:28 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] No VIF found with MAC fa:16:3e:eb:5b:20, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:38:29 user nova-compute[73188]: DEBUG nova.network.neutron [req-7b475648-f3a2-40ed-9de2-2f35e6e549fd req-2a25d6da-b129-4abf-8d6b-d3bb02a094bf service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Updated VIF entry in instance network info cache for port ae398b95-5857-4069-8fa5-c3b3e890fea3. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:38:29 user nova-compute[73188]: DEBUG nova.network.neutron [req-7b475648-f3a2-40ed-9de2-2f35e6e549fd req-2a25d6da-b129-4abf-8d6b-d3bb02a094bf service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Updating instance_info_cache with network_info: [{"id": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "address": "fa:16:3e:eb:5b:20", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae398b95-58", "ovs_interfaceid": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:38:29 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7b475648-f3a2-40ed-9de2-2f35e6e549fd req-2a25d6da-b129-4abf-8d6b-d3bb02a094bf service nova] Releasing lock "refresh_cache-511ffce0-2c7a-478c-bc7f-9e20322dca94" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:38:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:30 user nova-compute[73188]: DEBUG nova.compute.manager [req-2b1d2f16-3619-4392-a434-292cd665ef73 req-ec1f8388-ca43-4d06-95aa-e776f6f06af6 service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Received event network-vif-plugged-ae398b95-5857-4069-8fa5-c3b3e890fea3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:38:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2b1d2f16-3619-4392-a434-292cd665ef73 req-ec1f8388-ca43-4d06-95aa-e776f6f06af6 service nova] Acquiring lock "511ffce0-2c7a-478c-bc7f-9e20322dca94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:38:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2b1d2f16-3619-4392-a434-292cd665ef73 req-ec1f8388-ca43-4d06-95aa-e776f6f06af6 service nova] Lock "511ffce0-2c7a-478c-bc7f-9e20322dca94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:38:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-2b1d2f16-3619-4392-a434-292cd665ef73 req-ec1f8388-ca43-4d06-95aa-e776f6f06af6 service nova] Lock "511ffce0-2c7a-478c-bc7f-9e20322dca94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:38:30 user nova-compute[73188]: DEBUG nova.compute.manager [req-2b1d2f16-3619-4392-a434-292cd665ef73 req-ec1f8388-ca43-4d06-95aa-e776f6f06af6 service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] No waiting events found dispatching network-vif-plugged-ae398b95-5857-4069-8fa5-c3b3e890fea3 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:38:30 user nova-compute[73188]: WARNING nova.compute.manager [req-2b1d2f16-3619-4392-a434-292cd665ef73 req-ec1f8388-ca43-4d06-95aa-e776f6f06af6 service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Received unexpected event network-vif-plugged-ae398b95-5857-4069-8fa5-c3b3e890fea3 for instance with vm_state building and task_state spawning.
Aug 15 19:38:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:32 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692128312.2405796, 511ffce0-2c7a-478c-bc7f-9e20322dca94 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:38:32 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] VM Resumed (Lifecycle Event)
Aug 15 19:38:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:38:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:38:32 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Instance spawned successfully.
Aug 15 19:38:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:38:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:38:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:38:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:38:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:38:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:38:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:38:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:38:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:38:32 user nova-compute[73188]: DEBUG nova.compute.manager [req-627b0a06-e0ab-457c-b888-a6302b6922be req-a32fb09c-1f10-4e61-b455-f21d3953ada1 service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Received event network-vif-plugged-ae398b95-5857-4069-8fa5-c3b3e890fea3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:38:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-627b0a06-e0ab-457c-b888-a6302b6922be req-a32fb09c-1f10-4e61-b455-f21d3953ada1 service nova] Acquiring lock "511ffce0-2c7a-478c-bc7f-9e20322dca94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:38:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-627b0a06-e0ab-457c-b888-a6302b6922be req-a32fb09c-1f10-4e61-b455-f21d3953ada1 service nova] Lock "511ffce0-2c7a-478c-bc7f-9e20322dca94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:38:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-627b0a06-e0ab-457c-b888-a6302b6922be req-a32fb09c-1f10-4e61-b455-f21d3953ada1 service nova] Lock "511ffce0-2c7a-478c-bc7f-9e20322dca94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:38:32 user nova-compute[73188]: DEBUG nova.compute.manager [req-627b0a06-e0ab-457c-b888-a6302b6922be req-a32fb09c-1f10-4e61-b455-f21d3953ada1 service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] No waiting events found dispatching network-vif-plugged-ae398b95-5857-4069-8fa5-c3b3e890fea3 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:38:32 user nova-compute[73188]: WARNING nova.compute.manager [req-627b0a06-e0ab-457c-b888-a6302b6922be req-a32fb09c-1f10-4e61-b455-f21d3953ada1 service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Received unexpected event network-vif-plugged-ae398b95-5857-4069-8fa5-c3b3e890fea3 for instance with vm_state building and task_state spawning.
Aug 15 19:38:32 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:38:32 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692128312.244183, 511ffce0-2c7a-478c-bc7f-9e20322dca94 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:38:32 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] VM Started (Lifecycle Event)
Aug 15 19:38:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:38:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:38:32 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:38:32 user nova-compute[73188]: INFO nova.compute.manager [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Took 5.97 seconds to spawn the instance on the hypervisor.
Aug 15 19:38:32 user nova-compute[73188]: DEBUG nova.compute.manager [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:38:32 user nova-compute[73188]: INFO nova.compute.manager [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Took 6.56 seconds to build instance.
Aug 15 19:38:32 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-1e331463-82a6-44c2-9d0e-3a835337149c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "511ffce0-2c7a-478c-bc7f-9e20322dca94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.659s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:38:33 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:38:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:34 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:38:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:37 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquiring lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquiring lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-01f0f756-44c8-4c8b-afef-2f7d845eacd2 req-6fa149e0-c21f-4c21-b329-9d878ae10e93 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Received event network-changed-14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-01f0f756-44c8-4c8b-afef-2f7d845eacd2 req-6fa149e0-c21f-4c21-b329-9d878ae10e93 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Refreshing instance network info cache due to event network-changed-14f35d48-3eee-47e2-84b7-d5805df1d826. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-01f0f756-44c8-4c8b-afef-2f7d845eacd2 req-6fa149e0-c21f-4c21-b329-9d878ae10e93 service nova] Acquiring lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-01f0f756-44c8-4c8b-afef-2f7d845eacd2 req-6fa149e0-c21f-4c21-b329-9d878ae10e93 service nova] Acquired lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG nova.network.neutron [req-01f0f756-44c8-4c8b-afef-2f7d845eacd2 req-6fa149e0-c21f-4c21-b329-9d878ae10e93 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Refreshing network info cache for port 14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:38:38 user nova-compute[73188]: INFO nova.compute.manager [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Terminating instance
Aug 15 19:38:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:38:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG nova.network.neutron [req-01f0f756-44c8-4c8b-afef-2f7d845eacd2 req-6fa149e0-c21f-4c21-b329-9d878ae10e93 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Updated VIF entry in instance network info cache for port 14f35d48-3eee-47e2-84b7-d5805df1d826. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG nova.network.neutron [req-01f0f756-44c8-4c8b-afef-2f7d845eacd2 req-6fa149e0-c21f-4c21-b329-9d878ae10e93 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Updating instance_info_cache with network_info: [{"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f35d48-3e", "ovs_interfaceid": "14f35d48-3eee-47e2-84b7-d5805df1d826", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-01f0f756-44c8-4c8b-afef-2f7d845eacd2 req-6fa149e0-c21f-4c21-b329-9d878ae10e93 service nova] Releasing lock "refresh_cache-6e48fce8-e4d4-4e30-a67e-5d81036b14cc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:38:39 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Instance destroyed successfully.
Aug 15 19:38:39 user nova-compute[73188]: DEBUG nova.objects.instance [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lazy-loading 'resources' on Instance uuid 6e48fce8-e4d4-4e30-a67e-5d81036b14cc {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T19:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2091190492',display_name='tempest-TestShelveInstance-server-2091190492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2091190492',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPz6u2nYKHQFAzYTyRfEeG06JbJBrTKBAcp90LkXrGpbDb7LTDjsVtedLmtluIbnn4t0KMbFAZIEu7pwAqVfeTIXG4MwAsMd5VwhFHLOWX5ycW/llYPoLXd8JAdz8j5jNA==',key_name='tempest-TestShelveInstance-1880994155',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:37:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6e83dc2ac5e4beb9043d1539bba6ddb',ramdisk_id='',reservation_id='r-a5dttlzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-704396217',owner_user_name='tempest-TestShelveInstance-704396217-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:37:09Z,user_data=None,user_id='d432668099f24666a003c56ec5ca4001',uuid=6e48fce8-e4d4-4e30-a67e-5d81036b14cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f35d48-3e", "ovs_interfaceid": "14f35d48-3eee-47e2-84b7-d5805df1d826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Converting VIF {"id": "14f35d48-3eee-47e2-84b7-d5805df1d826", "address": "fa:16:3e:17:4e:1a", "network": {"id": "943da617-81f7-4b12-8278-0ce36f9f1d20", "bridge": "br-int", "label": "tempest-TestShelveInstance-1356505746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6e83dc2ac5e4beb9043d1539bba6ddb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f35d48-3e", "ovs_interfaceid": "14f35d48-3eee-47e2-84b7-d5805df1d826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:4e:1a,bridge_name='br-int',has_traffic_filtering=True,id=14f35d48-3eee-47e2-84b7-d5805df1d826,network=Network(943da617-81f7-4b12-8278-0ce36f9f1d20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f35d48-3e') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG os_vif [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:4e:1a,bridge_name='br-int',has_traffic_filtering=True,id=14f35d48-3eee-47e2-84b7-d5805df1d826,network=Network(943da617-81f7-4b12-8278-0ce36f9f1d20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f35d48-3e') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14f35d48-3e, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:38:39 user nova-compute[73188]: INFO os_vif [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:4e:1a,bridge_name='br-int',has_traffic_filtering=True,id=14f35d48-3eee-47e2-84b7-d5805df1d826,network=Network(943da617-81f7-4b12-8278-0ce36f9f1d20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f35d48-3e')
Aug 15 19:38:39 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jEJQyGcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:38:39 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:38:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:38:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6093c69-3d5b-467a-9234-5479a7a557ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6680df34-02dd-4f23-b06d-7fab09a2af52]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 (non-flash)
Aug 15 19:38:40 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 (non-flash)
Aug 15 19:38:40 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f280832a560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3'): ({'sdb'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Removing single pathed devices sdb {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:38:40 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:38:40 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:38:40 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8335MB free_disk=25.18777847290039GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3d11e2-7f65-4745-856c-aed88aec65cc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2373114-f61d-4084-8ff7-aafa932910f3]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Flushing IO for device /dev/sdb {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[492a37d5-90ff-432e-8bcd-a3424a1fc3a0]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 6e48fce8-e4d4-4e30-a67e-5d81036b14cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 1c992ecd-ac21-44e7-937c-b19028cc95c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 511ffce0-2c7a-478c-bc7f-9e20322dca94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[27512cf0-571b-4d5f-9a00-d2342b4a861b]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13a83de-3787-4b7b-99c7-08957b847814]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdebbecd-494c-425e-81bc-dc12e93618ef]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3, portal: 172.16.0.220,3260]
Aug 15 19:38:40 user nova-compute[73188]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3, portal: 172.16.0.220,3260] successful.
Aug 15 19:38:40 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c52c974-f228-478e-8933-e1769a2d67a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ee9acc-27fa-4060-8e12-c5ce342311e9]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.767s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] <== disconnect_volume: return (770ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:38:40 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Deleting instance files /opt/stack/data/nova/instances/6e48fce8-e4d4-4e30-a67e-5d81036b14cc_del
Aug 15 19:38:40 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Deletion of /opt/stack/data/nova/instances/6e48fce8-e4d4-4e30-a67e-5d81036b14cc_del complete
Aug 15 19:38:40 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:38:40 user nova-compute[73188]: INFO nova.compute.manager [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Took 1.72 seconds to destroy the instance on the hypervisor.
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-e53d9826-1764-48a0-9cd3-b4684efecded req-e7227354-9fb2-4d9f-a83d-bbdfa4ad81ae service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Received event network-vif-unplugged-14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e53d9826-1764-48a0-9cd3-b4684efecded req-e7227354-9fb2-4d9f-a83d-bbdfa4ad81ae service nova] Acquiring lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e53d9826-1764-48a0-9cd3-b4684efecded req-e7227354-9fb2-4d9f-a83d-bbdfa4ad81ae service nova] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e53d9826-1764-48a0-9cd3-b4684efecded req-e7227354-9fb2-4d9f-a83d-bbdfa4ad81ae service nova] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-e53d9826-1764-48a0-9cd3-b4684efecded req-e7227354-9fb2-4d9f-a83d-bbdfa4ad81ae service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] No waiting events found dispatching network-vif-unplugged-14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-e53d9826-1764-48a0-9cd3-b4684efecded req-e7227354-9fb2-4d9f-a83d-bbdfa4ad81ae service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Received event network-vif-unplugged-14f35d48-3eee-47e2-84b7-d5805df1d826 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-e53d9826-1764-48a0-9cd3-b4684efecded req-e7227354-9fb2-4d9f-a83d-bbdfa4ad81ae service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Received event network-vif-plugged-14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e53d9826-1764-48a0-9cd3-b4684efecded req-e7227354-9fb2-4d9f-a83d-bbdfa4ad81ae service nova] Acquiring lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e53d9826-1764-48a0-9cd3-b4684efecded req-e7227354-9fb2-4d9f-a83d-bbdfa4ad81ae service nova] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e53d9826-1764-48a0-9cd3-b4684efecded req-e7227354-9fb2-4d9f-a83d-bbdfa4ad81ae service nova] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:38:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-e53d9826-1764-48a0-9cd3-b4684efecded req-e7227354-9fb2-4d9f-a83d-bbdfa4ad81ae service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] No waiting events found dispatching network-vif-plugged-14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:38:40 user nova-compute[73188]: WARNING nova.compute.manager [req-e53d9826-1764-48a0-9cd3-b4684efecded req-e7227354-9fb2-4d9f-a83d-bbdfa4ad81ae service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Received unexpected event network-vif-plugged-14f35d48-3eee-47e2-84b7-d5805df1d826 for instance with vm_state active and task_state deleting.
Aug 15 19:38:41 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:38:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-54c4f68f-d251-46fd-b7ee-e9954ea81cd6 req-0c1f7d9d-0b9c-4629-9492-864079a55a37 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Received event network-vif-deleted-14f35d48-3eee-47e2-84b7-d5805df1d826 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:38:41 user nova-compute[73188]: INFO nova.compute.manager [req-54c4f68f-d251-46fd-b7ee-e9954ea81cd6 req-0c1f7d9d-0b9c-4629-9492-864079a55a37 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Neutron deleted interface 14f35d48-3eee-47e2-84b7-d5805df1d826; detaching it from the instance and deleting it from the info cache
Aug 15 19:38:41 user nova-compute[73188]: DEBUG nova.network.neutron [req-54c4f68f-d251-46fd-b7ee-e9954ea81cd6 req-0c1f7d9d-0b9c-4629-9492-864079a55a37 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:38:41 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Took 0.58 seconds to deallocate network for instance.
Aug 15 19:38:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-54c4f68f-d251-46fd-b7ee-e9954ea81cd6 req-0c1f7d9d-0b9c-4629-9492-864079a55a37 service nova] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Detach interface failed, port_id=14f35d48-3eee-47e2-84b7-d5805df1d826, reason: Instance 6e48fce8-e4d4-4e30-a67e-5d81036b14cc could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:38:41 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:38:41 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:38:41 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:38:41 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Skipping network cache update for instance because it is being deleted. {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 15 19:38:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:38:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:38:41 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:38:41 user nova-compute[73188]: DEBUG nova.objects.instance [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lazy-loading 'info_cache' on Instance uuid 1c992ecd-ac21-44e7-937c-b19028cc95c2 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:38:41 user nova-compute[73188]: INFO nova.compute.manager [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Took 0.87 seconds to detach 1 volumes for instance.
Aug 15 19:38:41 user nova-compute[73188]: DEBUG nova.compute.manager [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Deleting volume: 1c52c974-f228-478e-8933-e1769a2d67a3 {{(pid=73188) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 19:38:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:38:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:38:42 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Updating instance_info_cache with network_info: [{"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fa5237-0a", "ovs_interfaceid": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:38:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-1c992ecd-ac21-44e7-937c-b19028cc95c2" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:38:42 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:38:42 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:38:42 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:38:42 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:38:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:38:42 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Deleted allocations for instance 6e48fce8-e4d4-4e30-a67e-5d81036b14cc
Aug 15 19:38:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-2958f8e8-2c46-400b-8037-53e0490826ae tempest-TestShelveInstance-704396217 tempest-TestShelveInstance-704396217-project-member] Lock "6e48fce8-e4d4-4e30-a67e-5d81036b14cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.697s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:38:44 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:38:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:46 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:38:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:54 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692128319.5915527, 6e48fce8-e4d4-4e30-a67e-5d81036b14cc => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:38:54 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] VM Stopped (Lifecycle Event)
Aug 15 19:38:54 user nova-compute[73188]: DEBUG nova.compute.manager [None req-bf3a7a4c-24bd-4925-97a7-54eaf616f6ac None None] [instance: 6e48fce8-e4d4-4e30-a67e-5d81036b14cc] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:38:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:38:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:04 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "1c992ecd-ac21-44e7-937c-b19028cc95c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:39:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:39:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:39:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:39:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:39:06 user nova-compute[73188]: INFO nova.compute.manager [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Terminating instance
Aug 15 19:39:06 user nova-compute[73188]: DEBUG nova.compute.manager [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:39:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:06 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-eea59ba3-641a-49b6-96c7-0ee008b40484 req-0d084ccf-36b0-480b-b345-eafb1f10dcf3 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Received event network-vif-unplugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:39:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-eea59ba3-641a-49b6-96c7-0ee008b40484 req-0d084ccf-36b0-480b-b345-eafb1f10dcf3 service nova] Acquiring lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:39:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-eea59ba3-641a-49b6-96c7-0ee008b40484 req-0d084ccf-36b0-480b-b345-eafb1f10dcf3 service nova] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:39:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-eea59ba3-641a-49b6-96c7-0ee008b40484 req-0d084ccf-36b0-480b-b345-eafb1f10dcf3 service nova] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:39:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-eea59ba3-641a-49b6-96c7-0ee008b40484 req-0d084ccf-36b0-480b-b345-eafb1f10dcf3 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] No waiting events found dispatching network-vif-unplugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:39:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-eea59ba3-641a-49b6-96c7-0ee008b40484 req-0d084ccf-36b0-480b-b345-eafb1f10dcf3 service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Received event network-vif-unplugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:39:07 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Instance destroyed successfully.
Aug 15 19:39:07 user nova-compute[73188]: DEBUG nova.objects.instance [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lazy-loading 'resources' on Instance uuid 1c992ecd-ac21-44e7-937c-b19028cc95c2 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:39:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T19:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-899178377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-899178377',id=47,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJWfFiblUIxO45fvcHFyaFxnFyqoFEPiOpvAeB5891ntCBT24TtXi1NaeFYPpa1oVaW8yMFBytF1mLakrHIeM0NduhCTsFyJXwHHx4r86jNa94MH9PX63//JN20aalewA==',key_name='tempest-keypair-1267490924',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:37:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='409362f6976b454ba96b7580b35db949',ramdisk_id='',reservation_id='r-0uo6aeyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1675372664',owner_user_name='tempest-AttachVolumeShelveTestJSON-1675372664-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:37:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7df4b06e72a452ca1dd4643694ce570',uuid=1c992ecd-ac21-44e7-937c-b19028cc95c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fa5237-0a", "ovs_interfaceid": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:39:07 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converting VIF {"id": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "address": "fa:16:3e:7f:d4:70", "network": {"id": "ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-885085169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409362f6976b454ba96b7580b35db949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17fa5237-0a", "ovs_interfaceid": "17fa5237-0a8d-4f42-956d-d4a9732b4539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:39:07 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:d4:70,bridge_name='br-int',has_traffic_filtering=True,id=17fa5237-0a8d-4f42-956d-d4a9732b4539,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fa5237-0a') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:39:07 user nova-compute[73188]: DEBUG os_vif [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:d4:70,bridge_name='br-int',has_traffic_filtering=True,id=17fa5237-0a8d-4f42-956d-d4a9732b4539,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fa5237-0a') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:39:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17fa5237-0a, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:39:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:39:07 user nova-compute[73188]: INFO os_vif [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:d4:70,bridge_name='br-int',has_traffic_filtering=True,id=17fa5237-0a8d-4f42-956d-d4a9732b4539,network=Network(ee3dfa1f-f3de-4d3e-a2d6-cc7b01489ae5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17fa5237-0a')
Aug 15 19:39:07 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Deleting instance files /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2_del
Aug 15 19:39:07 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Deletion of /opt/stack/data/nova/instances/1c992ecd-ac21-44e7-937c-b19028cc95c2_del complete
Aug 15 19:39:07 user nova-compute[73188]: INFO nova.compute.manager [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 15 19:39:07 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:39:07 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:39:07 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:39:08 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:39:08 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Took 0.78 seconds to deallocate network for instance.
Aug 15 19:39:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-331abce4-b41d-4fd0-b8f8-5579c49f1434 req-0ec238cb-d1e4-49bd-aa5b-1c24d28a44bc service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Received event network-vif-deleted-17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:39:08 user nova-compute[73188]: INFO nova.compute.manager [req-331abce4-b41d-4fd0-b8f8-5579c49f1434 req-0ec238cb-d1e4-49bd-aa5b-1c24d28a44bc service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Neutron deleted interface 17fa5237-0a8d-4f42-956d-d4a9732b4539; detaching it from the instance and deleting it from the info cache
Aug 15 19:39:08 user nova-compute[73188]: DEBUG nova.network.neutron [req-331abce4-b41d-4fd0-b8f8-5579c49f1434 req-0ec238cb-d1e4-49bd-aa5b-1c24d28a44bc service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:39:08 user nova-compute[73188]: DEBUG nova.compute.manager [req-331abce4-b41d-4fd0-b8f8-5579c49f1434 req-0ec238cb-d1e4-49bd-aa5b-1c24d28a44bc service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Detach interface failed, port_id=17fa5237-0a8d-4f42-956d-d4a9732b4539, reason: Instance 1c992ecd-ac21-44e7-937c-b19028cc95c2 could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:39:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:39:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:39:08 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:39:08 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:39:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:39:08 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Deleted allocations for instance 1c992ecd-ac21-44e7-937c-b19028cc95c2
Aug 15 19:39:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-66dcfed9-6703-4295-baba-99586ac17a57 tempest-AttachVolumeShelveTestJSON-1675372664 tempest-AttachVolumeShelveTestJSON-1675372664-project-member] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.788s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:39:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-e6c9c68c-ea77-419d-a651-e0101f43dc83 req-2fdfd724-4ba5-4928-9b02-037495576dcb service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Received event network-vif-plugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:39:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e6c9c68c-ea77-419d-a651-e0101f43dc83 req-2fdfd724-4ba5-4928-9b02-037495576dcb service nova] Acquiring lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:39:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e6c9c68c-ea77-419d-a651-e0101f43dc83 req-2fdfd724-4ba5-4928-9b02-037495576dcb service nova] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:39:09 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e6c9c68c-ea77-419d-a651-e0101f43dc83 req-2fdfd724-4ba5-4928-9b02-037495576dcb service nova] Lock "1c992ecd-ac21-44e7-937c-b19028cc95c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:39:09 user nova-compute[73188]: DEBUG nova.compute.manager [req-e6c9c68c-ea77-419d-a651-e0101f43dc83 req-2fdfd724-4ba5-4928-9b02-037495576dcb service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] No waiting events found dispatching network-vif-plugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:39:09 user nova-compute[73188]: WARNING nova.compute.manager [req-e6c9c68c-ea77-419d-a651-e0101f43dc83 req-2fdfd724-4ba5-4928-9b02-037495576dcb service nova] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Received unexpected event network-vif-plugged-17fa5237-0a8d-4f42-956d-d4a9732b4539 for instance with vm_state deleted and task_state None.
Aug 15 19:39:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:22 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692128347.3220994, 1c992ecd-ac21-44e7-937c-b19028cc95c2 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:39:22 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] VM Stopped (Lifecycle Event)
Aug 15 19:39:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-fc102277-46c7-4a80-99b0-36b3ba4a4565 None None] [instance: 1c992ecd-ac21-44e7-937c-b19028cc95c2] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:39:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:39:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:39:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:39:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:39:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:39:29 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:33 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:39:34 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:39:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:38 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:39:39 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:39:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:39:40 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:39:40 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:39:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-511ffce0-2c7a-478c-bc7f-9e20322dca94" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:39:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-511ffce0-2c7a-478c-bc7f-9e20322dca94" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:39:40 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:39:41 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Updating instance_info_cache with network_info: [{"id": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "address": "fa:16:3e:eb:5b:20", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae398b95-58", "ovs_interfaceid": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:39:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-511ffce0-2c7a-478c-bc7f-9e20322dca94" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:39:41 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:39:41 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:39:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:39:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:39:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:39:41 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:39:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:39:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:39:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:39:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:39:41 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:42 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:39:42 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:39:42 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8650MB free_disk=25.18597412109375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:39:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:39:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:39:42 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 511ffce0-2c7a-478c-bc7f-9e20322dca94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:39:42 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:39:42 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:39:42 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:39:42 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:39:42 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:39:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:39:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:42 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:39:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:44 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:39:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:47 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:39:49 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:49 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:39:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:39:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:39:55 user nova-compute[73188]: DEBUG nova.compute.manager [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:39:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:39:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:39:55 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:39:55 user nova-compute[73188]: INFO nova.compute.claims [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Claim successful on node user
Aug 15 19:39:55 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:39:55 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG nova.compute.manager [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG nova.compute.manager [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG nova.network.neutron [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:39:56 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:39:56 user nova-compute[73188]: DEBUG nova.compute.manager [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG nova.policy [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32ac444e64b14b1cbe4a3bf6bf6a579b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359d1159e0894d9fb21e8e8afdc397b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG nova.compute.manager [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:39:56 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Creating image(s)
Aug 15 19:39:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "/opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "/opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.180s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk 1073741824" returned: 0 in 0.049s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.177s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Cannot resize image /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:39:56 user nova-compute[73188]: DEBUG nova.objects.instance [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lazy-loading 'migration_context' on Instance uuid 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:39:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:39:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Ensure instance console log exists: /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:39:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:39:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:39:57 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:39:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:57 user nova-compute[73188]: DEBUG nova.network.neutron [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Successfully created port: 69b8e5d9-a600-492a-bc81-0e04d22871fb {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:39:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.network.neutron [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Successfully updated port: 69b8e5d9-a600-492a-bc81-0e04d22871fb {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "refresh_cache-6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquired lock "refresh_cache-6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.network.neutron [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-b3f1b441-aed7-4239-80e4-3005c414bd51 req-7219b311-8709-4eb2-95cc-4473ac89ae9f service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Received event network-changed-69b8e5d9-a600-492a-bc81-0e04d22871fb {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.compute.manager [req-b3f1b441-aed7-4239-80e4-3005c414bd51 req-7219b311-8709-4eb2-95cc-4473ac89ae9f service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Refreshing instance network info cache due to event network-changed-69b8e5d9-a600-492a-bc81-0e04d22871fb. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b3f1b441-aed7-4239-80e4-3005c414bd51 req-7219b311-8709-4eb2-95cc-4473ac89ae9f service nova] Acquiring lock "refresh_cache-6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.network.neutron [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.network.neutron [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Updating instance_info_cache with network_info: [{"id": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "address": "fa:16:3e:b8:89:9f", "network": {"id": "7502a12f-0713-4580-a7f2-8cfd4d75c1d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-988103788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "359d1159e0894d9fb21e8e8afdc397b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8e5d9-a6", "ovs_interfaceid": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Releasing lock "refresh_cache-6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Instance network_info: |[{"id": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "address": "fa:16:3e:b8:89:9f", "network": {"id": "7502a12f-0713-4580-a7f2-8cfd4d75c1d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-988103788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "359d1159e0894d9fb21e8e8afdc397b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8e5d9-a6", "ovs_interfaceid": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b3f1b441-aed7-4239-80e4-3005c414bd51 req-7219b311-8709-4eb2-95cc-4473ac89ae9f service nova] Acquired lock "refresh_cache-6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.network.neutron [req-b3f1b441-aed7-4239-80e4-3005c414bd51 req-7219b311-8709-4eb2-95cc-4473ac89ae9f service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Refreshing network info cache for port 69b8e5d9-a600-492a-bc81-0e04d22871fb {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Start _get_guest_xml network_info=[{"id": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "address": "fa:16:3e:b8:89:9f", "network": {"id": "7502a12f-0713-4580-a7f2-8cfd4d75c1d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-988103788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "359d1159e0894d9fb21e8e8afdc397b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8e5d9-a6", "ovs_interfaceid": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:39:58 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:39:58 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:39:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-864973667',display_name='tempest-SnapshotDataIntegrityTests-server-864973667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-864973667',id=50,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN+g55ntT0/DSLK2I24g25ZTVwVQHR3dHwPQ6Jb+KLbPdhQlJuepV+UBqkCAwUYjToUnCHFSNVqUQbly/EyHb+Yye+497y0tePm3SW4ApXAxihn74iTZI0wWNVQpZLQfg==',key_name='tempest-keypair-393585547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='359d1159e0894d9fb21e8e8afdc397b7',ramdisk_id='',reservation_id='r-q8ublx2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-952510571',owner_user_name='tempest-SnapshotDataIntegrityTests-952510571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:39:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32ac444e64b14b1cbe4a3bf6bf6a579b',uuid=6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "address": "fa:16:3e:b8:89:9f", "network": {"id": "7502a12f-0713-4580-a7f2-8cfd4d75c1d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-988103788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "359d1159e0894d9fb21e8e8afdc397b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8e5d9-a6", "ovs_interfaceid": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Converting VIF {"id": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "address": "fa:16:3e:b8:89:9f", "network": {"id": "7502a12f-0713-4580-a7f2-8cfd4d75c1d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-988103788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "359d1159e0894d9fb21e8e8afdc397b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8e5d9-a6", "ovs_interfaceid": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:89:9f,bridge_name='br-int',has_traffic_filtering=True,id=69b8e5d9-a600-492a-bc81-0e04d22871fb,network=Network(7502a12f-0713-4580-a7f2-8cfd4d75c1d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b8e5d9-a6') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.objects.instance [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:39:58 user nova-compute[73188]:   <uuid>6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb</uuid>
Aug 15 19:39:58 user nova-compute[73188]:   <name>instance-00000032</name>
Aug 15 19:39:58 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:39:58 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:39:58 user nova-compute[73188]:   <metadata>
Aug 15 19:39:58 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:39:58 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:39:58 user nova-compute[73188]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-864973667</nova:name>
Aug 15 19:39:58 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:39:58</nova:creationTime>
Aug 15 19:39:58 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:39:58 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:39:58 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:39:58 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:39:58 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:39:58 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:39:58 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:39:58 user nova-compute[73188]:       <nova:owner>
Aug 15 19:39:58 user nova-compute[73188]:         <nova:user uuid="32ac444e64b14b1cbe4a3bf6bf6a579b">tempest-SnapshotDataIntegrityTests-952510571-project-member</nova:user>
Aug 15 19:39:58 user nova-compute[73188]:         <nova:project uuid="359d1159e0894d9fb21e8e8afdc397b7">tempest-SnapshotDataIntegrityTests-952510571</nova:project>
Aug 15 19:39:58 user nova-compute[73188]:       </nova:owner>
Aug 15 19:39:58 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:39:58 user nova-compute[73188]:       <nova:ports>
Aug 15 19:39:58 user nova-compute[73188]:         <nova:port uuid="69b8e5d9-a600-492a-bc81-0e04d22871fb">
Aug 15 19:39:58 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 19:39:58 user nova-compute[73188]:         </nova:port>
Aug 15 19:39:58 user nova-compute[73188]:       </nova:ports>
Aug 15 19:39:58 user nova-compute[73188]:     </nova:instance>
Aug 15 19:39:58 user nova-compute[73188]:   </metadata>
Aug 15 19:39:58 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:39:58 user nova-compute[73188]:     <system>
Aug 15 19:39:58 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:39:58 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:39:58 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:39:58 user nova-compute[73188]:       <entry name="serial">6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb</entry>
Aug 15 19:39:58 user nova-compute[73188]:       <entry name="uuid">6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb</entry>
Aug 15 19:39:58 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:39:58 user nova-compute[73188]:     </system>
Aug 15 19:39:58 user nova-compute[73188]:   </sysinfo>
Aug 15 19:39:58 user nova-compute[73188]:   <os>
Aug 15 19:39:58 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:39:58 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:39:58 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:39:58 user nova-compute[73188]:   </os>
Aug 15 19:39:58 user nova-compute[73188]:   <features>
Aug 15 19:39:58 user nova-compute[73188]:     <acpi/>
Aug 15 19:39:58 user nova-compute[73188]:     <apic/>
Aug 15 19:39:58 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:39:58 user nova-compute[73188]:   </features>
Aug 15 19:39:58 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:39:58 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:39:58 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:39:58 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:39:58 user nova-compute[73188]:   </clock>
Aug 15 19:39:58 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:39:58 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:39:58 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:39:58 user nova-compute[73188]:   </cpu>
Aug 15 19:39:58 user nova-compute[73188]:   <devices>
Aug 15 19:39:58 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:39:58 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:39:58 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk"/>
Aug 15 19:39:58 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:39:58 user nova-compute[73188]:     </disk>
Aug 15 19:39:58 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:39:58 user nova-compute[73188]:       <mac address="fa:16:3e:b8:89:9f"/>
Aug 15 19:39:58 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:39:58 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:39:58 user nova-compute[73188]:       <target dev="tap69b8e5d9-a6"/>
Aug 15 19:39:58 user nova-compute[73188]:     </interface>
Aug 15 19:39:58 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:39:58 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/console.log" append="off"/>
Aug 15 19:39:58 user nova-compute[73188]:     </serial>
Aug 15 19:39:58 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:39:58 user nova-compute[73188]:     <video>
Aug 15 19:39:58 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:39:58 user nova-compute[73188]:     </video>
Aug 15 19:39:58 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:39:58 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:39:58 user nova-compute[73188]:     </rng>
Aug 15 19:39:58 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:39:58 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:39:58 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:39:58 user nova-compute[73188]:     </memballoon>
Aug 15 19:39:58 user nova-compute[73188]:   </devices>
Aug 15 19:39:58 user nova-compute[73188]: </domain>
Aug 15 19:39:58 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:39:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-864973667',display_name='tempest-SnapshotDataIntegrityTests-server-864973667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-864973667',id=50,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN+g55ntT0/DSLK2I24g25ZTVwVQHR3dHwPQ6Jb+KLbPdhQlJuepV+UBqkCAwUYjToUnCHFSNVqUQbly/EyHb+Yye+497y0tePm3SW4ApXAxihn74iTZI0wWNVQpZLQfg==',key_name='tempest-keypair-393585547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='359d1159e0894d9fb21e8e8afdc397b7',ramdisk_id='',reservation_id='r-q8ublx2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-952510571',owner_user_name='tempest-SnapshotDataIntegrityTests-952510571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:39:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32ac444e64b14b1cbe4a3bf6bf6a579b',uuid=6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "address": "fa:16:3e:b8:89:9f", "network": {"id": "7502a12f-0713-4580-a7f2-8cfd4d75c1d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-988103788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "359d1159e0894d9fb21e8e8afdc397b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8e5d9-a6", "ovs_interfaceid": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Converting VIF {"id": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "address": "fa:16:3e:b8:89:9f", "network": {"id": "7502a12f-0713-4580-a7f2-8cfd4d75c1d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-988103788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "359d1159e0894d9fb21e8e8afdc397b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8e5d9-a6", "ovs_interfaceid": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:89:9f,bridge_name='br-int',has_traffic_filtering=True,id=69b8e5d9-a600-492a-bc81-0e04d22871fb,network=Network(7502a12f-0713-4580-a7f2-8cfd4d75c1d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b8e5d9-a6') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG os_vif [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:89:9f,bridge_name='br-int',has_traffic_filtering=True,id=69b8e5d9-a600-492a-bc81-0e04d22871fb,network=Network(7502a12f-0713-4580-a7f2-8cfd4d75c1d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b8e5d9-a6') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69b8e5d9-a6, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69b8e5d9-a6, col_values=(('external_ids', {'iface-id': '69b8e5d9-a600-492a-bc81-0e04d22871fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:89:9f', 'vm-uuid': '6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:58 user nova-compute[73188]: INFO os_vif [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:89:9f,bridge_name='br-int',has_traffic_filtering=True,id=69b8e5d9-a600-492a-bc81-0e04d22871fb,network=Network(7502a12f-0713-4580-a7f2-8cfd4d75c1d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b8e5d9-a6')
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] No VIF found with MAC fa:16:3e:b8:89:9f, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.network.neutron [req-b3f1b441-aed7-4239-80e4-3005c414bd51 req-7219b311-8709-4eb2-95cc-4473ac89ae9f service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Updated VIF entry in instance network info cache for port 69b8e5d9-a600-492a-bc81-0e04d22871fb. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG nova.network.neutron [req-b3f1b441-aed7-4239-80e4-3005c414bd51 req-7219b311-8709-4eb2-95cc-4473ac89ae9f service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Updating instance_info_cache with network_info: [{"id": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "address": "fa:16:3e:b8:89:9f", "network": {"id": "7502a12f-0713-4580-a7f2-8cfd4d75c1d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-988103788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "359d1159e0894d9fb21e8e8afdc397b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8e5d9-a6", "ovs_interfaceid": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:39:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b3f1b441-aed7-4239-80e4-3005c414bd51 req-7219b311-8709-4eb2-95cc-4473ac89ae9f service nova] Releasing lock "refresh_cache-6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:39:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:39:59 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:00 user nova-compute[73188]: DEBUG nova.compute.manager [req-7227d905-00e8-46d7-ae8b-06faf3bc2d22 req-491b5df3-826f-4c6f-b924-9a6ea2d6f0d2 service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Received event network-vif-plugged-69b8e5d9-a600-492a-bc81-0e04d22871fb {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:40:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7227d905-00e8-46d7-ae8b-06faf3bc2d22 req-491b5df3-826f-4c6f-b924-9a6ea2d6f0d2 service nova] Acquiring lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:40:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7227d905-00e8-46d7-ae8b-06faf3bc2d22 req-491b5df3-826f-4c6f-b924-9a6ea2d6f0d2 service nova] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:40:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7227d905-00e8-46d7-ae8b-06faf3bc2d22 req-491b5df3-826f-4c6f-b924-9a6ea2d6f0d2 service nova] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:40:00 user nova-compute[73188]: DEBUG nova.compute.manager [req-7227d905-00e8-46d7-ae8b-06faf3bc2d22 req-491b5df3-826f-4c6f-b924-9a6ea2d6f0d2 service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] No waiting events found dispatching network-vif-plugged-69b8e5d9-a600-492a-bc81-0e04d22871fb {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:40:00 user nova-compute[73188]: WARNING nova.compute.manager [req-7227d905-00e8-46d7-ae8b-06faf3bc2d22 req-491b5df3-826f-4c6f-b924-9a6ea2d6f0d2 service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Received unexpected event network-vif-plugged-69b8e5d9-a600-492a-bc81-0e04d22871fb for instance with vm_state building and task_state spawning.
Aug 15 19:40:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:01 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692128401.9647744, 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:40:01 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] VM Resumed (Lifecycle Event)
Aug 15 19:40:01 user nova-compute[73188]: DEBUG nova.compute.manager [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:40:01 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:40:01 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Instance spawned successfully.
Aug 15 19:40:01 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:40:01 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:40:01 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:40:01 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:40:01 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:40:01 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:40:02 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:40:02 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:40:02 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:40:02 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:40:02 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692128401.966, 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:40:02 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] VM Started (Lifecycle Event)
Aug 15 19:40:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:40:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:40:02 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:40:02 user nova-compute[73188]: INFO nova.compute.manager [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Took 5.87 seconds to spawn the instance on the hypervisor.
Aug 15 19:40:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:40:02 user nova-compute[73188]: INFO nova.compute.manager [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Took 6.40 seconds to build instance.
Aug 15 19:40:02 user nova-compute[73188]: DEBUG nova.compute.manager [req-38494e70-88d8-4cac-9dfa-0ed3dfc3688b req-b25069a4-0c34-423d-a6ba-e947e50b81ad service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Received event network-vif-plugged-69b8e5d9-a600-492a-bc81-0e04d22871fb {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:40:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-38494e70-88d8-4cac-9dfa-0ed3dfc3688b req-b25069a4-0c34-423d-a6ba-e947e50b81ad service nova] Acquiring lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:40:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-38494e70-88d8-4cac-9dfa-0ed3dfc3688b req-b25069a4-0c34-423d-a6ba-e947e50b81ad service nova] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:40:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-38494e70-88d8-4cac-9dfa-0ed3dfc3688b req-b25069a4-0c34-423d-a6ba-e947e50b81ad service nova] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:40:02 user nova-compute[73188]: DEBUG nova.compute.manager [req-38494e70-88d8-4cac-9dfa-0ed3dfc3688b req-b25069a4-0c34-423d-a6ba-e947e50b81ad service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] No waiting events found dispatching network-vif-plugged-69b8e5d9-a600-492a-bc81-0e04d22871fb {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:40:02 user nova-compute[73188]: WARNING nova.compute.manager [req-38494e70-88d8-4cac-9dfa-0ed3dfc3688b req-b25069a4-0c34-423d-a6ba-e947e50b81ad service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Received unexpected event network-vif-plugged-69b8e5d9-a600-492a-bc81-0e04d22871fb for instance with vm_state active and task_state None.
Aug 15 19:40:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-32604b83-b742-4168-ac42-c96a2c3ec650 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.507s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:40:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:16 user nova-compute[73188]: DEBUG nova.compute.manager [req-e112fa6c-45b9-4354-88dc-3b82f7220273 req-5eb49b93-5e95-48e7-8ee6-356a839ed779 service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Received event network-changed-ae398b95-5857-4069-8fa5-c3b3e890fea3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:40:16 user nova-compute[73188]: DEBUG nova.compute.manager [req-e112fa6c-45b9-4354-88dc-3b82f7220273 req-5eb49b93-5e95-48e7-8ee6-356a839ed779 service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Refreshing instance network info cache due to event network-changed-ae398b95-5857-4069-8fa5-c3b3e890fea3. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:40:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e112fa6c-45b9-4354-88dc-3b82f7220273 req-5eb49b93-5e95-48e7-8ee6-356a839ed779 service nova] Acquiring lock "refresh_cache-511ffce0-2c7a-478c-bc7f-9e20322dca94" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:40:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e112fa6c-45b9-4354-88dc-3b82f7220273 req-5eb49b93-5e95-48e7-8ee6-356a839ed779 service nova] Acquired lock "refresh_cache-511ffce0-2c7a-478c-bc7f-9e20322dca94" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:40:16 user nova-compute[73188]: DEBUG nova.network.neutron [req-e112fa6c-45b9-4354-88dc-3b82f7220273 req-5eb49b93-5e95-48e7-8ee6-356a839ed779 service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Refreshing network info cache for port ae398b95-5857-4069-8fa5-c3b3e890fea3 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:40:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:17 user nova-compute[73188]: DEBUG nova.network.neutron [req-e112fa6c-45b9-4354-88dc-3b82f7220273 req-5eb49b93-5e95-48e7-8ee6-356a839ed779 service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Updated VIF entry in instance network info cache for port ae398b95-5857-4069-8fa5-c3b3e890fea3. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:40:17 user nova-compute[73188]: DEBUG nova.network.neutron [req-e112fa6c-45b9-4354-88dc-3b82f7220273 req-5eb49b93-5e95-48e7-8ee6-356a839ed779 service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Updating instance_info_cache with network_info: [{"id": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "address": "fa:16:3e:eb:5b:20", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae398b95-58", "ovs_interfaceid": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:40:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-e112fa6c-45b9-4354-88dc-3b82f7220273 req-5eb49b93-5e95-48e7-8ee6-356a839ed779 service nova] Releasing lock "refresh_cache-511ffce0-2c7a-478c-bc7f-9e20322dca94" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:40:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "511ffce0-2c7a-478c-bc7f-9e20322dca94" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "511ffce0-2c7a-478c-bc7f-9e20322dca94" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG nova.objects.instance [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lazy-loading 'flavor' on Instance uuid 511ffce0-2c7a-478c-bc7f-9e20322dca94 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "511ffce0-2c7a-478c-bc7f-9e20322dca94" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "511ffce0-2c7a-478c-bc7f-9e20322dca94" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "511ffce0-2c7a-478c-bc7f-9e20322dca94" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:40:20 user nova-compute[73188]: INFO nova.compute.manager [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Attaching volume a83c61e7-a598-4565-a6e9-382468a5aa3d to /dev/vdb
Aug 15 19:40:20 user nova-compute[73188]: DEBUG os_brick.utils [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6461dc-2f6e-40f8-a9cf-6a446b9d0479]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea0bbcd-dafb-4024-81a2-73193ca2f285]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[20062d27-e6e1-44f8-8b9e-68eb2c4f3949]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7a854d-9257-4192-a238-63ac4600282c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:40:20 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:40:20 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25e512b-3439-4ef1-ae76-33c2bf659139]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG os_brick.utils [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:40:20 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Updating existing volume attachment record: 435e0798-2b8d-4753-b83e-ca67fa599204 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:40:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JbqSCwtN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:40:29 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:40:29 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:40:29 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a177e332-5734-452e-8a84-99f882c325e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:40:29 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[616559f3-5bcc-4803-988a-1b7bd3b9294b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d] added
Aug 15 19:40:29 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce941a1c-30db-4626-a4a6-050747d194e4]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6bab0e-b44c-47ee-a51d-6b6658611764]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JbqSCwtN {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JbqSCwtN" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f6593a-3c1f-4f54-9686-7e1ab0bca020]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JbqSCwtN'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e085a58-5676-423e-ba28-0ff41fd711ff]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18adfb5-300e-4ded-a7aa-0f019df7dd8e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 19:40:29 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 19:40:29 user nova-compute[73188]:  {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:40:29 user nova-compute[73188]: WARNING os_brick.initiator.connectors.iscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 19:40:29 user nova-compute[73188]: 
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b548dc-6542-464c-a725-d558b533c191]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d, portal: 172.16.0.220,3260]
Aug 15 19:40:29 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d, portal: 172.16.0.220,3260] successful.
Aug 15 19:40:29 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[42499952-3a08-4736-b2e7-7effbe518d58]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8b6ad0-7048-4693-a183-b5d6ae2c8151]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d (non-flash)
Aug 15 19:40:29 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d (non-flash)
Aug 15 19:40:29 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2898de-0771-4ed6-818e-7a095caa309d]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:40:29 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JbqSCwtN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:40:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:40:30 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26436326439386537', 'path': '/dev/sdb'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:40:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436326439386537', 'path': '/dev/sdb'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:40:30 user nova-compute[73188]: DEBUG nova.objects.instance [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lazy-loading 'flavor' on Instance uuid 511ffce0-2c7a-478c-bc7f-9e20322dca94 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:40:30 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:40:30 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:40:30 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:40:30 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:40:30 user nova-compute[73188]:   <serial>a83c61e7-a598-4565-a6e9-382468a5aa3d</serial>
Aug 15 19:40:30 user nova-compute[73188]: </disk>
Aug 15 19:40:30 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:40:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:40:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:40:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] No VIF found with MAC fa:16:3e:eb:5b:20, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:40:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-55c891d1-fe85-486c-84a0-806388ae1d4c tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "511ffce0-2c7a-478c-bc7f-9e20322dca94" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.491s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:40:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "511ffce0-2c7a-478c-bc7f-9e20322dca94" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:40:31 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "511ffce0-2c7a-478c-bc7f-9e20322dca94" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:40:31 user nova-compute[73188]: INFO nova.compute.manager [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Detaching volume a83c61e7-a598-4565-a6e9-382468a5aa3d
Aug 15 19:40:31 user nova-compute[73188]: INFO nova.virt.block_device [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Attempting to driver detach volume a83c61e7-a598-4565-a6e9-382468a5aa3d from mountpoint /dev/vdb
Aug 15 19:40:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Attempting to detach device vdb from instance 511ffce0-2c7a-478c-bc7f-9e20322dca94 from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:40:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:40:31 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:40:31 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:40:31 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:40:31 user nova-compute[73188]:   <serial>a83c61e7-a598-4565-a6e9-382468a5aa3d</serial>
Aug 15 19:40:31 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:40:31 user nova-compute[73188]: </disk>
Aug 15 19:40:31 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:40:31 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Successfully detached device vdb from instance 511ffce0-2c7a-478c-bc7f-9e20322dca94 from the persistent domain config.
Aug 15 19:40:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 511ffce0-2c7a-478c-bc7f-9e20322dca94 from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:40:31 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:40:31 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:40:31 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:40:31 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:40:31 user nova-compute[73188]:   <serial>a83c61e7-a598-4565-a6e9-382468a5aa3d</serial>
Aug 15 19:40:31 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:40:31 user nova-compute[73188]: </disk>
Aug 15 19:40:31 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692128432.4050007, 511ffce0-2c7a-478c-bc7f-9e20322dca94 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 511ffce0-2c7a-478c-bc7f-9e20322dca94 {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:40:32 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Successfully detached device vdb from instance 511ffce0-2c7a-478c-bc7f-9e20322dca94 from the live domain config.
Aug 15 19:40:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JbqSCwtN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:40:32 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:40:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba0f15e-619c-48d1-b0b4-1d467dcfd649]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4aab39b-d637-405a-b369-245d0660d279]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d (non-flash)
Aug 15 19:40:32 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d (non-flash)
Aug 15 19:40:32 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f280832b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d'): ({'sdb'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Removing single pathed devices sdb {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acc2012-c508-4996-9ea8-2a4e5cd6cc27]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f10daff-ffb0-49ba-8cf6-c57e7619853b]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Flushing IO for device /dev/sdb {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edb5818-14bc-4f38-bc38-512233720713]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef05ec5-227e-498a-b205-8f7c13aa6328]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adae5e6-6ade-4805-8810-3803c4abb615]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0e5abe-6a31-4032-93b9-c742dbb11030]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d, portal: 172.16.0.220,3260]
Aug 15 19:40:32 user nova-compute[73188]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d, portal: 172.16.0.220,3260] successful.
Aug 15 19:40:32 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a83c61e7-a598-4565-a6e9-382468a5aa3d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[99113900-1225-4cc2-b742-603cb62f46ef]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] <== disconnect_volume: return (269ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:40:32 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:40:33 user nova-compute[73188]: DEBUG nova.objects.instance [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lazy-loading 'flavor' on Instance uuid 511ffce0-2c7a-478c-bc7f-9e20322dca94 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:40:33 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-d4cb0ba3-9536-4880-a579-d5ae413838b8 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "511ffce0-2c7a-478c-bc7f-9e20322dca94" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.561s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:40:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:35 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:40:36 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:40:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:39 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:40:39 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:40:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:40:41 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:40:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:40:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:40:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:40:41 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:40:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:40:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:40:42 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:40:42 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:40:42 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8521MB free_disk=25.146244049072266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:40:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:40:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:40:42 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 511ffce0-2c7a-478c-bc7f-9e20322dca94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:40:42 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:40:42 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:40:42 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:40:42 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:40:42 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:40:43 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:40:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:40:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:40:44 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:40:44 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:40:44 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:40:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-511ffce0-2c7a-478c-bc7f-9e20322dca94" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:40:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-511ffce0-2c7a-478c-bc7f-9e20322dca94" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:40:44 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:40:44 user nova-compute[73188]: DEBUG nova.objects.instance [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lazy-loading 'info_cache' on Instance uuid 511ffce0-2c7a-478c-bc7f-9e20322dca94 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:40:44 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Updating instance_info_cache with network_info: [{"id": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "address": "fa:16:3e:eb:5b:20", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae398b95-58", "ovs_interfaceid": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:40:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-511ffce0-2c7a-478c-bc7f-9e20322dca94" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:40:44 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:40:44 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:40:46 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:40:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:48 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:40:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:40:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:40:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:40:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:40:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:40:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:41:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:41:05 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:41:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:41:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:41:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:41:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:41:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:41:05 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:41:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Verify base images {{(pid=73188) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 15 19:41:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Image id f00e830a-b2ca-4a70-976f-0b43c7345f1b yields fingerprint 33a5035d1373d9b35d1a38b38ed90ff033edc49f {{(pid=73188) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 15 19:41:05 user nova-compute[73188]: INFO nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] image f00e830a-b2ca-4a70-976f-0b43c7345f1b at (/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f): checking
Aug 15 19:41:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] image f00e830a-b2ca-4a70-976f-0b43c7345f1b at (/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f): image is in use {{(pid=73188) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 15 19:41:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73188) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 15 19:41:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] 511ffce0-2c7a-478c-bc7f-9e20322dca94 is a valid instance name {{(pid=73188) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 15 19:41:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] 511ffce0-2c7a-478c-bc7f-9e20322dca94 has a disk file {{(pid=73188) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 15 19:41:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:41:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:41:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 511ffce0-2c7a-478c-bc7f-9e20322dca94 is backed by 33a5035d1373d9b35d1a38b38ed90ff033edc49f {{(pid=73188) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 15 19:41:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb is a valid instance name {{(pid=73188) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 15 19:41:05 user nova-compute[73188]: DEBUG nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb has a disk file {{(pid=73188) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 15 19:41:05 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:41:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:41:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb is backed by 33a5035d1373d9b35d1a38b38ed90ff033edc49f {{(pid=73188) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 15 19:41:06 user nova-compute[73188]: WARNING nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/400749c548c376c896e4f18d4379aea5f726d5ca
Aug 15 19:41:06 user nova-compute[73188]: WARNING nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/3362f0b0687e609ff915b47a67a76c6a2c333581
Aug 15 19:41:06 user nova-compute[73188]: WARNING nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/b4ad1892a653f1e505cc271f42376fe4f4db3fdf
Aug 15 19:41:06 user nova-compute[73188]: WARNING nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/30124c79b513114e1ceb54d1623640b83c4fb6eb
Aug 15 19:41:06 user nova-compute[73188]: WARNING nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/eb94ba01989f4cf27d87de7eb460222cff939dad
Aug 15 19:41:06 user nova-compute[73188]: WARNING nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84
Aug 15 19:41:06 user nova-compute[73188]: WARNING nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/fb4d2dfa8ae5a6d58488705f5f5605aa11359ed6
Aug 15 19:41:06 user nova-compute[73188]: WARNING nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/93ca97421fd098913012c3c919b10b322a7860f5
Aug 15 19:41:06 user nova-compute[73188]: WARNING nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/a90f38dd850e9266964344af8413670f672fe9db
Aug 15 19:41:06 user nova-compute[73188]: INFO nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Active base files: /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f
Aug 15 19:41:06 user nova-compute[73188]: INFO nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Removable base files: /opt/stack/data/nova/instances/_base/400749c548c376c896e4f18d4379aea5f726d5ca /opt/stack/data/nova/instances/_base/3362f0b0687e609ff915b47a67a76c6a2c333581 /opt/stack/data/nova/instances/_base/b4ad1892a653f1e505cc271f42376fe4f4db3fdf /opt/stack/data/nova/instances/_base/30124c79b513114e1ceb54d1623640b83c4fb6eb /opt/stack/data/nova/instances/_base/eb94ba01989f4cf27d87de7eb460222cff939dad /opt/stack/data/nova/instances/_base/bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84 /opt/stack/data/nova/instances/_base/fb4d2dfa8ae5a6d58488705f5f5605aa11359ed6 /opt/stack/data/nova/instances/_base/93ca97421fd098913012c3c919b10b322a7860f5 /opt/stack/data/nova/instances/_base/a90f38dd850e9266964344af8413670f672fe9db
Aug 15 19:41:06 user nova-compute[73188]: INFO nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/400749c548c376c896e4f18d4379aea5f726d5ca
Aug 15 19:41:06 user nova-compute[73188]: INFO nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3362f0b0687e609ff915b47a67a76c6a2c333581
Aug 15 19:41:06 user nova-compute[73188]: INFO nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b4ad1892a653f1e505cc271f42376fe4f4db3fdf
Aug 15 19:41:06 user nova-compute[73188]: INFO nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/30124c79b513114e1ceb54d1623640b83c4fb6eb
Aug 15 19:41:06 user nova-compute[73188]: INFO nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/eb94ba01989f4cf27d87de7eb460222cff939dad
Aug 15 19:41:06 user nova-compute[73188]: INFO nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bf0c83f29b7da3bae82a3c2fe3915631c4ad5a84
Aug 15 19:41:06 user nova-compute[73188]: INFO nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fb4d2dfa8ae5a6d58488705f5f5605aa11359ed6
Aug 15 19:41:06 user nova-compute[73188]: INFO nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/93ca97421fd098913012c3c919b10b322a7860f5
Aug 15 19:41:06 user nova-compute[73188]: INFO nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a90f38dd850e9266964344af8413670f672fe9db
Aug 15 19:41:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Verification complete {{(pid=73188) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 15 19:41:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Verify swap images {{(pid=73188) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 15 19:41:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.imagecache [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Verify ephemeral images {{(pid=73188) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 15 19:41:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:41:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:41:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:41:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "511ffce0-2c7a-478c-bc7f-9e20322dca94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:41:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "511ffce0-2c7a-478c-bc7f-9e20322dca94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:41:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "511ffce0-2c7a-478c-bc7f-9e20322dca94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:41:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "511ffce0-2c7a-478c-bc7f-9e20322dca94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:41:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "511ffce0-2c7a-478c-bc7f-9e20322dca94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:41:22 user nova-compute[73188]: INFO nova.compute.manager [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Terminating instance
Aug 15 19:41:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:41:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:41:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:41:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:41:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:41:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-697a09ec-9ddf-43c4-a0d8-4bd5dfd14b80 req-8f66f699-6ea6-4070-852a-0b33fd81343a service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Received event network-vif-unplugged-ae398b95-5857-4069-8fa5-c3b3e890fea3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:41:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-697a09ec-9ddf-43c4-a0d8-4bd5dfd14b80 req-8f66f699-6ea6-4070-852a-0b33fd81343a service nova] Acquiring lock "511ffce0-2c7a-478c-bc7f-9e20322dca94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:41:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-697a09ec-9ddf-43c4-a0d8-4bd5dfd14b80 req-8f66f699-6ea6-4070-852a-0b33fd81343a service nova] Lock "511ffce0-2c7a-478c-bc7f-9e20322dca94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:41:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-697a09ec-9ddf-43c4-a0d8-4bd5dfd14b80 req-8f66f699-6ea6-4070-852a-0b33fd81343a service nova] Lock "511ffce0-2c7a-478c-bc7f-9e20322dca94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:41:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-697a09ec-9ddf-43c4-a0d8-4bd5dfd14b80 req-8f66f699-6ea6-4070-852a-0b33fd81343a service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] No waiting events found dispatching network-vif-unplugged-ae398b95-5857-4069-8fa5-c3b3e890fea3 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:41:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-697a09ec-9ddf-43c4-a0d8-4bd5dfd14b80 req-8f66f699-6ea6-4070-852a-0b33fd81343a service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Received event network-vif-unplugged-ae398b95-5857-4069-8fa5-c3b3e890fea3 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:41:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:41:22 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Instance destroyed successfully.
Aug 15 19:41:22 user nova-compute[73188]: DEBUG nova.objects.instance [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lazy-loading 'resources' on Instance uuid 511ffce0-2c7a-478c-bc7f-9e20322dca94 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:41:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-933430195',display_name='tempest-AttachVolumeNegativeTest-server-933430195',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-933430195',id=49,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJgETPW43fcpJiiS74xOE6dd0DKF7xJHoXrgsnOi2i/eLhyFb5NTzXPqbroEffXedojxkx0rqBradtB6bZGks8P7bA9N2Y6P3FMaGfC6QRowFeYW0M7i6Gzf42EUmsCvA==',key_name='tempest-keypair-742756043',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:38:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5bc7d940cd1410a878ac89e24a4c4bc',ramdisk_id='',reservation_id='r-tiqv6s7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1373631227',owner_user_name='tempest-AttachVolumeNegativeTest-1373631227-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e526de0e03140bea2d410f535f75bb7',uuid=511ffce0-2c7a-478c-bc7f-9e20322dca94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "address": "fa:16:3e:eb:5b:20", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae398b95-58", "ovs_interfaceid": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:41:23 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converting VIF {"id": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "address": "fa:16:3e:eb:5b:20", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae398b95-58", "ovs_interfaceid": "ae398b95-5857-4069-8fa5-c3b3e890fea3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:41:23 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:5b:20,bridge_name='br-int',has_traffic_filtering=True,id=ae398b95-5857-4069-8fa5-c3b3e890fea3,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae398b95-58') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:41:23 user nova-compute[73188]: DEBUG os_vif [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:5b:20,bridge_name='br-int',has_traffic_filtering=True,id=ae398b95-5857-4069-8fa5-c3b3e890fea3,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae398b95-58') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:41:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:41:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae398b95-58, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:41:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:41:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:41:23 user nova-compute[73188]: INFO os_vif [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:5b:20,bridge_name='br-int',has_traffic_filtering=True,id=ae398b95-5857-4069-8fa5-c3b3e890fea3,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae398b95-58')
Aug 15 19:41:23 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Deleting instance files /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94_del
Aug 15 19:41:23 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Deletion of /opt/stack/data/nova/instances/511ffce0-2c7a-478c-bc7f-9e20322dca94_del complete
Aug 15 19:41:23 user nova-compute[73188]: INFO nova.compute.manager [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 15 19:41:23 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:41:23 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:41:23 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:41:24 user nova-compute[73188]: DEBUG nova.compute.manager [req-7765cd5b-2e51-4c4d-8e91-50f7a94f27fa req-25ec79e8-ad2b-445c-9da9-dd0c507175ea service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Received event network-vif-plugged-ae398b95-5857-4069-8fa5-c3b3e890fea3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:41:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7765cd5b-2e51-4c4d-8e91-50f7a94f27fa req-25ec79e8-ad2b-445c-9da9-dd0c507175ea service nova] Acquiring lock "511ffce0-2c7a-478c-bc7f-9e20322dca94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:41:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7765cd5b-2e51-4c4d-8e91-50f7a94f27fa req-25ec79e8-ad2b-445c-9da9-dd0c507175ea service nova] Lock "511ffce0-2c7a-478c-bc7f-9e20322dca94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:41:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7765cd5b-2e51-4c4d-8e91-50f7a94f27fa req-25ec79e8-ad2b-445c-9da9-dd0c507175ea service nova] Lock "511ffce0-2c7a-478c-bc7f-9e20322dca94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:41:24 user nova-compute[73188]: DEBUG nova.compute.manager [req-7765cd5b-2e51-4c4d-8e91-50f7a94f27fa req-25ec79e8-ad2b-445c-9da9-dd0c507175ea service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] No waiting events found dispatching network-vif-plugged-ae398b95-5857-4069-8fa5-c3b3e890fea3 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:41:24 user nova-compute[73188]: WARNING nova.compute.manager [req-7765cd5b-2e51-4c4d-8e91-50f7a94f27fa req-25ec79e8-ad2b-445c-9da9-dd0c507175ea service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Received unexpected event network-vif-plugged-ae398b95-5857-4069-8fa5-c3b3e890fea3 for instance with vm_state active and task_state deleting.
Aug 15 19:41:24 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:41:24 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Took 1.61 seconds to deallocate network for instance.
Aug 15 19:41:24 user nova-compute[73188]: DEBUG nova.compute.manager [req-103e4910-3be7-4f9b-8ace-55a5be651fdb req-8b9c599f-da96-4ade-a9e8-62a33e8d56f2 service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Received event network-vif-deleted-ae398b95-5857-4069-8fa5-c3b3e890fea3 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:41:24 user nova-compute[73188]: INFO nova.compute.manager [req-103e4910-3be7-4f9b-8ace-55a5be651fdb req-8b9c599f-da96-4ade-a9e8-62a33e8d56f2 service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Neutron deleted interface ae398b95-5857-4069-8fa5-c3b3e890fea3; detaching it from the instance and deleting it from the info cache
Aug 15 19:41:24 user nova-compute[73188]: DEBUG nova.network.neutron [req-103e4910-3be7-4f9b-8ace-55a5be651fdb req-8b9c599f-da96-4ade-a9e8-62a33e8d56f2 service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:41:24 user nova-compute[73188]: DEBUG nova.compute.manager [req-103e4910-3be7-4f9b-8ace-55a5be651fdb req-8b9c599f-da96-4ade-a9e8-62a33e8d56f2 service nova] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Detach interface failed, port_id=ae398b95-5857-4069-8fa5-c3b3e890fea3, reason: Instance 511ffce0-2c7a-478c-bc7f-9e20322dca94 could not be found. {{(pid=73188) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 19:41:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:41:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:41:24 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:41:24 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:41:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:41:24 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Deleted allocations for instance 511ffce0-2c7a-478c-bc7f-9e20322dca94
Aug 15 19:41:25 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-0f19a426-d4da-4cc1-895c-b1ed966d380a tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "511ffce0-2c7a-478c-bc7f-9e20322dca94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.806s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:41:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:41:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:41:35 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:41:35 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:41:37 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692128482.9780598, 511ffce0-2c7a-478c-bc7f-9e20322dca94 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:41:37 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] VM Stopped (Lifecycle Event)
Aug 15 19:41:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-24256b38-318e-434f-a350-1dacde8507b8 None None] [instance: 511ffce0-2c7a-478c-bc7f-9e20322dca94] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:41:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:41:38 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:41:39 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:41:40 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:41:40 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:41:41 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:41:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:41:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:41:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:41:41 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:41:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:41:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:41:41 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:41:42 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:41:42 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:41:42 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:41:42 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8635MB free_disk=25.172439575195312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:41:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:41:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:41:42 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:41:42 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:41:42 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:41:42 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing inventories for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 19:41:42 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Updating ProviderTree inventory for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 19:41:42 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Updating inventory in ProviderTree for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 19:41:42 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing aggregate associations for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5, aggregates: None {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 19:41:42 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing trait associations for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 19:41:42 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:41:42 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:41:42 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:41:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:41:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:41:44 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:41:44 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:41:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:41:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:41:45 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:41:45 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Updating instance_info_cache with network_info: [{"id": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "address": "fa:16:3e:b8:89:9f", "network": {"id": "7502a12f-0713-4580-a7f2-8cfd4d75c1d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-988103788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "359d1159e0894d9fb21e8e8afdc397b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8e5d9-a6", "ovs_interfaceid": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:41:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:41:45 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:41:45 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:41:46 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:41:46 user nova-compute[73188]: DEBUG nova.compute.manager [req-88a1d887-ce5d-4a8b-b0a1-ccb00e28cf08 req-b0dbc9f6-2403-4362-ba68-57ae351975d5 service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Received event network-changed-69b8e5d9-a600-492a-bc81-0e04d22871fb {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:41:46 user nova-compute[73188]: DEBUG nova.compute.manager [req-88a1d887-ce5d-4a8b-b0a1-ccb00e28cf08 req-b0dbc9f6-2403-4362-ba68-57ae351975d5 service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Refreshing instance network info cache due to event network-changed-69b8e5d9-a600-492a-bc81-0e04d22871fb. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:41:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-88a1d887-ce5d-4a8b-b0a1-ccb00e28cf08 req-b0dbc9f6-2403-4362-ba68-57ae351975d5 service nova] Acquiring lock "refresh_cache-6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:41:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-88a1d887-ce5d-4a8b-b0a1-ccb00e28cf08 req-b0dbc9f6-2403-4362-ba68-57ae351975d5 service nova] Acquired lock "refresh_cache-6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:41:46 user nova-compute[73188]: DEBUG nova.network.neutron [req-88a1d887-ce5d-4a8b-b0a1-ccb00e28cf08 req-b0dbc9f6-2403-4362-ba68-57ae351975d5 service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Refreshing network info cache for port 69b8e5d9-a600-492a-bc81-0e04d22871fb {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:41:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:41:47 user nova-compute[73188]: DEBUG nova.network.neutron [req-88a1d887-ce5d-4a8b-b0a1-ccb00e28cf08 req-b0dbc9f6-2403-4362-ba68-57ae351975d5 service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Updated VIF entry in instance network info cache for port 69b8e5d9-a600-492a-bc81-0e04d22871fb. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:41:47 user nova-compute[73188]: DEBUG nova.network.neutron [req-88a1d887-ce5d-4a8b-b0a1-ccb00e28cf08 req-b0dbc9f6-2403-4362-ba68-57ae351975d5 service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Updating instance_info_cache with network_info: [{"id": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "address": "fa:16:3e:b8:89:9f", "network": {"id": "7502a12f-0713-4580-a7f2-8cfd4d75c1d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-988103788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "359d1159e0894d9fb21e8e8afdc397b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8e5d9-a6", "ovs_interfaceid": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:41:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-88a1d887-ce5d-4a8b-b0a1-ccb00e28cf08 req-b0dbc9f6-2403-4362-ba68-57ae351975d5 service nova] Releasing lock "refresh_cache-6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:41:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:41:48 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG nova.objects.instance [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lazy-loading 'flavor' on Instance uuid 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:41:51 user nova-compute[73188]: INFO nova.compute.manager [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Attaching volume ff410315-3406-4422-9eee-7a50faa3183b to /dev/vdb
Aug 15 19:41:51 user nova-compute[73188]: DEBUG os_brick.utils [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c7c34c-1343-4b49-9c2b-3f89b099a43a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[44254243-ca8e-4fcf-8946-386d56d5a691]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bca9b5b-1722-4a31-9e60-a001b4ea1fb8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b131ad7-e10e-453b-9ab0-1a6a3f9a6f62]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:41:51 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:41:51 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e244fd0-c2ae-4d28-8ddf-ebc81a95671f]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG os_brick.utils [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:41:51 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Updating existing volume attachment record: 71b8312f-0dd2-4321-a4c5-bfce8eb3afd8 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:41:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:41:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:41:54 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:41:54 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:41:54 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=73188) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 19:41:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:41:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:41:58 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:41:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Cleaning up deleted instances {{(pid=73188) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 19:41:58 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] There are 0 instances to clean {{(pid=73188) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vBeiscRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:42:00 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:42:00 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:42:00 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4951bec9-6eec-4e03-8be0-99e6d4facb28]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:42:00 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2873eba-e2be-495e-93fc-b45f50dce8e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b] added
Aug 15 19:42:00 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cade27fd-c8f5-4d5d-aa4a-64de77671118]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2c0f7f-0faf-447c-acba-749ca7067929]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vBeiscRD {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vBeiscRD" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f832ed87-a732-4212-8dea-84b23ab87950]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vBeiscRD'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b191ae-7322-4a08-9f81-2220265a3b28]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5852d9-37b7-4260-8ba5-047cb53ac5f5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 19:42:00 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 19:42:00 user nova-compute[73188]:  {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:42:00 user nova-compute[73188]: WARNING os_brick.initiator.connectors.iscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 19:42:00 user nova-compute[73188]: 
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[780da68e-f126-4a75-8ead-0e6f4386f2fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b, portal: 172.16.0.220,3260]
Aug 15 19:42:00 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b, portal: 172.16.0.220,3260] successful.
Aug 15 19:42:00 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b9364f-3792-4b15-bf5a-33273382ee39]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed053045-896f-44db-95b3-626fa3fbafec]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b (non-flash)
Aug 15 19:42:00 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b (non-flash)
Aug 15 19:42:00 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3e2f9c-9f2c-471e-849b-b5d8a16fba33]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:42:00 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vBeiscRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:42:01 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:42:01 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23162333938373834', 'path': '/dev/sdb'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:42:01 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162333938373834', 'path': '/dev/sdb'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:42:01 user nova-compute[73188]: DEBUG nova.objects.instance [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lazy-loading 'flavor' on Instance uuid 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:42:01 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:42:01 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:42:01 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:42:01 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:42:01 user nova-compute[73188]:   <serial>ff410315-3406-4422-9eee-7a50faa3183b</serial>
Aug 15 19:42:01 user nova-compute[73188]: </disk>
Aug 15 19:42:01 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:42:01 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:42:01 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:42:01 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] No VIF found with MAC fa:16:3e:b8:89:9f, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:42:02 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c92f4f4d-8b7d-41fe-aa65-f545d9e0fb33 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.453s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:42:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:42:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:42:16 user nova-compute[73188]: DEBUG nova.compute.manager [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:42:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:42:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:42:16 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:42:16 user nova-compute[73188]: INFO nova.compute.claims [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Claim successful on node user
Aug 15 19:42:16 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:42:16 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:42:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:42:16 user nova-compute[73188]: DEBUG nova.compute.manager [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:42:16 user nova-compute[73188]: DEBUG nova.compute.manager [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:42:16 user nova-compute[73188]: DEBUG nova.network.neutron [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:42:16 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:42:16 user nova-compute[73188]: DEBUG nova.compute.manager [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:42:16 user nova-compute[73188]: DEBUG nova.policy [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e526de0e03140bea2d410f535f75bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5bc7d940cd1410a878ac89e24a4c4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:42:16 user nova-compute[73188]: DEBUG nova.compute.manager [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:42:16 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:42:16 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Creating image(s)
Aug 15 19:42:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "/opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:42:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "/opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:42:16 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "/opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:42:16 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.185s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:42:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:42:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.175s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/disk 1073741824" returned: 0 in 0.050s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:42:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.175s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:17 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:42:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:17 user nova-compute[73188]: DEBUG nova.network.neutron [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Successfully created port: d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:42:17 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:17 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Cannot resize image /opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:42:17 user nova-compute[73188]: DEBUG nova.objects.instance [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lazy-loading 'migration_context' on Instance uuid c29d22f8-552b-4f7f-b27a-1abae7daa5dc {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:42:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:42:17 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Ensure instance console log exists: /opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:42:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:42:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:42:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.network.neutron [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Successfully updated port: d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "refresh_cache-c29d22f8-552b-4f7f-b27a-1abae7daa5dc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquired lock "refresh_cache-c29d22f8-552b-4f7f-b27a-1abae7daa5dc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.network.neutron [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.compute.manager [req-cf935523-a726-4fbc-bb23-9046d5b9d490 req-15f4cd3d-7b9e-466c-8bdb-1508f95ddde1 service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Received event network-changed-d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.compute.manager [req-cf935523-a726-4fbc-bb23-9046d5b9d490 req-15f4cd3d-7b9e-466c-8bdb-1508f95ddde1 service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Refreshing instance network info cache due to event network-changed-d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cf935523-a726-4fbc-bb23-9046d5b9d490 req-15f4cd3d-7b9e-466c-8bdb-1508f95ddde1 service nova] Acquiring lock "refresh_cache-c29d22f8-552b-4f7f-b27a-1abae7daa5dc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.network.neutron [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.network.neutron [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Updating instance_info_cache with network_info: [{"id": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "address": "fa:16:3e:81:01:9b", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bdbcb2-3c", "ovs_interfaceid": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Releasing lock "refresh_cache-c29d22f8-552b-4f7f-b27a-1abae7daa5dc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.compute.manager [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Instance network_info: |[{"id": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "address": "fa:16:3e:81:01:9b", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bdbcb2-3c", "ovs_interfaceid": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cf935523-a726-4fbc-bb23-9046d5b9d490 req-15f4cd3d-7b9e-466c-8bdb-1508f95ddde1 service nova] Acquired lock "refresh_cache-c29d22f8-552b-4f7f-b27a-1abae7daa5dc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.network.neutron [req-cf935523-a726-4fbc-bb23-9046d5b9d490 req-15f4cd3d-7b9e-466c-8bdb-1508f95ddde1 service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Refreshing network info cache for port d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Start _get_guest_xml network_info=[{"id": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "address": "fa:16:3e:81:01:9b", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bdbcb2-3c", "ovs_interfaceid": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:42:18 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:42:18 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:42:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1411754341',display_name='tempest-AttachVolumeNegativeTest-server-1411754341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1411754341',id=51,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvSgQMf0C0AUv2jy7aofu+ChYH3XecdmeAiymXCvc1y9BPulug1kQfL5sSZubu8Gd4X8lB5WV3S6hgJtoQ40ryK6uEAn57BC4GpQoyASfTQlugTK31Lmotu9XA3L6GJ0Q==',key_name='tempest-keypair-1276756512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5bc7d940cd1410a878ac89e24a4c4bc',ramdisk_id='',reservation_id='r-heyjlwps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1373631227',owner_user_name='tempest-AttachVolumeNegativeTest-1373631227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e526de0e03140bea2d410f535f75bb7',uuid=c29d22f8-552b-4f7f-b27a-1abae7daa5dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "address": "fa:16:3e:81:01:9b", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bdbcb2-3c", "ovs_interfaceid": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converting VIF {"id": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "address": "fa:16:3e:81:01:9b", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bdbcb2-3c", "ovs_interfaceid": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:01:9b,bridge_name='br-int',has_traffic_filtering=True,id=d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5bdbcb2-3c') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.objects.instance [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lazy-loading 'pci_devices' on Instance uuid c29d22f8-552b-4f7f-b27a-1abae7daa5dc {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:42:18 user nova-compute[73188]:   <uuid>c29d22f8-552b-4f7f-b27a-1abae7daa5dc</uuid>
Aug 15 19:42:18 user nova-compute[73188]:   <name>instance-00000033</name>
Aug 15 19:42:18 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:42:18 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:42:18 user nova-compute[73188]:   <metadata>
Aug 15 19:42:18 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:42:18 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:42:18 user nova-compute[73188]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1411754341</nova:name>
Aug 15 19:42:18 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:42:18</nova:creationTime>
Aug 15 19:42:18 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:42:18 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:42:18 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:42:18 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:42:18 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:42:18 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:42:18 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:42:18 user nova-compute[73188]:       <nova:owner>
Aug 15 19:42:18 user nova-compute[73188]:         <nova:user uuid="0e526de0e03140bea2d410f535f75bb7">tempest-AttachVolumeNegativeTest-1373631227-project-member</nova:user>
Aug 15 19:42:18 user nova-compute[73188]:         <nova:project uuid="f5bc7d940cd1410a878ac89e24a4c4bc">tempest-AttachVolumeNegativeTest-1373631227</nova:project>
Aug 15 19:42:18 user nova-compute[73188]:       </nova:owner>
Aug 15 19:42:18 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:42:18 user nova-compute[73188]:       <nova:ports>
Aug 15 19:42:18 user nova-compute[73188]:         <nova:port uuid="d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0">
Aug 15 19:42:18 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 19:42:18 user nova-compute[73188]:         </nova:port>
Aug 15 19:42:18 user nova-compute[73188]:       </nova:ports>
Aug 15 19:42:18 user nova-compute[73188]:     </nova:instance>
Aug 15 19:42:18 user nova-compute[73188]:   </metadata>
Aug 15 19:42:18 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:42:18 user nova-compute[73188]:     <system>
Aug 15 19:42:18 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:42:18 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:42:18 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:42:18 user nova-compute[73188]:       <entry name="serial">c29d22f8-552b-4f7f-b27a-1abae7daa5dc</entry>
Aug 15 19:42:18 user nova-compute[73188]:       <entry name="uuid">c29d22f8-552b-4f7f-b27a-1abae7daa5dc</entry>
Aug 15 19:42:18 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:42:18 user nova-compute[73188]:     </system>
Aug 15 19:42:18 user nova-compute[73188]:   </sysinfo>
Aug 15 19:42:18 user nova-compute[73188]:   <os>
Aug 15 19:42:18 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:42:18 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:42:18 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:42:18 user nova-compute[73188]:   </os>
Aug 15 19:42:18 user nova-compute[73188]:   <features>
Aug 15 19:42:18 user nova-compute[73188]:     <acpi/>
Aug 15 19:42:18 user nova-compute[73188]:     <apic/>
Aug 15 19:42:18 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:42:18 user nova-compute[73188]:   </features>
Aug 15 19:42:18 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:42:18 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:42:18 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:42:18 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:42:18 user nova-compute[73188]:   </clock>
Aug 15 19:42:18 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:42:18 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:42:18 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:42:18 user nova-compute[73188]:   </cpu>
Aug 15 19:42:18 user nova-compute[73188]:   <devices>
Aug 15 19:42:18 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:42:18 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:42:18 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/disk"/>
Aug 15 19:42:18 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:42:18 user nova-compute[73188]:     </disk>
Aug 15 19:42:18 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:42:18 user nova-compute[73188]:       <mac address="fa:16:3e:81:01:9b"/>
Aug 15 19:42:18 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:42:18 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:42:18 user nova-compute[73188]:       <target dev="tapd5bdbcb2-3c"/>
Aug 15 19:42:18 user nova-compute[73188]:     </interface>
Aug 15 19:42:18 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:42:18 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/console.log" append="off"/>
Aug 15 19:42:18 user nova-compute[73188]:     </serial>
Aug 15 19:42:18 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:42:18 user nova-compute[73188]:     <video>
Aug 15 19:42:18 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:42:18 user nova-compute[73188]:     </video>
Aug 15 19:42:18 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:42:18 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:42:18 user nova-compute[73188]:     </rng>
Aug 15 19:42:18 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:42:18 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:42:18 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:42:18 user nova-compute[73188]:     </memballoon>
Aug 15 19:42:18 user nova-compute[73188]:   </devices>
Aug 15 19:42:18 user nova-compute[73188]: </domain>
Aug 15 19:42:18 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:42:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1411754341',display_name='tempest-AttachVolumeNegativeTest-server-1411754341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1411754341',id=51,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvSgQMf0C0AUv2jy7aofu+ChYH3XecdmeAiymXCvc1y9BPulug1kQfL5sSZubu8Gd4X8lB5WV3S6hgJtoQ40ryK6uEAn57BC4GpQoyASfTQlugTK31Lmotu9XA3L6GJ0Q==',key_name='tempest-keypair-1276756512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5bc7d940cd1410a878ac89e24a4c4bc',ramdisk_id='',reservation_id='r-heyjlwps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1373631227',owner_user_name='tempest-AttachVolumeNegativeTest-1373631227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e526de0e03140bea2d410f535f75bb7',uuid=c29d22f8-552b-4f7f-b27a-1abae7daa5dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "address": "fa:16:3e:81:01:9b", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bdbcb2-3c", "ovs_interfaceid": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converting VIF {"id": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "address": "fa:16:3e:81:01:9b", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bdbcb2-3c", "ovs_interfaceid": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:01:9b,bridge_name='br-int',has_traffic_filtering=True,id=d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5bdbcb2-3c') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG os_vif [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:01:9b,bridge_name='br-int',has_traffic_filtering=True,id=d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5bdbcb2-3c') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5bdbcb2-3c, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5bdbcb2-3c, col_values=(('external_ids', {'iface-id': 'd5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:01:9b', 'vm-uuid': 'c29d22f8-552b-4f7f-b27a-1abae7daa5dc'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:18 user nova-compute[73188]: INFO os_vif [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:01:9b,bridge_name='br-int',has_traffic_filtering=True,id=d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5bdbcb2-3c')
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:42:18 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] No VIF found with MAC fa:16:3e:81:01:9b, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:42:19 user nova-compute[73188]: DEBUG nova.network.neutron [req-cf935523-a726-4fbc-bb23-9046d5b9d490 req-15f4cd3d-7b9e-466c-8bdb-1508f95ddde1 service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Updated VIF entry in instance network info cache for port d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:42:19 user nova-compute[73188]: DEBUG nova.network.neutron [req-cf935523-a726-4fbc-bb23-9046d5b9d490 req-15f4cd3d-7b9e-466c-8bdb-1508f95ddde1 service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Updating instance_info_cache with network_info: [{"id": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "address": "fa:16:3e:81:01:9b", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bdbcb2-3c", "ovs_interfaceid": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:42:19 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-cf935523-a726-4fbc-bb23-9046d5b9d490 req-15f4cd3d-7b9e-466c-8bdb-1508f95ddde1 service nova] Releasing lock "refresh_cache-c29d22f8-552b-4f7f-b27a-1abae7daa5dc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:42:19 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:20 user nova-compute[73188]: DEBUG nova.compute.manager [req-c87a6a9a-808a-4ad0-8fc2-d810df9e2f52 req-2bc3b69e-fd71-4135-ad32-640ce542f4ea service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Received event network-vif-plugged-d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:42:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c87a6a9a-808a-4ad0-8fc2-d810df9e2f52 req-2bc3b69e-fd71-4135-ad32-640ce542f4ea service nova] Acquiring lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:42:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c87a6a9a-808a-4ad0-8fc2-d810df9e2f52 req-2bc3b69e-fd71-4135-ad32-640ce542f4ea service nova] Lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:42:20 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-c87a6a9a-808a-4ad0-8fc2-d810df9e2f52 req-2bc3b69e-fd71-4135-ad32-640ce542f4ea service nova] Lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:42:20 user nova-compute[73188]: DEBUG nova.compute.manager [req-c87a6a9a-808a-4ad0-8fc2-d810df9e2f52 req-2bc3b69e-fd71-4135-ad32-640ce542f4ea service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] No waiting events found dispatching network-vif-plugged-d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:42:20 user nova-compute[73188]: WARNING nova.compute.manager [req-c87a6a9a-808a-4ad0-8fc2-d810df9e2f52 req-2bc3b69e-fd71-4135-ad32-640ce542f4ea service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Received unexpected event network-vif-plugged-d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0 for instance with vm_state building and task_state spawning.
Aug 15 19:42:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:22 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692128542.3187606, c29d22f8-552b-4f7f-b27a-1abae7daa5dc => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:42:22 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] VM Resumed (Lifecycle Event)
Aug 15 19:42:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:42:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:42:22 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Instance spawned successfully.
Aug 15 19:42:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:42:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:42:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:42:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:42:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:42:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:42:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:42:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:42:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:42:22 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:42:22 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692128542.3220403, c29d22f8-552b-4f7f-b27a-1abae7daa5dc => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:42:22 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] VM Started (Lifecycle Event)
Aug 15 19:42:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:42:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:42:22 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:42:22 user nova-compute[73188]: INFO nova.compute.manager [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Took 5.56 seconds to spawn the instance on the hypervisor.
Aug 15 19:42:22 user nova-compute[73188]: DEBUG nova.compute.manager [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:42:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-b75a380e-86b7-4436-974a-f05b316c9ab9 req-3064f577-0808-49eb-ba04-b4f2430f4849 service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Received event network-vif-plugged-d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:42:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b75a380e-86b7-4436-974a-f05b316c9ab9 req-3064f577-0808-49eb-ba04-b4f2430f4849 service nova] Acquiring lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:42:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b75a380e-86b7-4436-974a-f05b316c9ab9 req-3064f577-0808-49eb-ba04-b4f2430f4849 service nova] Lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:42:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-b75a380e-86b7-4436-974a-f05b316c9ab9 req-3064f577-0808-49eb-ba04-b4f2430f4849 service nova] Lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:42:22 user nova-compute[73188]: DEBUG nova.compute.manager [req-b75a380e-86b7-4436-974a-f05b316c9ab9 req-3064f577-0808-49eb-ba04-b4f2430f4849 service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] No waiting events found dispatching network-vif-plugged-d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:42:22 user nova-compute[73188]: WARNING nova.compute.manager [req-b75a380e-86b7-4436-974a-f05b316c9ab9 req-3064f577-0808-49eb-ba04-b4f2430f4849 service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Received unexpected event network-vif-plugged-d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0 for instance with vm_state building and task_state spawning.
Aug 15 19:42:22 user nova-compute[73188]: INFO nova.compute.manager [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Took 6.11 seconds to build instance.
Aug 15 19:42:22 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fd99ec2e-b321-468a-bc9b-4858682ceb53 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.201s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:42:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:23 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_power_states {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:42:23 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:42:23 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Triggering sync for uuid c29d22f8-552b-4f7f-b27a-1abae7daa5dc {{(pid=73188) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 19:42:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:42:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:42:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:42:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:42:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:42:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:42:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:42:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:37 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:42:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:39 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:42:40 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:42:41 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:42:41 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:42:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:42:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:42:42 user nova-compute[73188]: INFO nova.compute.manager [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Detaching volume ff410315-3406-4422-9eee-7a50faa3183b
Aug 15 19:42:42 user nova-compute[73188]: INFO nova.virt.block_device [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Attempting to driver detach volume ff410315-3406-4422-9eee-7a50faa3183b from mountpoint /dev/vdb
Aug 15 19:42:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Attempting to detach device vdb from instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:42:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:42:42 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:42:42 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:42:42 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:42:42 user nova-compute[73188]:   <serial>ff410315-3406-4422-9eee-7a50faa3183b</serial>
Aug 15 19:42:42 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:42:42 user nova-compute[73188]: </disk>
Aug 15 19:42:42 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:42:42 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Successfully detached device vdb from instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb from the persistent domain config.
Aug 15 19:42:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:42:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:42:42 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:42:42 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:42:42 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:42:42 user nova-compute[73188]:   <serial>ff410315-3406-4422-9eee-7a50faa3183b</serial>
Aug 15 19:42:42 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:42:42 user nova-compute[73188]: </disk>
Aug 15 19:42:42 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692128563.2063487, 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:42:43 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Successfully detached device vdb from instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb from the live domain config.
Aug 15 19:42:43 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vBeiscRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:42:43 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:42:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b199c5c-0e27-4c99-96ea-bb06d483829f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d96979-4a33-4f90-bd28-063257f1b468]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b (non-flash)
Aug 15 19:42:43 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b (non-flash)
Aug 15 19:42:43 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2808188d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b'): ({'sdb'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Removing single pathed devices sdb {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[26793901-e131-40e0-a5cd-7f02e5db347d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17dcd3d-969c-4a3d-b565-b031d5de112e]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Flushing IO for device /dev/sdb {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5b5c96-cf5e-424b-8e9a-bce4197767bf]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b313375-1eae-497d-b54e-42f458b4ddbf]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[db636b7a-d8aa-45c2-a6db-3cc3f70e57ab]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[219945ec-aa21-4d43-aa9b-2f1996e2691d]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b, portal: 172.16.0.220,3260]
Aug 15 19:42:43 user nova-compute[73188]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b, portal: 172.16.0.220,3260] successful.
Aug 15 19:42:43 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff410315-3406-4422-9eee-7a50faa3183b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9810cc-a486-4606-b005-d807c84e492c]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] <== disconnect_volume: return (282ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG nova.objects.instance [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lazy-loading 'info_cache' on Instance uuid 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:42:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:44 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Updating instance_info_cache with network_info: [{"id": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "address": "fa:16:3e:b8:89:9f", "network": {"id": "7502a12f-0713-4580-a7f2-8cfd4d75c1d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-988103788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "359d1159e0894d9fb21e8e8afdc397b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8e5d9-a6", "ovs_interfaceid": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:42:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:42:44 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:42:44 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:42:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:42:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:42:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:42:44 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:42:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:44 user nova-compute[73188]: DEBUG nova.objects.instance [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lazy-loading 'flavor' on Instance uuid 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:42:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-56285fd7-7645-426a-8d8c-e25c4dc5a129 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.687s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:42:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:42:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:42:45 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:42:45 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:42:45 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8508MB free_disk=25.133460998535156GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:42:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:42:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:42:45 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:42:45 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance c29d22f8-552b-4f7f-b27a-1abae7daa5dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:42:45 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:42:45 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:42:45 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:42:45 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:42:45 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:42:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:42:46 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:42:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:47 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:42:48 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:42:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:42:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:42:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:42:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:42:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:42:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:43:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:43:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:43:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:43:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:43:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:43:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:43:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:43:09 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:43:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:43:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:43:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:43:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:43:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG nova.objects.instance [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lazy-loading 'flavor' on Instance uuid 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:43:37 user nova-compute[73188]: INFO nova.compute.manager [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Attaching volume a3f3677d-c6f2-4152-865d-db6399c6e0d9 to /dev/vdb
Aug 15 19:43:37 user nova-compute[73188]: DEBUG os_brick.utils [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8f21f0-c40b-4fde-8494-608fa36c181a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[803f125d-48c7-484b-b992-499ac8a419d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f44547-5766-4422-85d7-51f6ed82f043]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2341cdba-09f5-466d-ad17-baa1eb2e6ec5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:43:37 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:43:37 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a3149d-ddbc-4d78-9ca2-fac9b62fe684]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG os_brick.utils [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:43:37 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Updating existing volume attachment record: 68ab6155-1794-4a9a-9e6b-ad95ad5e013e {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:43:38 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:43:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:43:39 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:43:42 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:43:43 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:43:43 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:43:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:43:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:43:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:43:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:43:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:43:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:43:44 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:43:45 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:43:45 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:43:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-c29d22f8-552b-4f7f-b27a-1abae7daa5dc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:43:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-c29d22f8-552b-4f7f-b27a-1abae7daa5dc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:43:45 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyFEqxYa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:43:46 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:43:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:43:46 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:43:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:43:46 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb9737f-9050-4e3b-bf60-24be587c99f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:43:46 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f9fb57-ebb6-47eb-97be-13f1c7fd0e51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9] added
Aug 15 19:43:46 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd714452-81eb-4201-b253-262bf0700a23]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf9d658-fab7-4f40-b25f-31d5fcffe2ce]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PyFEqxYa {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PyFEqxYa" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66bdb18-856e-47f9-b542-20a6cefdf4a6]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PyFEqxYa'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0902c79-9d5b-4f7e-a5d5-abd3b13c37ed]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c079b90-f24e-4af5-8a99-2a86cf2972e9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 19:43:46 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 19:43:46 user nova-compute[73188]:  {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:43:46 user nova-compute[73188]: WARNING os_brick.initiator.connectors.iscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 19:43:46 user nova-compute[73188]: 
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9d08a5-3ca7-4f2a-9a0f-6a40614cde42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9, portal: 172.16.0.220,3260]
Aug 15 19:43:46 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9, portal: 172.16.0.220,3260] successful.
Aug 15 19:43:46 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[18111400-4a99-4d5e-8233-fd7503a7eeaf]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e49c368-d56b-496e-bcc8-eeb9e0852cb3]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 (non-flash)
Aug 15 19:43:46 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 (non-flash)
Aug 15 19:43:46 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7701876e-4aa5-4296-a9ec-3ee3ace8e2ed]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Updating instance_info_cache with network_info: [{"id": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "address": "fa:16:3e:81:01:9b", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bdbcb2-3c", "ovs_interfaceid": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-c29d22f8-552b-4f7f-b27a-1abae7daa5dc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:43:46 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:43:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:47 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:43:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyFEqxYa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:43:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:43:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23637613531613035', 'path': '/dev/sdb'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:43:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637613531613035', 'path': '/dev/sdb'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:43:47 user nova-compute[73188]: DEBUG nova.objects.instance [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lazy-loading 'flavor' on Instance uuid 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:43:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:43:47 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:43:47 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:43:47 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:43:47 user nova-compute[73188]:   <serial>a3f3677d-c6f2-4152-865d-db6399c6e0d9</serial>
Aug 15 19:43:47 user nova-compute[73188]: </disk>
Aug 15 19:43:47 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:43:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:48 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:43:48 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:43:48 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8539MB free_disk=25.130802154541016GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:43:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:43:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:43:48 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:43:48 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:43:48 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] No VIF found with MAC fa:16:3e:b8:89:9f, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:43:48 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:43:48 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance c29d22f8-552b-4f7f-b27a-1abae7daa5dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:43:48 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:43:48 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:43:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-60e4d3f4-23d2-43bf-8561-46e114e51ada tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.895s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:43:48 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:43:48 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:43:48 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:43:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:43:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:43:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:43:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:43:50 user nova-compute[73188]: INFO nova.compute.manager [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Detaching volume a3f3677d-c6f2-4152-865d-db6399c6e0d9
Aug 15 19:43:50 user nova-compute[73188]: INFO nova.virt.block_device [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Attempting to driver detach volume a3f3677d-c6f2-4152-865d-db6399c6e0d9 from mountpoint /dev/vdb
Aug 15 19:43:50 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Attempting to detach device vdb from instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:43:50 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:43:50 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:43:50 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:43:50 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:43:50 user nova-compute[73188]:   <serial>a3f3677d-c6f2-4152-865d-db6399c6e0d9</serial>
Aug 15 19:43:50 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:43:50 user nova-compute[73188]: </disk>
Aug 15 19:43:50 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:43:51 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Successfully detached device vdb from instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb from the persistent domain config.
Aug 15 19:43:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:43:51 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:43:51 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:43:51 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:43:51 user nova-compute[73188]:   <serial>a3f3677d-c6f2-4152-865d-db6399c6e0d9</serial>
Aug 15 19:43:51 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:43:51 user nova-compute[73188]: </disk>
Aug 15 19:43:51 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692128631.4632807, 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:43:51 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Successfully detached device vdb from instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb from the live domain config.
Aug 15 19:43:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyFEqxYa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:43:51 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:43:51 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd09675-0ccc-406c-9448-37ceb6f4c6ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:742054bf-7ec6-4b8e-b516-8a38517f3bb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd17367f-94e0-4073-960c-97e45710bb33]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:742054bf-7ec6-4b8e-b516-8a38517f3bb6 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 (non-flash)
Aug 15 19:43:51 user nova-compute[73188]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:742054bf-7ec6-4b8e-b516-8a38517f3bb6 (non-flash)
Aug 15 19:43:51 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 (non-flash)
Aug 15 19:43:51 user nova-compute[73188]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:742054bf-7ec6-4b8e-b516-8a38517f3bb6 (non-flash)
Aug 15 19:43:51 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28101e8820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9'): ({'sdb'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Removing single pathed devices sdb {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[70660fc2-09f8-4d7b-9a03-b617a8be4138]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7753743c-07a9-4e04-a322-4272fd741c82]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Flushing IO for device /dev/sdb {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[036af8c6-667c-418c-8c37-b376ff63c9ea]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[813e31ae-90dd-4e52-8137-1cc0ebbeb297]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a04a172-89d8-4187-9ac2-56ba30fb9e78]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b4b4f9-2b22-4250-94ed-3508e906fad0]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9, portal: 172.16.0.220,3260]
Aug 15 19:43:51 user nova-compute[73188]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9, portal: 172.16.0.220,3260] successful.
Aug 15 19:43:51 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3f3677d-c6f2-4152-865d-db6399c6e0d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[079d92a8-bea9-477d-bb3f-3ec435f188a7]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] <== disconnect_volume: return (287ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:43:51 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:43:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:43:52 user nova-compute[73188]: DEBUG nova.objects.instance [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lazy-loading 'flavor' on Instance uuid 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:43:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-fae6949d-3e7e-4506-938f-aba97c892aa6 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.669s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:43:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:43:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:43:59 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:44:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:44:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-53f310ad-8136-4d62-90cc-25d703d1ebb7 req-80d1fa9f-8b9d-49f7-a722-dd3306b1c832 service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Received event network-changed-d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:44:07 user nova-compute[73188]: DEBUG nova.compute.manager [req-53f310ad-8136-4d62-90cc-25d703d1ebb7 req-80d1fa9f-8b9d-49f7-a722-dd3306b1c832 service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Refreshing instance network info cache due to event network-changed-d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:44:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-53f310ad-8136-4d62-90cc-25d703d1ebb7 req-80d1fa9f-8b9d-49f7-a722-dd3306b1c832 service nova] Acquiring lock "refresh_cache-c29d22f8-552b-4f7f-b27a-1abae7daa5dc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:44:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-53f310ad-8136-4d62-90cc-25d703d1ebb7 req-80d1fa9f-8b9d-49f7-a722-dd3306b1c832 service nova] Acquired lock "refresh_cache-c29d22f8-552b-4f7f-b27a-1abae7daa5dc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:44:07 user nova-compute[73188]: DEBUG nova.network.neutron [req-53f310ad-8136-4d62-90cc-25d703d1ebb7 req-80d1fa9f-8b9d-49f7-a722-dd3306b1c832 service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Refreshing network info cache for port d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:44:08 user nova-compute[73188]: DEBUG nova.network.neutron [req-53f310ad-8136-4d62-90cc-25d703d1ebb7 req-80d1fa9f-8b9d-49f7-a722-dd3306b1c832 service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Updated VIF entry in instance network info cache for port d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:44:08 user nova-compute[73188]: DEBUG nova.network.neutron [req-53f310ad-8136-4d62-90cc-25d703d1ebb7 req-80d1fa9f-8b9d-49f7-a722-dd3306b1c832 service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Updating instance_info_cache with network_info: [{"id": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "address": "fa:16:3e:81:01:9b", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bdbcb2-3c", "ovs_interfaceid": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:44:08 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-53f310ad-8136-4d62-90cc-25d703d1ebb7 req-80d1fa9f-8b9d-49f7-a722-dd3306b1c832 service nova] Releasing lock "refresh_cache-c29d22f8-552b-4f7f-b27a-1abae7daa5dc" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:44:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG nova.objects.instance [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lazy-loading 'flavor' on Instance uuid c29d22f8-552b-4f7f-b27a-1abae7daa5dc {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:44:12 user nova-compute[73188]: INFO nova.compute.manager [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Attaching volume 9541b1cb-0a02-474e-844e-e10c5ee91aed to /dev/vdb
Aug 15 19:44:12 user nova-compute[73188]: DEBUG os_brick.utils [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d747e6f-686a-4272-891c-c09d4b545dd1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[087646d2-cd86-46b1-a779-317998d24a5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b552a6f0-a49a-45ce-91a8-3d99cb38fd07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[410d792c-c6ab-4ddd-b94e-89c19ab38437]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:44:12 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:44:12 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d4c862-9164-4a94-b828-ca5ad94417c0]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG os_brick.utils [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:44:12 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Updating existing volume attachment record: fe1f08b6-0e7c-45e8-acfc-4455f603e8f8 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:44:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:44:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:44:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KcJmWXoF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:44:21 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:44:21 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:44:21 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f15e27-d8a5-4fdf-ab36-66026f8f60f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:44:21 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[836a3bd4-e7ec-450d-9a05-6d6424fbe8b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed] added
Aug 15 19:44:21 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[710c1432-d2ac-4bd4-9438-8966e3b71b80]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[925d3494-bb58-46bf-82ad-d1641ef0146e]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KcJmWXoF {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KcJmWXoF" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0a8732-bf94-4d92-9919-693b02e6bfe2]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KcJmWXoF'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0f21a6-b807-4762-bea0-f46001bf3b1c]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c47cf39-2f7c-4012-b37a-834a617532af]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 19:44:21 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 19:44:21 user nova-compute[73188]:  {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:44:21 user nova-compute[73188]: WARNING os_brick.initiator.connectors.iscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 19:44:21 user nova-compute[73188]: 
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2868a9-b3dd-4792-9d3a-c38bc0d2af92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed, portal: 172.16.0.220,3260]
Aug 15 19:44:21 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed, portal: 172.16.0.220,3260] successful.
Aug 15 19:44:21 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[c502ae82-3343-4f21-a320-027fbe546b95]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbe9a7e-2416-4e57-85f8-62a41e5e9408]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed (non-flash)
Aug 15 19:44:21 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed (non-flash)
Aug 15 19:44:21 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f121938e-a06d-4338-9fb5-ffe1f4a33d30]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:44:21 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KcJmWXoF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:44:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:44:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:44:22 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23539663864393830', 'path': '/dev/sdb'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:44:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539663864393830', 'path': '/dev/sdb'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:44:22 user nova-compute[73188]: DEBUG nova.objects.instance [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lazy-loading 'flavor' on Instance uuid c29d22f8-552b-4f7f-b27a-1abae7daa5dc {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:44:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:44:22 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:44:22 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:44:22 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:44:22 user nova-compute[73188]:   <serial>9541b1cb-0a02-474e-844e-e10c5ee91aed</serial>
Aug 15 19:44:22 user nova-compute[73188]: </disk>
Aug 15 19:44:22 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:44:22 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:44:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:44:23 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] No VIF found with MAC fa:16:3e:81:01:9b, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:44:23 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6b63dcd8-d10e-4d75-8670-d450909aa556 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.771s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:44:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:44:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:44:24 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:44:24 user nova-compute[73188]: INFO nova.compute.manager [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Detaching volume 9541b1cb-0a02-474e-844e-e10c5ee91aed
Aug 15 19:44:24 user nova-compute[73188]: INFO nova.virt.block_device [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Attempting to driver detach volume 9541b1cb-0a02-474e-844e-e10c5ee91aed from mountpoint /dev/vdb
Aug 15 19:44:24 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Attempting to detach device vdb from instance c29d22f8-552b-4f7f-b27a-1abae7daa5dc from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:44:24 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:44:24 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:44:24 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:44:24 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:44:24 user nova-compute[73188]:   <serial>9541b1cb-0a02-474e-844e-e10c5ee91aed</serial>
Aug 15 19:44:24 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:44:24 user nova-compute[73188]: </disk>
Aug 15 19:44:24 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:44:24 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Successfully detached device vdb from instance c29d22f8-552b-4f7f-b27a-1abae7daa5dc from the persistent domain config.
Aug 15 19:44:24 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c29d22f8-552b-4f7f-b27a-1abae7daa5dc from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:44:24 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:44:24 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:44:24 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:44:24 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:44:24 user nova-compute[73188]:   <serial>9541b1cb-0a02-474e-844e-e10c5ee91aed</serial>
Aug 15 19:44:24 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:44:24 user nova-compute[73188]: </disk>
Aug 15 19:44:24 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692128665.2253048, c29d22f8-552b-4f7f-b27a-1abae7daa5dc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c29d22f8-552b-4f7f-b27a-1abae7daa5dc {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:44:25 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Successfully detached device vdb from instance c29d22f8-552b-4f7f-b27a-1abae7daa5dc from the live domain config.
Aug 15 19:44:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KcJmWXoF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:44:25 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:44:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f989f04f-475e-4eec-8ba6-6d81b1e72d64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d60894a-e19b-4f9f-816a-71ed1cde448c]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed (non-flash)
Aug 15 19:44:25 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed (non-flash)
Aug 15 19:44:25 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281018f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed'): ({'sdb'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Removing single pathed devices sdb {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e7f0d7-df00-4086-9015-a270b00a40fc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[04137fe3-3261-461b-8802-f0ab81cec5f5]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Flushing IO for device /dev/sdb {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d44860-c49d-4ff4-b5ab-42d38beda6ec]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b74665e-65cc-4283-b098-e931cda4e3c3]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[acadb25b-f638-40d5-9a0b-d59b85c0f474]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[add41134-c434-43b4-aad5-3c6a14a5f580]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed, portal: 172.16.0.220,3260]
Aug 15 19:44:25 user nova-compute[73188]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed, portal: 172.16.0.220,3260] successful.
Aug 15 19:44:25 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9541b1cb-0a02-474e-844e-e10c5ee91aed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca3eb2b-ef43-4422-a082-885ea6f55f16]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.239s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] <== disconnect_volume: return (240ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:44:25 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:44:26 user nova-compute[73188]: DEBUG nova.objects.instance [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lazy-loading 'flavor' on Instance uuid c29d22f8-552b-4f7f-b27a-1abae7daa5dc {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:44:26 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-347bdbac-e488-490b-8572-eb4e7cc02462 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.537s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:44:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:44:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:44:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:44:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:44:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:44:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:44:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:44:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:44:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:44:39 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:44:40 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:44:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:44:43 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:44:43 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:44:43 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:44:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:44:44 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:44:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:44:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:44:44 user nova-compute[73188]: DEBUG nova.objects.instance [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lazy-loading 'flavor' on Instance uuid 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:44:45 user nova-compute[73188]: INFO nova.compute.manager [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Attaching volume 7066f8e7-2275-4b31-bc4a-9d26dd3c471f to /dev/vdb
Aug 15 19:44:45 user nova-compute[73188]: DEBUG os_brick.utils [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59a81b0-646b-4814-8e98-6748a1a8ef88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b23aeaf-cf96-4716-90cc-1fb961ea8f60]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d23a04-79f5-46fa-8647-fd67236c01c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[871333a6-6ae4-4a9c-a006-5e628d7019db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:44:45 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0d8782-f0ff-453d-b444-bbb14cc73cb1]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG os_brick.utils [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Updating existing volume attachment record: f26129ed-575d-4fca-be83-b78d3c14172f {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:45 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:46 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:44:46 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:44:46 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8532MB free_disk=25.128459930419922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:44:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:44:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:44:47 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:44:47 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance c29d22f8-552b-4f7f-b27a-1abae7daa5dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:44:47 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:44:47 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:44:47 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:44:47 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:44:47 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:44:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:44:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:44:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:44:49 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:44:49 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:44:49 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:44:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:44:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:44:49 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:44:49 user nova-compute[73188]: DEBUG nova.objects.instance [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lazy-loading 'info_cache' on Instance uuid 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:44:49 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Updating instance_info_cache with network_info: [{"id": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "address": "fa:16:3e:b8:89:9f", "network": {"id": "7502a12f-0713-4580-a7f2-8cfd4d75c1d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-988103788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "359d1159e0894d9fb21e8e8afdc397b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8e5d9-a6", "ovs_interfaceid": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:44:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:44:49 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:44:51 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:44:51 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:44:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:44:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:44:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:44:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:44:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:44:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQxDreJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:44:54 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:44:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:44:54 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:44:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:44:54 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[017662a5-ee3c-44e7-bf50-5bc6236eb189]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:44:54 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[36557669-4c38-4205-9cfd-4fa1a7e4cdb8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f] added
Aug 15 19:44:54 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a322ef-d4d0-45ef-809e-abeaf03bbc7b]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd0b927-b191-4a8c-8e7c-c11d70b4c053]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XQxDreJC {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XQxDreJC" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd98a950-ef68-48e5-8463-0f6395242f74]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XQxDreJC'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bb05ed-94aa-4a11-bac2-815049648ff6]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2142fa-dcf5-4055-8605-4a16a5f5fd75]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 19:44:54 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 19:44:54 user nova-compute[73188]:  {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:44:54 user nova-compute[73188]: WARNING os_brick.initiator.connectors.iscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 19:44:54 user nova-compute[73188]: 
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf3bb53-6833-4ff6-986e-42019c45b7b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f, portal: 172.16.0.220,3260]
Aug 15 19:44:54 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f, portal: 172.16.0.220,3260] successful.
Aug 15 19:44:54 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4348dbd2-b0f9-4ae6-b4fe-b251484d217d]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb849cc-788e-47b9-8779-fe51669b4229]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f (non-flash)
Aug 15 19:44:54 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f (non-flash)
Aug 15 19:44:54 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9fa9f4-b896-4eb9-80ac-145b3b70a35f]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:54 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:44:55 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:44:55 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQxDreJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:44:55 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:44:55 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26462386434383532', 'path': '/dev/sdb'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:44:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462386434383532', 'path': '/dev/sdb'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:44:55 user nova-compute[73188]: DEBUG nova.objects.instance [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lazy-loading 'flavor' on Instance uuid 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:44:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:44:55 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:44:55 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:44:55 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:44:55 user nova-compute[73188]:   <serial>7066f8e7-2275-4b31-bc4a-9d26dd3c471f</serial>
Aug 15 19:44:55 user nova-compute[73188]: </disk>
Aug 15 19:44:55 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:44:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:44:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:44:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] No VIF found with MAC fa:16:3e:b8:89:9f, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:44:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6bc03f45-9ae5-45cf-92af-493e528922cb tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.947s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:44:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:44:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:44:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:44:58 user nova-compute[73188]: INFO nova.compute.manager [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Detaching volume 7066f8e7-2275-4b31-bc4a-9d26dd3c471f
Aug 15 19:44:58 user nova-compute[73188]: INFO nova.virt.block_device [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Attempting to driver detach volume 7066f8e7-2275-4b31-bc4a-9d26dd3c471f from mountpoint /dev/vdb
Aug 15 19:44:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Attempting to detach device vdb from instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:44:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:44:58 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:44:58 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:44:58 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:44:58 user nova-compute[73188]:   <serial>7066f8e7-2275-4b31-bc4a-9d26dd3c471f</serial>
Aug 15 19:44:58 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:44:58 user nova-compute[73188]: </disk>
Aug 15 19:44:58 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:44:58 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Successfully detached device vdb from instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb from the persistent domain config.
Aug 15 19:44:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:44:58 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:44:58 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:44:58 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:44:58 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:44:58 user nova-compute[73188]:   <serial>7066f8e7-2275-4b31-bc4a-9d26dd3c471f</serial>
Aug 15 19:44:58 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:44:58 user nova-compute[73188]: </disk>
Aug 15 19:44:58 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:44:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692128699.0292675, 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:44:59 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Successfully detached device vdb from instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb from the live domain config.
Aug 15 19:44:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQxDreJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:44:59 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:44:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfecf92b-a2d5-49a4-a757-224671068116]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b8307b-bfca-4ccb-b215-130ca6c41c54]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f (non-flash)
Aug 15 19:44:59 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f (non-flash)
Aug 15 19:44:59 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e47e6050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f'): ({'sdb'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Removing single pathed devices sdb {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[da811db5-14b3-4eec-9b6a-0285d4931014]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1dd118-6523-4246-9a4c-57b13d9b331c]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Flushing IO for device /dev/sdb {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb2006b-fdf3-4234-a7e6-e756ba9b46e9]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60210c4-b4c9-42a6-9eaf-38fc38ee2c54]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f03e45d-85b9-4dbf-8802-530232dbd14c]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b57dae6-b796-45ad-a627-0ad577c14a5a]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f, portal: 172.16.0.220,3260]
Aug 15 19:44:59 user nova-compute[73188]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f, portal: 172.16.0.220,3260] successful.
Aug 15 19:44:59 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7066f8e7-2275-4b31-bc4a-9d26dd3c471f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[841911a4-c1eb-40cd-8683-c115b0da2413]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] <== disconnect_volume: return (264ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:44:59 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:45:00 user nova-compute[73188]: DEBUG nova.objects.instance [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lazy-loading 'flavor' on Instance uuid 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:45:00 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-90846403-2aa5-44d6-a651-4b668f3deea7 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.702s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:45:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:45:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:45:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:45:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:45:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:45:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:45:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:45:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:45:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:45:15 user nova-compute[73188]: INFO nova.compute.manager [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Terminating instance
Aug 15 19:45:15 user nova-compute[73188]: DEBUG nova.compute.manager [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG nova.compute.manager [req-54b95dca-c76f-482e-bd23-0ea9d28f7070 req-498701fe-b41f-4c43-b8fa-62df5f8ff94c service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Received event network-vif-unplugged-d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-54b95dca-c76f-482e-bd23-0ea9d28f7070 req-498701fe-b41f-4c43-b8fa-62df5f8ff94c service nova] Acquiring lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-54b95dca-c76f-482e-bd23-0ea9d28f7070 req-498701fe-b41f-4c43-b8fa-62df5f8ff94c service nova] Lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-54b95dca-c76f-482e-bd23-0ea9d28f7070 req-498701fe-b41f-4c43-b8fa-62df5f8ff94c service nova] Lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG nova.compute.manager [req-54b95dca-c76f-482e-bd23-0ea9d28f7070 req-498701fe-b41f-4c43-b8fa-62df5f8ff94c service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] No waiting events found dispatching network-vif-unplugged-d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG nova.compute.manager [req-54b95dca-c76f-482e-bd23-0ea9d28f7070 req-498701fe-b41f-4c43-b8fa-62df5f8ff94c service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Received event network-vif-unplugged-d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:45:15 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Instance destroyed successfully.
Aug 15 19:45:15 user nova-compute[73188]: DEBUG nova.objects.instance [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lazy-loading 'resources' on Instance uuid c29d22f8-552b-4f7f-b27a-1abae7daa5dc {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:42:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1411754341',display_name='tempest-AttachVolumeNegativeTest-server-1411754341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1411754341',id=51,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvSgQMf0C0AUv2jy7aofu+ChYH3XecdmeAiymXCvc1y9BPulug1kQfL5sSZubu8Gd4X8lB5WV3S6hgJtoQ40ryK6uEAn57BC4GpQoyASfTQlugTK31Lmotu9XA3L6GJ0Q==',key_name='tempest-keypair-1276756512',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:42:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5bc7d940cd1410a878ac89e24a4c4bc',ramdisk_id='',reservation_id='r-heyjlwps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1373631227',owner_user_name='tempest-AttachVolumeNegativeTest-1373631227-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:42:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e526de0e03140bea2d410f535f75bb7',uuid=c29d22f8-552b-4f7f-b27a-1abae7daa5dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "address": "fa:16:3e:81:01:9b", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bdbcb2-3c", "ovs_interfaceid": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converting VIF {"id": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "address": "fa:16:3e:81:01:9b", "network": {"id": "6c4a4a85-79f7-4436-8097-12022d478889", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-463076437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5bc7d940cd1410a878ac89e24a4c4bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bdbcb2-3c", "ovs_interfaceid": "d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:01:9b,bridge_name='br-int',has_traffic_filtering=True,id=d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5bdbcb2-3c') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG os_vif [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:01:9b,bridge_name='br-int',has_traffic_filtering=True,id=d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5bdbcb2-3c') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5bdbcb2-3c, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:45:15 user nova-compute[73188]: INFO os_vif [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:01:9b,bridge_name='br-int',has_traffic_filtering=True,id=d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0,network=Network(6c4a4a85-79f7-4436-8097-12022d478889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5bdbcb2-3c')
Aug 15 19:45:15 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Deleting instance files /opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc_del
Aug 15 19:45:15 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Deletion of /opt/stack/data/nova/instances/c29d22f8-552b-4f7f-b27a-1abae7daa5dc_del complete
Aug 15 19:45:15 user nova-compute[73188]: INFO nova.compute.manager [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 15 19:45:15 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:45:15 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:45:17 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:45:17 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Took 1.25 seconds to deallocate network for instance.
Aug 15 19:45:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:45:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:45:17 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:45:17 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:45:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:45:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-07ac36c0-771d-4f34-a272-8e056f617afc req-e5d5e7bb-ef83-49a8-85be-6e59e85b4b67 service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Received event network-vif-plugged-d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:45:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-07ac36c0-771d-4f34-a272-8e056f617afc req-e5d5e7bb-ef83-49a8-85be-6e59e85b4b67 service nova] Acquiring lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:45:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-07ac36c0-771d-4f34-a272-8e056f617afc req-e5d5e7bb-ef83-49a8-85be-6e59e85b4b67 service nova] Lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:45:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-07ac36c0-771d-4f34-a272-8e056f617afc req-e5d5e7bb-ef83-49a8-85be-6e59e85b4b67 service nova] Lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:45:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-07ac36c0-771d-4f34-a272-8e056f617afc req-e5d5e7bb-ef83-49a8-85be-6e59e85b4b67 service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] No waiting events found dispatching network-vif-plugged-d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:45:17 user nova-compute[73188]: WARNING nova.compute.manager [req-07ac36c0-771d-4f34-a272-8e056f617afc req-e5d5e7bb-ef83-49a8-85be-6e59e85b4b67 service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Received unexpected event network-vif-plugged-d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0 for instance with vm_state deleted and task_state None.
Aug 15 19:45:17 user nova-compute[73188]: DEBUG nova.compute.manager [req-07ac36c0-771d-4f34-a272-8e056f617afc req-e5d5e7bb-ef83-49a8-85be-6e59e85b4b67 service nova] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Received event network-vif-deleted-d5bdbcb2-3c03-4727-acf0-d2fbc3c5bae0 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:45:17 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Deleted allocations for instance c29d22f8-552b-4f7f-b27a-1abae7daa5dc
Aug 15 19:45:17 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-5cc712e5-3612-44e5-b640-126082d34881 tempest-AttachVolumeNegativeTest-1373631227 tempest-AttachVolumeNegativeTest-1373631227-project-member] Lock "c29d22f8-552b-4f7f-b27a-1abae7daa5dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.450s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:45:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:45:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:45:30 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692128715.8033419, c29d22f8-552b-4f7f-b27a-1abae7daa5dc => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:45:30 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] VM Stopped (Lifecycle Event)
Aug 15 19:45:30 user nova-compute[73188]: DEBUG nova.compute.manager [None req-69196a61-c624-45b1-93c0-f2a1684b0949 None None] [instance: c29d22f8-552b-4f7f-b27a-1abae7daa5dc] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:45:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:45:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:45:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:45:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:45:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:45:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:45:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:45:40 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:45:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:45:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:45:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:45:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:45:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:45:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:45:42 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:45:44 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:45:44 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:45:44 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:45:45 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:45:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:45:46 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:45:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:45:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:45:46 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:45:46 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:45:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:45:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:45:46 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:45:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:45:47 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:45:47 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:45:47 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8621MB free_disk=25.15456771850586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:45:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:45:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:45:47 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:45:47 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:45:47 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:45:47 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:45:47 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:45:47 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:45:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:45:49 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:45:49 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:45:49 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Didn't find any instances for network info cache update. {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 19:45:50 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:45:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:45:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:45:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:45:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:45:52 user nova-compute[73188]: DEBUG nova.objects.instance [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lazy-loading 'flavor' on Instance uuid 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:45:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:45:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:45:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:45:52 user nova-compute[73188]: INFO nova.compute.manager [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Attaching volume 0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 to /dev/vdb
Aug 15 19:45:52 user nova-compute[73188]: DEBUG os_brick.utils [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:45:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:45:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:45:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c1b118-8fab-4ae7-9168-3f1eb76fd2ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:45:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:45:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:45:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8ae932-2123-454c-9bce-846d3d7916c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:45:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:45:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:45:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[631b9162-042a-4295-aff3-8287246708f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:45:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6facdaee-134b-41c4-a244-a13a01233287]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:45:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:45:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:45:52 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:45:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:45:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:45:52 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:45:52 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f8aa8f-3923-4898-a3f5-838926f556b3]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:45:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:45:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:45:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:45:53 user nova-compute[73188]: DEBUG os_brick.utils [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:45:53 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Updating existing volume attachment record: ab8ce8af-66d1-4a56-ae96-86abaf0415a1 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:45:53 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:45:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:45:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:45:59 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:46:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScYdTbsf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:46:01 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:46:01 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:46:01 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:46:01 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:46:01 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:46:01 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[050c2e4e-b8e8-4d47-99a6-d91c4e7e695a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:46:01 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad176eda-d4ea-4825-8e69-679babb6f972]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5] added
Aug 15 19:46:01 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fb66b4-795b-4240-bef7-fa802fe80df8]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[de133d1c-5f94-4bcb-9d04-6f2285a98e3b]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ScYdTbsf {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ScYdTbsf" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[09793f5c-241a-423c-804e-1a7be7fb20c8]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ScYdTbsf'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5e49b2-abef-4320-b487-a309094a4a62]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[91560707-baf5-41c1-aadc-9cd15fe76e98]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 19:46:01 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:46:01 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 19:46:01 user nova-compute[73188]:  {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:46:01 user nova-compute[73188]: WARNING os_brick.initiator.connectors.iscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 19:46:01 user nova-compute[73188]: 
Aug 15 19:46:01 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:46:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 -p 172.16.0.220:3260 --login" returned: 0 in 0.250s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:46:02 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec0594d-d3e8-4f82-8319-f92dff3e6af7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:46:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5, portal: 172.16.0.220,3260]
Aug 15 19:46:02 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5, portal: 172.16.0.220,3260] successful.
Aug 15 19:46:02 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:46:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:46:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:46:02 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e09d41-3cc2-4587-958a-19a2714bd737]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:46:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:46:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:46:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:46:02 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e0fb30-fccb-4b68-92b1-ba164404d603]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:46:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 (non-flash)
Aug 15 19:46:02 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:46:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 (non-flash)
Aug 15 19:46:02 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:46:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.548s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:46:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:46:02 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:46:02 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:46:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:46:02 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:46:02 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5ed279-7b07-4555-87c2-073999ffe004]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:46:02 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:46:02 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScYdTbsf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:46:03 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.576s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:46:03 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] <== connect_volume: return (1578ms) {'type': 'block', 'scsi_wwn': '23062373661356166', 'path': '/dev/sdb'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:46:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062373661356166', 'path': '/dev/sdb'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:46:03 user nova-compute[73188]: DEBUG nova.objects.instance [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lazy-loading 'flavor' on Instance uuid 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:46:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:46:03 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:46:03 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:46:03 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:46:03 user nova-compute[73188]:   <serial>0b1e9421-8f56-49c3-8a4f-cc3119acdfd5</serial>
Aug 15 19:46:03 user nova-compute[73188]: </disk>
Aug 15 19:46:03 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:46:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:46:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:46:03 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] No VIF found with MAC fa:16:3e:b8:89:9f, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:46:03 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-c268ca71-6657-41fb-9dd5-b618942b6a07 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.922s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:46:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:46:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:46:06 user nova-compute[73188]: INFO nova.compute.manager [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Detaching volume 0b1e9421-8f56-49c3-8a4f-cc3119acdfd5
Aug 15 19:46:06 user nova-compute[73188]: INFO nova.virt.block_device [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Attempting to driver detach volume 0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 from mountpoint /dev/vdb
Aug 15 19:46:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Attempting to detach device vdb from instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:46:06 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:46:06 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:46:06 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:46:06 user nova-compute[73188]:   <serial>0b1e9421-8f56-49c3-8a4f-cc3119acdfd5</serial>
Aug 15 19:46:06 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:46:06 user nova-compute[73188]: </disk>
Aug 15 19:46:06 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:46:06 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Successfully detached device vdb from instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb from the persistent domain config.
Aug 15 19:46:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:46:06 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:46:06 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:46:06 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:46:06 user nova-compute[73188]:   <serial>0b1e9421-8f56-49c3-8a4f-cc3119acdfd5</serial>
Aug 15 19:46:06 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:46:06 user nova-compute[73188]: </disk>
Aug 15 19:46:06 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692128766.7531402, 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:46:06 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Successfully detached device vdb from instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb from the live domain config.
Aug 15 19:46:06 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScYdTbsf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:46:06 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:46:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6055f8-e56c-42ee-a58d-f2b0df7bcaa0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9573693-72e9-4a54-b2a2-0eeec456a74a]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 (non-flash)
Aug 15 19:46:06 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 (non-flash)
Aug 15 19:46:06 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f280832a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5'): ({'sdb'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Removing single pathed devices sdb {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b144972-d234-4ae1-a187-1d2a853ee6bd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3439073a-f796-45d3-845b-5bb31bd5d116]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Flushing IO for device /dev/sdb {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[f204e3b9-b2c1-4d30-8a5a-e59b40e28d04]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[35db2b0c-85b8-4a0e-a521-16a31541073e]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[deebe0dd-667e-4a8f-97e2-0a1f07f30229]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:46:06 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:46:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:46:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7e6586-040d-49d9-8881-f73a9387a1fa]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:46:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5, portal: 172.16.0.220,3260]
Aug 15 19:46:07 user nova-compute[73188]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5, portal: 172.16.0.220,3260] successful.
Aug 15 19:46:07 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:46:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:46:07 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b1e9421-8f56-49c3-8a4f-cc3119acdfd5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:46:07 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac9dc2c-f1ca-402d-bf59-f8f8b7e98c53]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:46:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:46:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:46:07 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] <== disconnect_volume: return (279ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:46:07 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:46:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:46:07 user nova-compute[73188]: DEBUG nova.objects.instance [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lazy-loading 'flavor' on Instance uuid 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:46:07 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-6b3e4c0c-bef6-4400-a3c5-9d7eee443691 tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.708s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:46:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:46:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:46:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:46:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:46:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:46:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:46:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:46:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:46:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:46:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:46:31 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:46:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:46:40 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:46:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:46:42 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:46:43 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:46:44 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:46:44 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:46:45 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:46:46 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:46:46 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:46:47 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:46:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:46:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:46:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:46:47 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:46:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:46:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:46:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:46:48 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:46:48 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:46:48 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:46:48 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8672MB free_disk=25.143310546875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:46:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:46:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:46:48 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:46:48 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:46:48 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:46:48 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing inventories for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 19:46:48 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Updating ProviderTree inventory for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 19:46:48 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Updating inventory in ProviderTree for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 19:46:48 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing aggregate associations for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5, aggregates: None {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 19:46:48 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing trait associations for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 19:46:48 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:46:48 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:46:48 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:46:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:46:49 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:46:49 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:46:49 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:46:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:46:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:46:50 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:46:50 user nova-compute[73188]: DEBUG nova.objects.instance [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lazy-loading 'info_cache' on Instance uuid 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:46:50 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:46:50 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Updating instance_info_cache with network_info: [{"id": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "address": "fa:16:3e:b8:89:9f", "network": {"id": "7502a12f-0713-4580-a7f2-8cfd4d75c1d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-988103788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "359d1159e0894d9fb21e8e8afdc397b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8e5d9-a6", "ovs_interfaceid": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:46:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:46:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:46:51 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:46:54 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:46:55 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:46:57 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:46:57 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=73188) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 19:47:00 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:05 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:08 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:47:08 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Cleaning up deleted instances {{(pid=73188) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 19:47:08 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] There are 0 instances to clean {{(pid=73188) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 19:47:10 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:15 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:47:20 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:47:25 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:26 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:35 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Acquiring lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:47:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:47:38 user nova-compute[73188]: DEBUG nova.compute.manager [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Starting instance... {{(pid=73188) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73188) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 19:47:39 user nova-compute[73188]: INFO nova.compute.claims [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Claim successful on node user
Aug 15 19:47:39 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Start building networks asynchronously for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Allocating IP information in the background. {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG nova.network.neutron [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] allocate_for_instance() {{(pid=73188) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:47:39 user nova-compute[73188]: INFO nova.compute.manager [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Terminating instance
Aug 15 19:47:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:47:39 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 19:47:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Start building block device mappings for instance. {{(pid=73188) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG nova.compute.manager [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Start spawning the instance on the hypervisor. {{(pid=73188) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Creating instance directory {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 19:47:39 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Creating image(s)
Aug 15 19:47:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Acquiring lock "/opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "/opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "/opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG nova.policy [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e75eecf03cd442897bc666306578859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe830c7f8efa4ae2a0e8c049e0c1e3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73188) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG nova.compute.manager [req-8ed7ccd9-4da9-4297-9eec-b1d67ff07477 req-1aa72933-b436-454d-ab26-c76ba9e08e68 service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Received event network-vif-unplugged-69b8e5d9-a600-492a-bc81-0e04d22871fb {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8ed7ccd9-4da9-4297-9eec-b1d67ff07477 req-1aa72933-b436-454d-ab26-c76ba9e08e68 service nova] Acquiring lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8ed7ccd9-4da9-4297-9eec-b1d67ff07477 req-1aa72933-b436-454d-ab26-c76ba9e08e68 service nova] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-8ed7ccd9-4da9-4297-9eec-b1d67ff07477 req-1aa72933-b436-454d-ab26-c76ba9e08e68 service nova] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG nova.compute.manager [req-8ed7ccd9-4da9-4297-9eec-b1d67ff07477 req-1aa72933-b436-454d-ab26-c76ba9e08e68 service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] No waiting events found dispatching network-vif-unplugged-69b8e5d9-a600-492a-bc81-0e04d22871fb {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG nova.compute.manager [req-8ed7ccd9-4da9-4297-9eec-b1d67ff07477 req-1aa72933-b436-454d-ab26-c76ba9e08e68 service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Received event network-vif-unplugged-69b8e5d9-a600-492a-bc81-0e04d22871fb for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.227s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Acquiring lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:47:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.187s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk 1073741824 {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f,backing_fmt=raw /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk 1073741824" returned: 0 in 0.055s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "33a5035d1373d9b35d1a38b38ed90ff033edc49f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:47:40 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Instance destroyed successfully.
Aug 15 19:47:40 user nova-compute[73188]: DEBUG nova.objects.instance [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lazy-loading 'resources' on Instance uuid 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:39:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-864973667',display_name='tempest-SnapshotDataIntegrityTests-server-864973667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-864973667',id=50,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN+g55ntT0/DSLK2I24g25ZTVwVQHR3dHwPQ6Jb+KLbPdhQlJuepV+UBqkCAwUYjToUnCHFSNVqUQbly/EyHb+Yye+497y0tePm3SW4ApXAxihn74iTZI0wWNVQpZLQfg==',key_name='tempest-keypair-393585547',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:40:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='359d1159e0894d9fb21e8e8afdc397b7',ramdisk_id='',reservation_id='r-q8ublx2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-952510571',owner_user_name='tempest-SnapshotDataIntegrityTests-952510571-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32ac444e64b14b1cbe4a3bf6bf6a579b',uuid=6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "address": "fa:16:3e:b8:89:9f", "network": {"id": "7502a12f-0713-4580-a7f2-8cfd4d75c1d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-988103788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "359d1159e0894d9fb21e8e8afdc397b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8e5d9-a6", "ovs_interfaceid": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Converting VIF {"id": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "address": "fa:16:3e:b8:89:9f", "network": {"id": "7502a12f-0713-4580-a7f2-8cfd4d75c1d6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-988103788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "359d1159e0894d9fb21e8e8afdc397b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8e5d9-a6", "ovs_interfaceid": "69b8e5d9-a600-492a-bc81-0e04d22871fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:89:9f,bridge_name='br-int',has_traffic_filtering=True,id=69b8e5d9-a600-492a-bc81-0e04d22871fb,network=Network(7502a12f-0713-4580-a7f2-8cfd4d75c1d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b8e5d9-a6') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG os_vif [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:89:9f,bridge_name='br-int',has_traffic_filtering=True,id=69b8e5d9-a600-492a-bc81-0e04d22871fb,network=Network(7502a12f-0713-4580-a7f2-8cfd4d75c1d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b8e5d9-a6') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69b8e5d9-a6, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:47:40 user nova-compute[73188]: INFO os_vif [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:89:9f,bridge_name='br-int',has_traffic_filtering=True,id=69b8e5d9-a600-492a-bc81-0e04d22871fb,network=Network(7502a12f-0713-4580-a7f2-8cfd4d75c1d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b8e5d9-a6')
Aug 15 19:47:40 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Deleting instance files /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb_del
Aug 15 19:47:40 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Deletion of /opt/stack/data/nova/instances/6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb_del complete
Aug 15 19:47:40 user nova-compute[73188]: INFO nova.compute.manager [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 15 19:47:40 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33a5035d1373d9b35d1a38b38ed90ff033edc49f --force-share --output=json" returned: 0 in 0.202s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk. size=1073741824 {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG nova.virt.disk.api [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Cannot resize image /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk to a smaller size. {{(pid=73188) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG nova.objects.instance [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lazy-loading 'migration_context' on Instance uuid 3dac87a8-1d6a-4277-858b-abf8f77168e8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Created local disks {{(pid=73188) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Ensure instance console log exists: /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/console.log {{(pid=73188) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:47:40 user nova-compute[73188]: DEBUG nova.network.neutron [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Successfully created port: b5f446cc-6fba-410e-a615-58e5ef828375 {{(pid=73188) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 19:47:41 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:47:41 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Took 1.13 seconds to deallocate network for instance.
Aug 15 19:47:41 user nova-compute[73188]: DEBUG nova.network.neutron [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Successfully updated port: b5f446cc-6fba-410e-a615-58e5ef828375 {{(pid=73188) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 19:47:41 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:47:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:47:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:47:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Acquiring lock "refresh_cache-3dac87a8-1d6a-4277-858b-abf8f77168e8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:47:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Acquired lock "refresh_cache-3dac87a8-1d6a-4277-858b-abf8f77168e8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:47:41 user nova-compute[73188]: DEBUG nova.network.neutron [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Building network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 19:47:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-ccaea443-f9d4-45cd-808f-08153ba62a26 req-85fab97e-d4ce-4d73-9ca0-3687309b0fad service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Received event network-changed-b5f446cc-6fba-410e-a615-58e5ef828375 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:47:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-ccaea443-f9d4-45cd-808f-08153ba62a26 req-85fab97e-d4ce-4d73-9ca0-3687309b0fad service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Refreshing instance network info cache due to event network-changed-b5f446cc-6fba-410e-a615-58e5ef828375. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:47:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ccaea443-f9d4-45cd-808f-08153ba62a26 req-85fab97e-d4ce-4d73-9ca0-3687309b0fad service nova] Acquiring lock "refresh_cache-3dac87a8-1d6a-4277-858b-abf8f77168e8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:47:41 user nova-compute[73188]: DEBUG nova.network.neutron [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Instance cache missing network info. {{(pid=73188) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 19:47:41 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:47:41 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:47:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:47:41 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Deleted allocations for instance 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb
Aug 15 19:47:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-58e94e45-e03e-4d90-9bf8-52d4ecc49d15 req-d2b96f0f-d35f-4e9f-a16f-2f1ecd3d0b3e service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Received event network-vif-plugged-69b8e5d9-a600-492a-bc81-0e04d22871fb {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:47:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-58e94e45-e03e-4d90-9bf8-52d4ecc49d15 req-d2b96f0f-d35f-4e9f-a16f-2f1ecd3d0b3e service nova] Acquiring lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:47:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-58e94e45-e03e-4d90-9bf8-52d4ecc49d15 req-d2b96f0f-d35f-4e9f-a16f-2f1ecd3d0b3e service nova] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:47:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-58e94e45-e03e-4d90-9bf8-52d4ecc49d15 req-d2b96f0f-d35f-4e9f-a16f-2f1ecd3d0b3e service nova] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:47:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-58e94e45-e03e-4d90-9bf8-52d4ecc49d15 req-d2b96f0f-d35f-4e9f-a16f-2f1ecd3d0b3e service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] No waiting events found dispatching network-vif-plugged-69b8e5d9-a600-492a-bc81-0e04d22871fb {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:47:41 user nova-compute[73188]: WARNING nova.compute.manager [req-58e94e45-e03e-4d90-9bf8-52d4ecc49d15 req-d2b96f0f-d35f-4e9f-a16f-2f1ecd3d0b3e service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Received unexpected event network-vif-plugged-69b8e5d9-a600-492a-bc81-0e04d22871fb for instance with vm_state deleted and task_state None.
Aug 15 19:47:41 user nova-compute[73188]: DEBUG nova.compute.manager [req-58e94e45-e03e-4d90-9bf8-52d4ecc49d15 req-d2b96f0f-d35f-4e9f-a16f-2f1ecd3d0b3e service nova] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Received event network-vif-deleted-69b8e5d9-a600-492a-bc81-0e04d22871fb {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:47:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-ac151dc3-da2c-48e2-bca0-9921d6d8641e tempest-SnapshotDataIntegrityTests-952510571 tempest-SnapshotDataIntegrityTests-952510571-project-member] Lock "6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.504s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.network.neutron [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Updating instance_info_cache with network_info: [{"id": "b5f446cc-6fba-410e-a615-58e5ef828375", "address": "fa:16:3e:9e:32:a8", "network": {"id": "51986952-5a55-415b-a850-9075906d3b3c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-198183386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe830c7f8efa4ae2a0e8c049e0c1e3ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f446cc-6f", "ovs_interfaceid": "b5f446cc-6fba-410e-a615-58e5ef828375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Releasing lock "refresh_cache-3dac87a8-1d6a-4277-858b-abf8f77168e8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.compute.manager [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Instance network_info: |[{"id": "b5f446cc-6fba-410e-a615-58e5ef828375", "address": "fa:16:3e:9e:32:a8", "network": {"id": "51986952-5a55-415b-a850-9075906d3b3c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-198183386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe830c7f8efa4ae2a0e8c049e0c1e3ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f446cc-6f", "ovs_interfaceid": "b5f446cc-6fba-410e-a615-58e5ef828375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73188) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ccaea443-f9d4-45cd-808f-08153ba62a26 req-85fab97e-d4ce-4d73-9ca0-3687309b0fad service nova] Acquired lock "refresh_cache-3dac87a8-1d6a-4277-858b-abf8f77168e8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.network.neutron [req-ccaea443-f9d4-45cd-808f-08153ba62a26 req-85fab97e-d4ce-4d73-9ca0-3687309b0fad service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Refreshing network info cache for port b5f446cc-6fba-410e-a615-58e5ef828375 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Start _get_guest_xml network_info=[{"id": "b5f446cc-6fba-410e-a615-58e5ef828375", "address": "fa:16:3e:9e:32:a8", "network": {"id": "51986952-5a55-415b-a850-9075906d3b3c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-198183386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe830c7f8efa4ae2a0e8c049e0c1e3ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f446cc-6f", "ovs_interfaceid": "b5f446cc-6fba-410e-a615-58e5ef828375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'image_id': 'f00e830a-b2ca-4a70-976f-0b43c7345f1b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 19:47:42 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:47:42 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] CPU controller missing on host. {{(pid=73188) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.host [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] CPU controller found on host. {{(pid=73188) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73188) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T19:01:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T19:01:34Z,direct_url=<?>,disk_format='qcow2',id=f00e830a-b2ca-4a70-976f-0b43c7345f1b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='955614a7fb044176adad07bac93ae638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T19:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Flavor limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Image limits 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Flavor pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Image pref 0:0:0 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Got 1 possible topologies {{(pid=73188) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.virt.hardware [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73188) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-250224661',display_name='tempest-TestServerVolumeAttachmentScenario-server-250224661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-250224661',id=52,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLC3qpVldgyAVrH6Jx8gTFyArlq5E+TgFl5fOpyt4FBa2ZgS1QSg6N1ZWYKKr1wN9fv9kCrmzv28CZYQlwh7RtJuSWsrtg3ZTS90ReqJzZz23OqoIXB7Hopzi9cdDfA2nw==',key_name='tempest-keypair-584962616',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe830c7f8efa4ae2a0e8c049e0c1e3ad',ramdisk_id='',reservation_id='r-e2bzueig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-448510547',owner_user_name='tempest-TestServerVolumeAttachmentScenario-448510547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:47:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e75eecf03cd442897bc666306578859',uuid=3dac87a8-1d6a-4277-858b-abf8f77168e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5f446cc-6fba-410e-a615-58e5ef828375", "address": "fa:16:3e:9e:32:a8", "network": {"id": "51986952-5a55-415b-a850-9075906d3b3c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-198183386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe830c7f8efa4ae2a0e8c049e0c1e3ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f446cc-6f", "ovs_interfaceid": "b5f446cc-6fba-410e-a615-58e5ef828375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73188) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Converting VIF {"id": "b5f446cc-6fba-410e-a615-58e5ef828375", "address": "fa:16:3e:9e:32:a8", "network": {"id": "51986952-5a55-415b-a850-9075906d3b3c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-198183386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe830c7f8efa4ae2a0e8c049e0c1e3ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f446cc-6f", "ovs_interfaceid": "b5f446cc-6fba-410e-a615-58e5ef828375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:32:a8,bridge_name='br-int',has_traffic_filtering=True,id=b5f446cc-6fba-410e-a615-58e5ef828375,network=Network(51986952-5a55-415b-a850-9075906d3b3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f446cc-6f') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.objects.instance [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lazy-loading 'pci_devices' on Instance uuid 3dac87a8-1d6a-4277-858b-abf8f77168e8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] End _get_guest_xml xml=<domain type="kvm">
Aug 15 19:47:42 user nova-compute[73188]:   <uuid>3dac87a8-1d6a-4277-858b-abf8f77168e8</uuid>
Aug 15 19:47:42 user nova-compute[73188]:   <name>instance-00000034</name>
Aug 15 19:47:42 user nova-compute[73188]:   <memory>524288</memory>
Aug 15 19:47:42 user nova-compute[73188]:   <vcpu>1</vcpu>
Aug 15 19:47:42 user nova-compute[73188]:   <metadata>
Aug 15 19:47:42 user nova-compute[73188]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 19:47:42 user nova-compute[73188]:       <nova:package version="0.0.0"/>
Aug 15 19:47:42 user nova-compute[73188]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-250224661</nova:name>
Aug 15 19:47:42 user nova-compute[73188]:       <nova:creationTime>2023-08-15 19:47:42</nova:creationTime>
Aug 15 19:47:42 user nova-compute[73188]:       <nova:flavor name="m1.tiny">
Aug 15 19:47:42 user nova-compute[73188]:         <nova:memory>512</nova:memory>
Aug 15 19:47:42 user nova-compute[73188]:         <nova:disk>1</nova:disk>
Aug 15 19:47:42 user nova-compute[73188]:         <nova:swap>0</nova:swap>
Aug 15 19:47:42 user nova-compute[73188]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 19:47:42 user nova-compute[73188]:         <nova:vcpus>1</nova:vcpus>
Aug 15 19:47:42 user nova-compute[73188]:       </nova:flavor>
Aug 15 19:47:42 user nova-compute[73188]:       <nova:owner>
Aug 15 19:47:42 user nova-compute[73188]:         <nova:user uuid="4e75eecf03cd442897bc666306578859">tempest-TestServerVolumeAttachmentScenario-448510547-project-member</nova:user>
Aug 15 19:47:42 user nova-compute[73188]:         <nova:project uuid="fe830c7f8efa4ae2a0e8c049e0c1e3ad">tempest-TestServerVolumeAttachmentScenario-448510547</nova:project>
Aug 15 19:47:42 user nova-compute[73188]:       </nova:owner>
Aug 15 19:47:42 user nova-compute[73188]:       <nova:root type="image" uuid="f00e830a-b2ca-4a70-976f-0b43c7345f1b"/>
Aug 15 19:47:42 user nova-compute[73188]:       <nova:ports>
Aug 15 19:47:42 user nova-compute[73188]:         <nova:port uuid="b5f446cc-6fba-410e-a615-58e5ef828375">
Aug 15 19:47:42 user nova-compute[73188]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 19:47:42 user nova-compute[73188]:         </nova:port>
Aug 15 19:47:42 user nova-compute[73188]:       </nova:ports>
Aug 15 19:47:42 user nova-compute[73188]:     </nova:instance>
Aug 15 19:47:42 user nova-compute[73188]:   </metadata>
Aug 15 19:47:42 user nova-compute[73188]:   <sysinfo type="smbios">
Aug 15 19:47:42 user nova-compute[73188]:     <system>
Aug 15 19:47:42 user nova-compute[73188]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 19:47:42 user nova-compute[73188]:       <entry name="product">OpenStack Nova</entry>
Aug 15 19:47:42 user nova-compute[73188]:       <entry name="version">0.0.0</entry>
Aug 15 19:47:42 user nova-compute[73188]:       <entry name="serial">3dac87a8-1d6a-4277-858b-abf8f77168e8</entry>
Aug 15 19:47:42 user nova-compute[73188]:       <entry name="uuid">3dac87a8-1d6a-4277-858b-abf8f77168e8</entry>
Aug 15 19:47:42 user nova-compute[73188]:       <entry name="family">Virtual Machine</entry>
Aug 15 19:47:42 user nova-compute[73188]:     </system>
Aug 15 19:47:42 user nova-compute[73188]:   </sysinfo>
Aug 15 19:47:42 user nova-compute[73188]:   <os>
Aug 15 19:47:42 user nova-compute[73188]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 19:47:42 user nova-compute[73188]:     <boot dev="hd"/>
Aug 15 19:47:42 user nova-compute[73188]:     <smbios mode="sysinfo"/>
Aug 15 19:47:42 user nova-compute[73188]:   </os>
Aug 15 19:47:42 user nova-compute[73188]:   <features>
Aug 15 19:47:42 user nova-compute[73188]:     <acpi/>
Aug 15 19:47:42 user nova-compute[73188]:     <apic/>
Aug 15 19:47:42 user nova-compute[73188]:     <vmcoreinfo/>
Aug 15 19:47:42 user nova-compute[73188]:   </features>
Aug 15 19:47:42 user nova-compute[73188]:   <clock offset="utc">
Aug 15 19:47:42 user nova-compute[73188]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 19:47:42 user nova-compute[73188]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 19:47:42 user nova-compute[73188]:     <timer name="hpet" present="no"/>
Aug 15 19:47:42 user nova-compute[73188]:   </clock>
Aug 15 19:47:42 user nova-compute[73188]:   <cpu mode="custom" match="exact">
Aug 15 19:47:42 user nova-compute[73188]:     <model>Nehalem</model>
Aug 15 19:47:42 user nova-compute[73188]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 19:47:42 user nova-compute[73188]:   </cpu>
Aug 15 19:47:42 user nova-compute[73188]:   <devices>
Aug 15 19:47:42 user nova-compute[73188]:     <disk type="file" device="disk">
Aug 15 19:47:42 user nova-compute[73188]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 19:47:42 user nova-compute[73188]:       <source file="/opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk"/>
Aug 15 19:47:42 user nova-compute[73188]:       <target dev="vda" bus="virtio"/>
Aug 15 19:47:42 user nova-compute[73188]:     </disk>
Aug 15 19:47:42 user nova-compute[73188]:     <interface type="ethernet">
Aug 15 19:47:42 user nova-compute[73188]:       <mac address="fa:16:3e:9e:32:a8"/>
Aug 15 19:47:42 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:47:42 user nova-compute[73188]:       <mtu size="1442"/>
Aug 15 19:47:42 user nova-compute[73188]:       <target dev="tapb5f446cc-6f"/>
Aug 15 19:47:42 user nova-compute[73188]:     </interface>
Aug 15 19:47:42 user nova-compute[73188]:     <serial type="pty">
Aug 15 19:47:42 user nova-compute[73188]:       <log file="/opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/console.log" append="off"/>
Aug 15 19:47:42 user nova-compute[73188]:     </serial>
Aug 15 19:47:42 user nova-compute[73188]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 19:47:42 user nova-compute[73188]:     <video>
Aug 15 19:47:42 user nova-compute[73188]:       <model type="virtio"/>
Aug 15 19:47:42 user nova-compute[73188]:     </video>
Aug 15 19:47:42 user nova-compute[73188]:     <rng model="virtio">
Aug 15 19:47:42 user nova-compute[73188]:       <backend model="random">/dev/urandom</backend>
Aug 15 19:47:42 user nova-compute[73188]:     </rng>
Aug 15 19:47:42 user nova-compute[73188]:     <controller type="usb" index="0" model="none"/>
Aug 15 19:47:42 user nova-compute[73188]:     <memballoon model="virtio">
Aug 15 19:47:42 user nova-compute[73188]:       <stats period="10"/>
Aug 15 19:47:42 user nova-compute[73188]:     </memballoon>
Aug 15 19:47:42 user nova-compute[73188]:   </devices>
Aug 15 19:47:42 user nova-compute[73188]: </domain>
Aug 15 19:47:42 user nova-compute[73188]:  {{(pid=73188) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-250224661',display_name='tempest-TestServerVolumeAttachmentScenario-server-250224661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-250224661',id=52,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLC3qpVldgyAVrH6Jx8gTFyArlq5E+TgFl5fOpyt4FBa2ZgS1QSg6N1ZWYKKr1wN9fv9kCrmzv28CZYQlwh7RtJuSWsrtg3ZTS90ReqJzZz23OqoIXB7Hopzi9cdDfA2nw==',key_name='tempest-keypair-584962616',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe830c7f8efa4ae2a0e8c049e0c1e3ad',ramdisk_id='',reservation_id='r-e2bzueig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-448510547',owner_user_name='tempest-TestServerVolumeAttachmentScenario-448510547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T19:47:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e75eecf03cd442897bc666306578859',uuid=3dac87a8-1d6a-4277-858b-abf8f77168e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5f446cc-6fba-410e-a615-58e5ef828375", "address": "fa:16:3e:9e:32:a8", "network": {"id": "51986952-5a55-415b-a850-9075906d3b3c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-198183386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe830c7f8efa4ae2a0e8c049e0c1e3ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f446cc-6f", "ovs_interfaceid": "b5f446cc-6fba-410e-a615-58e5ef828375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Converting VIF {"id": "b5f446cc-6fba-410e-a615-58e5ef828375", "address": "fa:16:3e:9e:32:a8", "network": {"id": "51986952-5a55-415b-a850-9075906d3b3c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-198183386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe830c7f8efa4ae2a0e8c049e0c1e3ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f446cc-6f", "ovs_interfaceid": "b5f446cc-6fba-410e-a615-58e5ef828375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:32:a8,bridge_name='br-int',has_traffic_filtering=True,id=b5f446cc-6fba-410e-a615-58e5ef828375,network=Network(51986952-5a55-415b-a850-9075906d3b3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f446cc-6f') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG os_vif [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:32:a8,bridge_name='br-int',has_traffic_filtering=True,id=b5f446cc-6fba-410e-a615-58e5ef828375,network=Network(51986952-5a55-415b-a850-9075906d3b3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f446cc-6f') {{(pid=73188) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5f446cc-6f, may_exist=True, interface_attrs={}) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb5f446cc-6f, col_values=(('external_ids', {'iface-id': 'b5f446cc-6fba-410e-a615-58e5ef828375', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:32:a8', 'vm-uuid': '3dac87a8-1d6a-4277-858b-abf8f77168e8'}),), if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:42 user nova-compute[73188]: INFO os_vif [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:32:a8,bridge_name='br-int',has_traffic_filtering=True,id=b5f446cc-6fba-410e-a615-58e5ef828375,network=Network(51986952-5a55-415b-a850-9075906d3b3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f446cc-6f')
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] No VIF found with MAC fa:16:3e:9e:32:a8, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.network.neutron [req-ccaea443-f9d4-45cd-808f-08153ba62a26 req-85fab97e-d4ce-4d73-9ca0-3687309b0fad service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Updated VIF entry in instance network info cache for port b5f446cc-6fba-410e-a615-58e5ef828375. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG nova.network.neutron [req-ccaea443-f9d4-45cd-808f-08153ba62a26 req-85fab97e-d4ce-4d73-9ca0-3687309b0fad service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Updating instance_info_cache with network_info: [{"id": "b5f446cc-6fba-410e-a615-58e5ef828375", "address": "fa:16:3e:9e:32:a8", "network": {"id": "51986952-5a55-415b-a850-9075906d3b3c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-198183386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe830c7f8efa4ae2a0e8c049e0c1e3ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f446cc-6f", "ovs_interfaceid": "b5f446cc-6fba-410e-a615-58e5ef828375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:47:42 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-ccaea443-f9d4-45cd-808f-08153ba62a26 req-85fab97e-d4ce-4d73-9ca0-3687309b0fad service nova] Releasing lock "refresh_cache-3dac87a8-1d6a-4277-858b-abf8f77168e8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:47:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:43 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:47:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:43 user nova-compute[73188]: DEBUG nova.compute.manager [req-6df412e8-d3fb-4eb6-977a-c658b0705b42 req-73c830e3-152f-47b8-a817-c22e086e319c service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Received event network-vif-plugged-b5f446cc-6fba-410e-a615-58e5ef828375 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:47:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6df412e8-d3fb-4eb6-977a-c658b0705b42 req-73c830e3-152f-47b8-a817-c22e086e319c service nova] Acquiring lock "3dac87a8-1d6a-4277-858b-abf8f77168e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:47:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6df412e8-d3fb-4eb6-977a-c658b0705b42 req-73c830e3-152f-47b8-a817-c22e086e319c service nova] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:47:43 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-6df412e8-d3fb-4eb6-977a-c658b0705b42 req-73c830e3-152f-47b8-a817-c22e086e319c service nova] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:47:43 user nova-compute[73188]: DEBUG nova.compute.manager [req-6df412e8-d3fb-4eb6-977a-c658b0705b42 req-73c830e3-152f-47b8-a817-c22e086e319c service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] No waiting events found dispatching network-vif-plugged-b5f446cc-6fba-410e-a615-58e5ef828375 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:47:43 user nova-compute[73188]: WARNING nova.compute.manager [req-6df412e8-d3fb-4eb6-977a-c658b0705b42 req-73c830e3-152f-47b8-a817-c22e086e319c service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Received unexpected event network-vif-plugged-b5f446cc-6fba-410e-a615-58e5ef828375 for instance with vm_state building and task_state spawning.
Aug 15 19:47:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:44 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:45 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692128865.697606, 3dac87a8-1d6a-4277-858b-abf8f77168e8 => Resumed> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:47:45 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] VM Resumed (Lifecycle Event)
Aug 15 19:47:45 user nova-compute[73188]: DEBUG nova.compute.manager [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Instance event wait completed in 0 seconds for  {{(pid=73188) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 19:47:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Guest created on hypervisor {{(pid=73188) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 19:47:45 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Instance spawned successfully.
Aug 15 19:47:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 19:47:45 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:47:45 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:47:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Found default for hw_cdrom_bus of ide {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:47:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Found default for hw_disk_bus of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:47:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Found default for hw_input_bus of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:47:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Found default for hw_pointer_model of None {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:47:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Found default for hw_video_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:47:45 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Found default for hw_vif_model of virtio {{(pid=73188) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 19:47:45 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:47:45 user nova-compute[73188]: DEBUG nova.virt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Emitting event <LifecycleEvent: 1692128865.6989377, 3dac87a8-1d6a-4277-858b-abf8f77168e8 => Started> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:47:45 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] VM Started (Lifecycle Event)
Aug 15 19:47:45 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:47:45 user nova-compute[73188]: DEBUG nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73188) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 19:47:45 user nova-compute[73188]: INFO nova.compute.manager [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 19:47:45 user nova-compute[73188]: INFO nova.compute.manager [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Took 6.19 seconds to spawn the instance on the hypervisor.
Aug 15 19:47:45 user nova-compute[73188]: DEBUG nova.compute.manager [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:47:45 user nova-compute[73188]: DEBUG nova.compute.manager [req-fe45d6c4-6d38-4662-8121-4a71914e1092 req-fdd20581-2e2d-45b5-8315-50f7a0426bfb service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Received event network-vif-plugged-b5f446cc-6fba-410e-a615-58e5ef828375 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:47:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fe45d6c4-6d38-4662-8121-4a71914e1092 req-fdd20581-2e2d-45b5-8315-50f7a0426bfb service nova] Acquiring lock "3dac87a8-1d6a-4277-858b-abf8f77168e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:47:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fe45d6c4-6d38-4662-8121-4a71914e1092 req-fdd20581-2e2d-45b5-8315-50f7a0426bfb service nova] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:47:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-fe45d6c4-6d38-4662-8121-4a71914e1092 req-fdd20581-2e2d-45b5-8315-50f7a0426bfb service nova] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:47:45 user nova-compute[73188]: DEBUG nova.compute.manager [req-fe45d6c4-6d38-4662-8121-4a71914e1092 req-fdd20581-2e2d-45b5-8315-50f7a0426bfb service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] No waiting events found dispatching network-vif-plugged-b5f446cc-6fba-410e-a615-58e5ef828375 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:47:45 user nova-compute[73188]: WARNING nova.compute.manager [req-fe45d6c4-6d38-4662-8121-4a71914e1092 req-fdd20581-2e2d-45b5-8315-50f7a0426bfb service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Received unexpected event network-vif-plugged-b5f446cc-6fba-410e-a615-58e5ef828375 for instance with vm_state building and task_state spawning.
Aug 15 19:47:45 user nova-compute[73188]: INFO nova.compute.manager [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Took 6.87 seconds to build instance.
Aug 15 19:47:45 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-28ab7f24-d216-46ce-8de3-3e2bd4a4144e tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.013s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:47:46 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:47:46 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:47:46 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:47:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:48 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:47:48 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:47:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:47:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:47:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:47:48 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:47:48 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:47:48 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:47:48 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:47:49 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:47:49 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:47:49 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:47:49 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8747MB free_disk=25.167407989501953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:47:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:47:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:47:49 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3dac87a8-1d6a-4277-858b-abf8f77168e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:47:49 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:47:49 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:47:49 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:47:49 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:47:49 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:47:49 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:47:50 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:47:50 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:47:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:47:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:47:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-3dac87a8-1d6a-4277-858b-abf8f77168e8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:47:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-3dac87a8-1d6a-4277-858b-abf8f77168e8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:47:50 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:47:50 user nova-compute[73188]: DEBUG nova.objects.instance [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lazy-loading 'info_cache' on Instance uuid 3dac87a8-1d6a-4277-858b-abf8f77168e8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:47:51 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Updating instance_info_cache with network_info: [{"id": "b5f446cc-6fba-410e-a615-58e5ef828375", "address": "fa:16:3e:9e:32:a8", "network": {"id": "51986952-5a55-415b-a850-9075906d3b3c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-198183386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe830c7f8efa4ae2a0e8c049e0c1e3ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f446cc-6f", "ovs_interfaceid": "b5f446cc-6fba-410e-a615-58e5ef828375", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:47:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-3dac87a8-1d6a-4277-858b-abf8f77168e8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:47:51 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:47:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:47:54 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:47:55 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692128860.1995146, 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:47:55 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] VM Stopped (Lifecycle Event)
Aug 15 19:47:55 user nova-compute[73188]: DEBUG nova.compute.manager [None req-57b39697-2390-452b-9c3e-e3654e84bb95 None None] [instance: 6e0ccf9e-c83f-498d-8eac-a5c1c4c9beeb] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:47:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:47:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:48:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:48:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:48:02 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:48:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:48:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:48:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:48:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:48:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:48:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:48:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:48:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:48:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:48:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:48:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:48:36 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:48:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:48:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:48:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:48:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:48:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:48:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:48:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:48:42 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:48:44 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:48:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:48:48 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:48:48 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:48:48 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:48:50 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:48:50 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:48:50 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:48:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:48:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:48:50 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:48:50 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:48:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:48:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:48:50 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:48:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:48:51 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:48:51 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:48:51 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8739MB free_disk=25.138202667236328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:48:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:48:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:48:51 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3dac87a8-1d6a-4277-858b-abf8f77168e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:48:51 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:48:51 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:48:51 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:48:51 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:48:51 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:48:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:48:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:48:52 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:48:52 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:48:52 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:48:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-3dac87a8-1d6a-4277-858b-abf8f77168e8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:48:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-3dac87a8-1d6a-4277-858b-abf8f77168e8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:48:52 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:48:52 user nova-compute[73188]: DEBUG nova.objects.instance [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lazy-loading 'info_cache' on Instance uuid 3dac87a8-1d6a-4277-858b-abf8f77168e8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:48:53 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Updating instance_info_cache with network_info: [{"id": "b5f446cc-6fba-410e-a615-58e5ef828375", "address": "fa:16:3e:9e:32:a8", "network": {"id": "51986952-5a55-415b-a850-9075906d3b3c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-198183386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe830c7f8efa4ae2a0e8c049e0c1e3ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f446cc-6f", "ovs_interfaceid": "b5f446cc-6fba-410e-a615-58e5ef828375", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:48:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-3dac87a8-1d6a-4277-858b-abf8f77168e8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:48:53 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:48:56 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:48:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:48:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:48:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:48:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:48:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:48:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:49:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:49:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:49:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:49:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:49:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:49:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:49:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:49:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:49:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:49:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:49:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:49:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:49:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:49:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:49:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:49:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:49:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:49:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:49:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:49:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:49:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:49:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:49:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:49:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:49:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:49:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:49:30 user nova-compute[73188]: DEBUG nova.compute.manager [req-03fbea59-cb92-4b25-aa09-f21bc7ba9cd2 req-15bf4a02-4255-486f-861b-63c36d8615d6 service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Received event network-changed-b5f446cc-6fba-410e-a615-58e5ef828375 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:49:30 user nova-compute[73188]: DEBUG nova.compute.manager [req-03fbea59-cb92-4b25-aa09-f21bc7ba9cd2 req-15bf4a02-4255-486f-861b-63c36d8615d6 service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Refreshing instance network info cache due to event network-changed-b5f446cc-6fba-410e-a615-58e5ef828375. {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 19:49:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-03fbea59-cb92-4b25-aa09-f21bc7ba9cd2 req-15bf4a02-4255-486f-861b-63c36d8615d6 service nova] Acquiring lock "refresh_cache-3dac87a8-1d6a-4277-858b-abf8f77168e8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:49:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-03fbea59-cb92-4b25-aa09-f21bc7ba9cd2 req-15bf4a02-4255-486f-861b-63c36d8615d6 service nova] Acquired lock "refresh_cache-3dac87a8-1d6a-4277-858b-abf8f77168e8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:49:30 user nova-compute[73188]: DEBUG nova.network.neutron [req-03fbea59-cb92-4b25-aa09-f21bc7ba9cd2 req-15bf4a02-4255-486f-861b-63c36d8615d6 service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Refreshing network info cache for port b5f446cc-6fba-410e-a615-58e5ef828375 {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 19:49:30 user nova-compute[73188]: DEBUG nova.network.neutron [req-03fbea59-cb92-4b25-aa09-f21bc7ba9cd2 req-15bf4a02-4255-486f-861b-63c36d8615d6 service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Updated VIF entry in instance network info cache for port b5f446cc-6fba-410e-a615-58e5ef828375. {{(pid=73188) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 19:49:30 user nova-compute[73188]: DEBUG nova.network.neutron [req-03fbea59-cb92-4b25-aa09-f21bc7ba9cd2 req-15bf4a02-4255-486f-861b-63c36d8615d6 service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Updating instance_info_cache with network_info: [{"id": "b5f446cc-6fba-410e-a615-58e5ef828375", "address": "fa:16:3e:9e:32:a8", "network": {"id": "51986952-5a55-415b-a850-9075906d3b3c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-198183386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe830c7f8efa4ae2a0e8c049e0c1e3ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f446cc-6f", "ovs_interfaceid": "b5f446cc-6fba-410e-a615-58e5ef828375", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:49:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-03fbea59-cb92-4b25-aa09-f21bc7ba9cd2 req-15bf4a02-4255-486f-861b-63c36d8615d6 service nova] Releasing lock "refresh_cache-3dac87a8-1d6a-4277-858b-abf8f77168e8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:49:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Acquiring lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:49:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:49:30 user nova-compute[73188]: DEBUG nova.objects.instance [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lazy-loading 'flavor' on Instance uuid 3dac87a8-1d6a-4277-858b-abf8f77168e8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:49:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:49:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Acquiring lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:49:30 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:49:30 user nova-compute[73188]: INFO nova.compute.manager [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Attaching volume c099de2a-deca-4067-b507-4583bb7b0718 to /dev/vdb
Aug 15 19:49:30 user nova-compute[73188]: DEBUG os_brick.utils [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:49:30 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c825023-d4e9-4990-902a-822f474bd40a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5af24f-c0c3-48da-b706-b09df61846fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d387b9-a035-42dc-b3ab-31341922b1dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa476d5-ea9f-4d74-aa54-0b20c888e692]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:49:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:49:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:31 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:49:31 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:49:31 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5ddeff-eb9f-45c2-9809-2cfb66767a39]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:49:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:49:31 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:49:31 user nova-compute[73188]: DEBUG os_brick.utils [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:49:31 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Updating existing volume attachment record: 2868c308-8e68-4f32-a99e-0bfd2a0867dd {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:49:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:49:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:49:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:49:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:49:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:49:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:49:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:49:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:49:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvgVjYUA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:49:39 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:49:39 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:49:39 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dd5abc-8121-40f2-9457-ded4cdc35bac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:49:39 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[65462313-bc22-4c62-8353-de5ab993180b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718] added
Aug 15 19:49:39 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d5e2e2-79c5-4af4-af3c-8b30a1b4a6d8]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a41974-8e47-4cde-9784-9fbb7e46433f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HvgVjYUA {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HvgVjYUA" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4959038-7b46-4ba1-b7df-014b6b7df189]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HvgVjYUA'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[124b6463-9e8a-4313-aeec-50de20acf7c4]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b14ee81-c974-462b-bce1-dea82cb01f88]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 19:49:39 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 19:49:39 user nova-compute[73188]:  {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:49:39 user nova-compute[73188]: WARNING os_brick.initiator.connectors.iscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 19:49:39 user nova-compute[73188]: 
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[540a426c-bf72-49b2-8fe5-d716d5de598e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718, portal: 172.16.0.220,3260]
Aug 15 19:49:39 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718, portal: 172.16.0.220,3260] successful.
Aug 15 19:49:39 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c3db5c-2f61-4507-a72b-50fae5b0db6f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[83536c7d-7c5a-4140-8930-37b1f464a9c0]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 (non-flash)
Aug 15 19:49:39 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 (non-flash)
Aug 15 19:49:39 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cf12ce-9de1-48a7-9bfc-a2c9b663c1fb]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:49:39 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvgVjYUA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:49:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:49:40 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26635653635333338', 'path': '/dev/sdb'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:49:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635653635333338', 'path': '/dev/sdb'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:49:40 user nova-compute[73188]: DEBUG nova.objects.instance [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lazy-loading 'flavor' on Instance uuid 3dac87a8-1d6a-4277-858b-abf8f77168e8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:49:40 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:49:40 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:49:40 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:49:40 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:49:40 user nova-compute[73188]:   <serial>c099de2a-deca-4067-b507-4583bb7b0718</serial>
Aug 15 19:49:40 user nova-compute[73188]: </disk>
Aug 15 19:49:40 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:49:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:49:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:49:41 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] No VIF found with MAC fa:16:3e:9e:32:a8, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:49:41 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-b2c9a754-77b2-475d-b656-9c0dfdbd9d6a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.273s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:49:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Acquiring lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG nova.objects.instance [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lazy-loading 'flavor' on Instance uuid 3dac87a8-1d6a-4277-858b-abf8f77168e8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Acquiring lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:49:44 user nova-compute[73188]: INFO nova.compute.manager [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Attaching volume ca50676e-6559-4144-b98a-b615604047cf to /dev/vdc
Aug 15 19:49:44 user nova-compute[73188]: DEBUG os_brick.utils [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[89119bd8-c3d3-472c-b7a0-f191bd92b5a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec527da3912b\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb47aa1a-f1df-43b3-9701-d18b0a1def19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d96d4a-44ae-4f89-9f89-23c9faa1a08d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2fb1a5-caa1-43d2-ba93-665a47ba9fed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Running cmd (subprocess): nvme version {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] 'nvme version' failed. Not Retrying. {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] nvme not present on system {{(pid=73188) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 19:49:44 user nova-compute[73188]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 19:49:44 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[3683b33e-4ca7-48a6-a2e7-f4e34b72ff2d]: (4, '') {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73188) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.lightos [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] LIGHTOS: no hostnqn found. {{(pid=73188) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG os_brick.utils [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec527da3912b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:49:44 user nova-compute[73188]: DEBUG nova.virt.block_device [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Updating existing volume attachment record: 8b3b0d8f-6533-4fcf-b1c8-1801e102fe09 {{(pid=73188) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 19:49:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:49:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:49:50 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:49:50 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:49:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:49:51 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:49:51 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:49:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:49:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:49:51 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:49:51 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:49:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:51 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:52 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:52 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73188) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 19:49:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:49:52 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:49:52 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:49:52 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8749MB free_disk=25.129051208496094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:49:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:49:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:49:52 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3dac87a8-1d6a-4277-858b-abf8f77168e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:49:52 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:49:52 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:49:52 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:49:52 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:49:52 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:49:52 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Calling os-brick to attach iSCSI Volume {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMDItFNv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:49:53 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:49:53 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:49:53 user nova-compute[73188]: INFO os_brick.initiator.connectors.iscsi [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf -p 172.16.0.220:3260 {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfbc058-54df-47d4-9638-6d7fe0ce0c60]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 19:49:53 user nova-compute[73188]:  {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf -p 172.16.0.220:3260 --interface default --op new {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[230279a3-4e05-4fcb-b66c-46a019fceb1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf] added\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf] added
Aug 15 19:49:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b00b88-47e8-4d0c-878f-9cb135bfb4d2]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e2c123-31a1-4077-be48-f98a57340459]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iMDItFNv {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iMDItFNv" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee6d304-947a-4741-a429-1297f2b8b19f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iMDItFNv'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2477b7d-0058-43c4-aafd-6053fd3527c7]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b455ef1-1d61-4bb9-8fbe-231369062c76]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 (non-flash)
Aug 15 19:49:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 (non-flash)
Aug 15 19:49:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf -p 172.16.0.220:3260 --login {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44680a5-eb60-49ad-addf-2287078eb21d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf, portal: 172.16.0.220,3260]
Aug 15 19:49:53 user nova-compute[73188]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf, portal: 172.16.0.220,3260] successful.
Aug 15 19:49:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c917c9-a612-4fd5-83e8-f57c354cf5dd]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9075f5-7e96-4ae3-9279-2fb58600d568]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 (non-flash)
Aug 15 19:49:53 user nova-compute[73188]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf (non-flash)
Aug 15 19:49:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 (non-flash)
Aug 15 19:49:53 user nova-compute[73188]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf (non-flash)
Aug 15 19:49:53 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Connected to 172.16.0.220:3260 {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=73188) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73188) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[846f0f3f-9e08-44b6-bbd1-6f92387b05d2]: (4, ('- - 0', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73188) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMDItFNv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73188) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-3dac87a8-1d6a-4277-858b-abf8f77168e8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-3dac87a8-1d6a-4277-858b-abf8f77168e8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:49:53 user nova-compute[73188]: DEBUG nova.objects.instance [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lazy-loading 'info_cache' on Instance uuid 3dac87a8-1d6a-4277-858b-abf8f77168e8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:49:54 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Updating instance_info_cache with network_info: [{"id": "b5f446cc-6fba-410e-a615-58e5ef828375", "address": "fa:16:3e:9e:32:a8", "network": {"id": "51986952-5a55-415b-a850-9075906d3b3c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-198183386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe830c7f8efa4ae2a0e8c049e0c1e3ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f446cc-6f", "ovs_interfaceid": "b5f446cc-6fba-410e-a615-58e5ef828375", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:49:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-3dac87a8-1d6a-4277-858b-abf8f77168e8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:49:54 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:49:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:49:54 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26138633338343736', 'path': '/dev/sdc'} {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:49:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138633338343736', 'path': '/dev/sdc'} {{(pid=73188) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 19:49:54 user nova-compute[73188]: DEBUG nova.objects.instance [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lazy-loading 'flavor' on Instance uuid 3dac87a8-1d6a-4277-858b-abf8f77168e8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:49:54 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 19:49:54 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:49:54 user nova-compute[73188]:   <source dev="/dev/sdc"/>
Aug 15 19:49:54 user nova-compute[73188]:   <target dev="vdc" bus="virtio"/>
Aug 15 19:49:54 user nova-compute[73188]:   <serial>ca50676e-6559-4144-b98a-b615604047cf</serial>
Aug 15 19:49:54 user nova-compute[73188]: </disk>
Aug 15 19:49:54 user nova-compute[73188]:  {{(pid=73188) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 19:49:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] No BDM found with device name vda, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:49:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:49:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73188) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 19:49:55 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] No VIF found with MAC fa:16:3e:9e:32:a8, not building metadata {{(pid=73188) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 19:49:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-8a9a5435-ae03-4dbf-93a2-72dd0b20e013 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.624s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:49:56 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:49:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Acquiring lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:49:56 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:49:56 user nova-compute[73188]: INFO nova.compute.manager [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Detaching volume ca50676e-6559-4144-b98a-b615604047cf
Aug 15 19:49:56 user nova-compute[73188]: INFO nova.virt.block_device [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Attempting to driver detach volume ca50676e-6559-4144-b98a-b615604047cf from mountpoint /dev/vdc
Aug 15 19:49:56 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Attempting to detach device vdc from instance 3dac87a8-1d6a-4277-858b-abf8f77168e8 from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:49:56 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:49:56 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:49:56 user nova-compute[73188]:   <source dev="/dev/sdc"/>
Aug 15 19:49:56 user nova-compute[73188]:   <target dev="vdc" bus="virtio"/>
Aug 15 19:49:56 user nova-compute[73188]:   <serial>ca50676e-6559-4144-b98a-b615604047cf</serial>
Aug 15 19:49:56 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 19:49:56 user nova-compute[73188]: </disk>
Aug 15 19:49:56 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:49:56 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Successfully detached device vdc from instance 3dac87a8-1d6a-4277-858b-abf8f77168e8 from the persistent domain config.
Aug 15 19:49:56 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3dac87a8-1d6a-4277-858b-abf8f77168e8 from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:49:56 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:49:56 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:49:56 user nova-compute[73188]:   <source dev="/dev/sdc"/>
Aug 15 19:49:56 user nova-compute[73188]:   <target dev="vdc" bus="virtio"/>
Aug 15 19:49:56 user nova-compute[73188]:   <serial>ca50676e-6559-4144-b98a-b615604047cf</serial>
Aug 15 19:49:56 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 19:49:56 user nova-compute[73188]: </disk>
Aug 15 19:49:56 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692128997.238872, 3dac87a8-1d6a-4277-858b-abf8f77168e8 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3dac87a8-1d6a-4277-858b-abf8f77168e8 {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:49:57 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Successfully detached device vdc from instance 3dac87a8-1d6a-4277-858b-abf8f77168e8 from the live domain config.
Aug 15 19:49:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMDItFNv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:49:57 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:49:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3c65fd-564b-4d35-9d6b-b0d4e6ab405e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0090f6-c7eb-4ee9-8209-1b1a8477c34f]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 (non-flash)
Aug 15 19:49:57 user nova-compute[73188]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf (non-flash)
Aug 15 19:49:57 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 (non-flash)
Aug 15 19:49:57 user nova-compute[73188]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf (non-flash)
Aug 15 19:49:57 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28082ba950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf'): ({'sdc'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Removing single pathed devices sdc {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24f0dcc-e4fc-4ac1-bbe4-a6d31ceea387]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3aaf8c-5043-440f-a35f-04bdded72a72]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Flushing IO for device /dev/sdc {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e851e4-659f-4b5b-af8a-56fdca3a5b4f]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.028s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[16236d7a-b9d6-4ac5-9f69-a20437d9d0e3]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] SCSI volumes sdc have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae4ded7-249a-4ca9-ad5c-9bb2dc4cc9b8]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc97996-28da-4efa-9084-8201fcc54419]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf, portal: 172.16.0.220,3260]
Aug 15 19:49:57 user nova-compute[73188]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf, portal: 172.16.0.220,3260] successful.
Aug 15 19:49:57 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca50676e-6559-4144-b98a-b615604047cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c6b2e7-2eb6-42cb-909a-06573abcbfd2]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] <== disconnect_volume: return (272ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:49:57 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:49:58 user nova-compute[73188]: DEBUG nova.objects.instance [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lazy-loading 'flavor' on Instance uuid 3dac87a8-1d6a-4277-858b-abf8f77168e8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:49:58 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-3fa605b2-9cd5-4d80-a67e-869f5811217d tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.614s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:50:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:50:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:50:05 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:50:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:50:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:50:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:50:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:50:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:50:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:50:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:50:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:50:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:50:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:50:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:50:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:50:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:50:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:50:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:50:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:50:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:50:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:50:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:50:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:50:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:50:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:50:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:50:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:50:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:50:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:50:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:50:42 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:50:44 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:50:46 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Acquiring lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:50:47 user nova-compute[73188]: INFO nova.compute.manager [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Detaching volume c099de2a-deca-4067-b507-4583bb7b0718
Aug 15 19:50:47 user nova-compute[73188]: INFO nova.virt.block_device [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Attempting to driver detach volume c099de2a-deca-4067-b507-4583bb7b0718 from mountpoint /dev/vdb
Aug 15 19:50:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Attempting to detach device vdb from instance 3dac87a8-1d6a-4277-858b-abf8f77168e8 from the persistent domain config. {{(pid=73188) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:50:47 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:50:47 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:50:47 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:50:47 user nova-compute[73188]:   <serial>c099de2a-deca-4067-b507-4583bb7b0718</serial>
Aug 15 19:50:47 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:50:47 user nova-compute[73188]: </disk>
Aug 15 19:50:47 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:50:47 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Successfully detached device vdb from instance 3dac87a8-1d6a-4277-858b-abf8f77168e8 from the persistent domain config.
Aug 15 19:50:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3dac87a8-1d6a-4277-858b-abf8f77168e8 from the live domain config. {{(pid=73188) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.guest [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 19:50:47 user nova-compute[73188]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 19:50:47 user nova-compute[73188]:   <source dev="/dev/sdb"/>
Aug 15 19:50:47 user nova-compute[73188]:   <target dev="vdb" bus="virtio"/>
Aug 15 19:50:47 user nova-compute[73188]:   <serial>c099de2a-deca-4067-b507-4583bb7b0718</serial>
Aug 15 19:50:47 user nova-compute[73188]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 19:50:47 user nova-compute[73188]: </disk>
Aug 15 19:50:47 user nova-compute[73188]:  {{(pid=73188) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-56a04dfe-f34a-4692-b71a-ba0172b59ae9 None None] Received event <DeviceRemovedEvent: 1692129047.718354, 3dac87a8-1d6a-4277-858b-abf8f77168e8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73188) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.driver [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3dac87a8-1d6a-4277-858b-abf8f77168e8 {{(pid=73188) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 19:50:47 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Successfully detached device vdb from instance 3dac87a8-1d6a-4277-858b-abf8f77168e8 from the live domain config.
Aug 15 19:50:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] calling os-brick to detach iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f281ccb0790>, {'target_iqns': ['iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvgVjYUA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 19:50:47 user nova-compute[73188]: WARNING os_brick.initiator.connectors.base [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 19:50:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718', 0)] {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a44cbc-2c86-467e-b9df-9f17d27d10dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1131bd56-97d0-43f9-900c-74ca4457f0c5]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 (non-flash)\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 (non-flash)
Aug 15 19:50:47 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 (non-flash)
Aug 15 19:50:47 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f280832a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718'): ({'sdb'}, set())}) {{(pid=73188) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Removing single pathed devices sdb {{(pid=73188) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[5854bddd-818a-49e2-954b-863c3aa31172]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ac6e90-19d9-401b-acfc-e1bb59d39d73]: (4, ('ok\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Flushing IO for device /dev/sdb {{(pid=73188) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1973950-54d4-4632-85b8-d5ca5553fe5b]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73188) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[de398788-21db-48db-848b-4f333babe3fa]: (4, ('1', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG os_brick.initiator.linuxscsi [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] SCSI volumes sdb have been removed. {{(pid=73188) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718')] {{(pid=73188) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[1240b50c-6589-4842-8101-8c0320dc843e]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 -p 172.16.0.220:3260 --logout {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb05f15-39af-49e2-9502-a52adef264a2]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718, portal: 172.16.0.220,3260]
Aug 15 19:50:47 user nova-compute[73188]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718, portal: 172.16.0.220,3260] successful.
Aug 15 19:50:47 user nova-compute[73188]:  stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 -p 172.16.0.220:3260 --op delete {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c099de2a-deca-4067-b507-4583bb7b0718 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83967) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c24613-903a-4af7-ae13-8fc534a7db02]: (4, ('', '')) {{(pid=83967) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73188) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.base [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG os_brick.initiator.connectors.iscsi [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] <== disconnect_volume: return (263ms) None {{(pid=73188) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 19:50:47 user nova-compute[73188]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Disconnected iSCSI Volume {{(pid=73188) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 19:50:48 user nova-compute[73188]: DEBUG nova.objects.instance [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lazy-loading 'flavor' on Instance uuid 3dac87a8-1d6a-4277-858b-abf8f77168e8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:50:48 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-57309ecb-1029-4825-bdf7-3494ec581769 tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.642s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:50:50 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:50:50 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:50:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:50:52 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:50:53 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:50:53 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:50:53 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:50:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "refresh_cache-3dac87a8-1d6a-4277-858b-abf8f77168e8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 19:50:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquired lock "refresh_cache-3dac87a8-1d6a-4277-858b-abf8f77168e8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 19:50:53 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Forcefully refreshing network info cache for instance {{(pid=73188) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 19:50:53 user nova-compute[73188]: DEBUG nova.objects.instance [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lazy-loading 'info_cache' on Instance uuid 3dac87a8-1d6a-4277-858b-abf8f77168e8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:50:54 user nova-compute[73188]: DEBUG nova.network.neutron [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Updating instance_info_cache with network_info: [{"id": "b5f446cc-6fba-410e-a615-58e5ef828375", "address": "fa:16:3e:9e:32:a8", "network": {"id": "51986952-5a55-415b-a850-9075906d3b3c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-198183386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe830c7f8efa4ae2a0e8c049e0c1e3ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f446cc-6f", "ovs_interfaceid": "b5f446cc-6fba-410e-a615-58e5ef828375", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:50:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Releasing lock "refresh_cache-3dac87a8-1d6a-4277-858b-abf8f77168e8" {{(pid=73188) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 19:50:54 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Updated the network info_cache for instance {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 19:50:54 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:50:54 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:50:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:50:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:50:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:50:54 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:50:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:50:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:50:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk --force-share --output=json {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 19:50:54 user nova-compute[73188]: DEBUG oslo_concurrency.processutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73188) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 19:50:55 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:50:55 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:50:55 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8740MB free_disk=25.128124237060547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:50:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:50:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:50:55 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Instance 3dac87a8-1d6a-4277-858b-abf8f77168e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73188) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 19:50:55 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:50:55 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:50:55 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:50:55 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:50:55 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:50:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:50:56 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:50:57 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:50:57 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:51:02 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:51:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:51:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:51:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:51:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:51:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:51:07 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:51:12 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:51:17 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:51:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:51:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:51:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:51:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:51:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:51:22 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:51:27 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:51:32 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:51:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Acquiring lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:51:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:51:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Acquiring lock "3dac87a8-1d6a-4277-858b-abf8f77168e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:51:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:51:37 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:51:37 user nova-compute[73188]: INFO nova.compute.manager [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Terminating instance
Aug 15 19:51:37 user nova-compute[73188]: DEBUG nova.compute.manager [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Start destroying the instance on the hypervisor. {{(pid=73188) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 19:51:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:51:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:51:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:51:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:51:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:51:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:51:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:51:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:51:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:51:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:51:37 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:51:38 user nova-compute[73188]: INFO nova.virt.libvirt.driver [-] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Instance destroyed successfully.
Aug 15 19:51:38 user nova-compute[73188]: DEBUG nova.objects.instance [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lazy-loading 'resources' on Instance uuid 3dac87a8-1d6a-4277-858b-abf8f77168e8 {{(pid=73188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 19:51:38 user nova-compute[73188]: DEBUG nova.virt.libvirt.vif [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T19:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-250224661',display_name='tempest-TestServerVolumeAttachmentScenario-server-250224661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-250224661',id=52,image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLC3qpVldgyAVrH6Jx8gTFyArlq5E+TgFl5fOpyt4FBa2ZgS1QSg6N1ZWYKKr1wN9fv9kCrmzv28CZYQlwh7RtJuSWsrtg3ZTS90ReqJzZz23OqoIXB7Hopzi9cdDfA2nw==',key_name='tempest-keypair-584962616',keypairs=<?>,launch_index=0,launched_at=2023-08-15T19:47:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe830c7f8efa4ae2a0e8c049e0c1e3ad',ramdisk_id='',reservation_id='r-e2bzueig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f00e830a-b2ca-4a70-976f-0b43c7345f1b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-448510547',owner_user_name='tempest-TestServerVolumeAttachmentScenario-448510547-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T19:47:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e75eecf03cd442897bc666306578859',uuid=3dac87a8-1d6a-4277-858b-abf8f77168e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5f446cc-6fba-410e-a615-58e5ef828375", "address": "fa:16:3e:9e:32:a8", "network": {"id": "51986952-5a55-415b-a850-9075906d3b3c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-198183386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe830c7f8efa4ae2a0e8c049e0c1e3ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f446cc-6f", "ovs_interfaceid": "b5f446cc-6fba-410e-a615-58e5ef828375", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 19:51:38 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Converting VIF {"id": "b5f446cc-6fba-410e-a615-58e5ef828375", "address": "fa:16:3e:9e:32:a8", "network": {"id": "51986952-5a55-415b-a850-9075906d3b3c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-198183386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe830c7f8efa4ae2a0e8c049e0c1e3ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f446cc-6f", "ovs_interfaceid": "b5f446cc-6fba-410e-a615-58e5ef828375", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 19:51:38 user nova-compute[73188]: DEBUG nova.network.os_vif_util [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:32:a8,bridge_name='br-int',has_traffic_filtering=True,id=b5f446cc-6fba-410e-a615-58e5ef828375,network=Network(51986952-5a55-415b-a850-9075906d3b3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f446cc-6f') {{(pid=73188) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 19:51:38 user nova-compute[73188]: DEBUG os_vif [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:32:a8,bridge_name='br-int',has_traffic_filtering=True,id=b5f446cc-6fba-410e-a615-58e5ef828375,network=Network(51986952-5a55-415b-a850-9075906d3b3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f446cc-6f') {{(pid=73188) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 19:51:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:51:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5f446cc-6f, bridge=br-int, if_exists=True) {{(pid=73188) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 19:51:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:51:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:51:38 user nova-compute[73188]: INFO os_vif [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:32:a8,bridge_name='br-int',has_traffic_filtering=True,id=b5f446cc-6fba-410e-a615-58e5ef828375,network=Network(51986952-5a55-415b-a850-9075906d3b3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f446cc-6f')
Aug 15 19:51:38 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Deleting instance files /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8_del
Aug 15 19:51:38 user nova-compute[73188]: INFO nova.virt.libvirt.driver [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Deletion of /opt/stack/data/nova/instances/3dac87a8-1d6a-4277-858b-abf8f77168e8_del complete
Aug 15 19:51:38 user nova-compute[73188]: INFO nova.compute.manager [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 15 19:51:38 user nova-compute[73188]: DEBUG oslo.service.loopingcall [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73188) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 19:51:38 user nova-compute[73188]: DEBUG nova.compute.manager [-] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Deallocating network for instance {{(pid=73188) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 19:51:38 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] deallocate_for_instance() {{(pid=73188) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 19:51:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-7f962fc4-bad0-4777-b8d1-33e9f3293ce4 req-ea2602df-f095-45af-99a2-029d1c6e7389 service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Received event network-vif-unplugged-b5f446cc-6fba-410e-a615-58e5ef828375 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:51:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7f962fc4-bad0-4777-b8d1-33e9f3293ce4 req-ea2602df-f095-45af-99a2-029d1c6e7389 service nova] Acquiring lock "3dac87a8-1d6a-4277-858b-abf8f77168e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:51:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7f962fc4-bad0-4777-b8d1-33e9f3293ce4 req-ea2602df-f095-45af-99a2-029d1c6e7389 service nova] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:51:38 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-7f962fc4-bad0-4777-b8d1-33e9f3293ce4 req-ea2602df-f095-45af-99a2-029d1c6e7389 service nova] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:51:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-7f962fc4-bad0-4777-b8d1-33e9f3293ce4 req-ea2602df-f095-45af-99a2-029d1c6e7389 service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] No waiting events found dispatching network-vif-unplugged-b5f446cc-6fba-410e-a615-58e5ef828375 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:51:38 user nova-compute[73188]: DEBUG nova.compute.manager [req-7f962fc4-bad0-4777-b8d1-33e9f3293ce4 req-ea2602df-f095-45af-99a2-029d1c6e7389 service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Received event network-vif-unplugged-b5f446cc-6fba-410e-a615-58e5ef828375 for instance with task_state deleting. {{(pid=73188) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 19:51:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:51:40 user nova-compute[73188]: DEBUG nova.network.neutron [-] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Updating instance_info_cache with network_info: [] {{(pid=73188) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 19:51:40 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Took 1.68 seconds to deallocate network for instance.
Aug 15 19:51:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-dc136f9f-e4ca-4549-bacc-0b95d1c61bd7 req-440617c8-1f7f-47f4-b6f3-c49ad3b08989 service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Received event network-vif-deleted-b5f446cc-6fba-410e-a615-58e5ef828375 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:51:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:51:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:51:40 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:51:40 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:51:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:51:40 user nova-compute[73188]: INFO nova.scheduler.client.report [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Deleted allocations for instance 3dac87a8-1d6a-4277-858b-abf8f77168e8
Aug 15 19:51:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-815b64d7-c428-41b1-a988-4db2b6bbee5a tempest-TestServerVolumeAttachmentScenario-448510547 tempest-TestServerVolumeAttachmentScenario-448510547-project-member] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.857s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:51:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-691cadd5-0952-4ecf-b1c6-5fc296f0e9a0 req-5eb64221-22cb-4766-9038-dab88f7709b2 service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Received event network-vif-plugged-b5f446cc-6fba-410e-a615-58e5ef828375 {{(pid=73188) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 19:51:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-691cadd5-0952-4ecf-b1c6-5fc296f0e9a0 req-5eb64221-22cb-4766-9038-dab88f7709b2 service nova] Acquiring lock "3dac87a8-1d6a-4277-858b-abf8f77168e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:51:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-691cadd5-0952-4ecf-b1c6-5fc296f0e9a0 req-5eb64221-22cb-4766-9038-dab88f7709b2 service nova] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:51:40 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [req-691cadd5-0952-4ecf-b1c6-5fc296f0e9a0 req-5eb64221-22cb-4766-9038-dab88f7709b2 service nova] Lock "3dac87a8-1d6a-4277-858b-abf8f77168e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:51:40 user nova-compute[73188]: DEBUG nova.compute.manager [req-691cadd5-0952-4ecf-b1c6-5fc296f0e9a0 req-5eb64221-22cb-4766-9038-dab88f7709b2 service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] No waiting events found dispatching network-vif-plugged-b5f446cc-6fba-410e-a615-58e5ef828375 {{(pid=73188) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 19:51:40 user nova-compute[73188]: WARNING nova.compute.manager [req-691cadd5-0952-4ecf-b1c6-5fc296f0e9a0 req-5eb64221-22cb-4766-9038-dab88f7709b2 service nova] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Received unexpected event network-vif-plugged-b5f446cc-6fba-410e-a615-58e5ef828375 for instance with vm_state deleted and task_state None.
Aug 15 19:51:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:51:46 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:51:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:51:48 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:51:48 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:51:50 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:51:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:51:51 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:51:53 user nova-compute[73188]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692129098.2818105, 3dac87a8-1d6a-4277-858b-abf8f77168e8 => Stopped> {{(pid=73188) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 19:51:53 user nova-compute[73188]: INFO nova.compute.manager [-] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] VM Stopped (Lifecycle Event)
Aug 15 19:51:53 user nova-compute[73188]: DEBUG nova.compute.manager [None req-b7b42053-fea2-4bc4-a22e-5e1ec09f1168 None None] [instance: 3dac87a8-1d6a-4277-858b-abf8f77168e8] Checking state {{(pid=73188) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 19:51:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:51:53 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:51:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:51:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:51:53 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:51:53 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:51:54 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:51:54 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:51:54 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8885MB free_disk=25.155399322509766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:51:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:51:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:51:54 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:51:54 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:51:54 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing inventories for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 19:51:54 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Updating ProviderTree inventory for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 19:51:54 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Updating inventory in ProviderTree for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 19:51:54 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing aggregate associations for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5, aggregates: None {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 19:51:54 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Refreshing trait associations for resource provider 63d71eac-d5e2-446b-a323-b32b3e9557e5, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE {{(pid=73188) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 19:51:54 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:51:54 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:51:54 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:51:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:51:55 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:51:55 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:51:55 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:51:55 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Didn't find any instances for network info cache update. {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 19:51:55 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:51:56 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:51:57 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:51:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:52:02 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:52:02 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=73188) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 19:52:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:52:07 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:52:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:52:08 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:52:08 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Cleaning up deleted instances {{(pid=73188) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 19:52:08 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] There are 0 instances to clean {{(pid=73188) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 19:52:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:52:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:52:23 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:52:28 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:52:30 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:52:33 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:52:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 19:52:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:52:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73188) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 19:52:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:52:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73188) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 19:52:38 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:52:43 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:52:47 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:52:48 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:52:49 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:52:49 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._sync_power_states {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:52:50 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:52:50 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73188) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 19:52:51 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:52:51 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:52:53 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:52:54 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:52:54 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:52:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:52:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:52:54 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:52:54 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Auditing locally available compute resources for user (node: user) {{(pid=73188) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 19:52:54 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:52:55 user nova-compute[73188]: WARNING nova.virt.libvirt.driver [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 19:52:55 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Hypervisor/Node resource view: name=user free_ram=8880MB free_disk=25.154216766357422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73188) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 19:52:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 19:52:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 19:52:55 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 19:52:55 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73188) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 19:52:55 user nova-compute[73188]: DEBUG nova.compute.provider_tree [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed in ProviderTree for provider: 63d71eac-d5e2-446b-a323-b32b3e9557e5 {{(pid=73188) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 19:52:55 user nova-compute[73188]: DEBUG nova.scheduler.client.report [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Inventory has not changed for provider 63d71eac-d5e2-446b-a323-b32b3e9557e5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73188) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 19:52:55 user nova-compute[73188]: DEBUG nova.compute.resource_tracker [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Compute_service record updated for user:user {{(pid=73188) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 19:52:55 user nova-compute[73188]: DEBUG oslo_concurrency.lockutils [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=73188) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 19:52:56 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:52:56 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:52:56 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Starting heal instance info cache {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 19:52:56 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Rebuilding the list of instances to heal {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 19:52:56 user nova-compute[73188]: DEBUG nova.compute.manager [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Didn't find any instances for network info cache update. {{(pid=73188) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 19:52:57 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:52:58 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:52:58 user nova-compute[73188]: DEBUG oslo_service.periodic_task [None req-952ec477-cc2a-4fb4-9069-ff1cc820a18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73188) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 19:53:03 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:53:08 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:53:13 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 19:53:18 user nova-compute[73188]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73188) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}